Jul 14 11:09:20.693810 ip-10-0-142-177 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 11:09:20.693825 ip-10-0-142-177 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 11:09:20.693833 ip-10-0-142-177 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 11:09:20.694184 ip-10-0-142-177 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 11:09:30.770419 ip-10-0-142-177 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 11:09:30.770435 ip-10-0-142-177 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 7ab3df43e6ca42608127b34842e90556 -- Jul 14 11:11:20.350662 ip-10-0-142-177 systemd[1]: Starting Kubernetes Kubelet... Jul 14 11:11:20.778480 ip-10-0-142-177 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 11:11:20.778480 ip-10-0-142-177 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 11:11:20.778480 ip-10-0-142-177 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 11:11:20.778480 ip-10-0-142-177 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 11:11:20.778480 ip-10-0-142-177 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 11:11:20.778480 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.747069 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 11:11:20.778480 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756143 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:20.778480 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756158 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:20.778480 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756163 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:20.778480 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756169 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:20.778480 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756174 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:20.778480 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756178 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:20.778480 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756182 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:20.778480 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756187 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756193 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756196 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756200 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756204 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756208 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756212 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756215 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756219 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756230 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756234 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756237 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756242 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756245 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756251 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756254 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756259 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756262 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756266 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:20.779561 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756272 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756278 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756282 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756286 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756290 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756294 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756298 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756301 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756306 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756309 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756326 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756330 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756335 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756340 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756344 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756348 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756352 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756355 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756359 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756363 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:20.780635 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756367 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756371 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756374 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756378 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756383 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756386 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756390 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756394 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756397 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756401 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756405 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756408 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756412 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756416 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756419 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756423 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756427 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756433 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756436 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:20.781499 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756440 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756444 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756448 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756451 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756455 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756459 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756463 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756466 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756470 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756474 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756477 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756483 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756487 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756491 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756495 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756500 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756505 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756509 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756514 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:20.782593 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756519 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756523 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756527 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756530 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756533 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756537 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756540 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756544 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756549 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756553 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756557 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756560 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756564 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756569 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.756573 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757541 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757551 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757557 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757562 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757567 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:20.783671 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757571 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757575 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757580 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757584 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757588 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757592 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757596 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757599 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757602 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757606 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757610 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757614 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757618 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757622 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757626 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757630 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757634 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757637 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757641 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757645 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:20.784558 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757649 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757654 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757658 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757662 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757666 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757670 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757673 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757677 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757680 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757684 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757688 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757691 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757695 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757698 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757702 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757705 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757710 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757714 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757717 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757721 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:20.785636 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757725 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757728 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757732 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757736 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757740 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757745 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757749 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757752 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757756 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757760 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757763 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757766 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757768 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757773 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757776 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757779 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757782 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757785 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757789 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:20.786504 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757793 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757797 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757802 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757804 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757808 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757811 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757815 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757819 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757822 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757825 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757828 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757834 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757840 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757844 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757848 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757857 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757862 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757867 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757872 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:20.787572 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757877 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757881 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757886 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757890 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757895 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757899 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757903 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757907 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757911 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757915 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757919 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757923 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757927 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757931 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757935 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.757939 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759633 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759645 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759649 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:20.788632 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759653 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759665 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759669 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759673 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759677 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759683 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759689 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759694 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759699 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759706 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759711 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759716 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759723 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759738 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759743 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759747 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759751 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759756 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759760 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:20.789491 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759765 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759769 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759773 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759778 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759782 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759786 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759790 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759798 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759802 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759807 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759811 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759815 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759819 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759824 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759829 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759833 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759837 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759841 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759845 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759849 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:20.790563 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759858 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759862 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759870 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759875 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759880 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759886 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759889 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759899 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759903 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759907 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759911 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759918 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759922 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759927 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759931 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759935 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759939 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759943 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759947 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:20.791649 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759951 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759955 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759958 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759962 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759966 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759974 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759978 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759984 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759988 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759992 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.759996 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760000 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760006 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760010 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760015 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760022 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760026 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760031 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760039 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760043 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:20.792559 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760048 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760053 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760061 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760065 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760069 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760076 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760080 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760084 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760088 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760095 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760098 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760101 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760105 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760110 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760114 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760118 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760122 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.760127 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760249 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760261 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760269 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 11:11:20.793446 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760279 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760285 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760290 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760297 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760303 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760306 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760339 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760345 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760355 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760360 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760365 2561 flags.go:64] FLAG: --cgroup-root="" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760369 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760380 2561 flags.go:64] FLAG: --client-ca-file="" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760390 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760395 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760401 2561 flags.go:64] FLAG: --cluster-domain="" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760406 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760415 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760420 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760426 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760432 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760436 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760441 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 11:11:20.794564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760447 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760451 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760459 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760464 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760470 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760474 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760480 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760486 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760491 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760495 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760504 2561 flags.go:64] FLAG: --enable-server="true" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760508 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760513 2561 flags.go:64] FLAG: --event-burst="100" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760517 2561 flags.go:64] FLAG: --event-qps="50" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760522 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760528 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760533 2561 flags.go:64] FLAG: --eviction-hard="" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760543 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760552 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760561 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760567 2561 flags.go:64] FLAG: --eviction-soft="" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760572 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760578 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760583 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760587 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 11:11:20.795464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760591 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760596 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760604 2561 flags.go:64] FLAG: --feature-gates="" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760610 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760615 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760620 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760625 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760630 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760634 2561 flags.go:64] FLAG: --help="false" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760638 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-142-177.ec2.internal" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760643 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760651 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760656 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760661 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760668 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760672 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760677 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760682 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760686 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760695 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760700 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760704 2561 flags.go:64] FLAG: --kube-reserved="" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760714 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760718 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 11:11:20.796574 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760721 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760724 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760728 2561 flags.go:64] FLAG: --lock-file="" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760733 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760741 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760746 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760755 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760760 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760764 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760769 2561 flags.go:64] FLAG: --logging-format="text" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760774 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760779 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760787 2561 flags.go:64] FLAG: --manifest-url="" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760791 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760797 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760802 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760808 2561 flags.go:64] FLAG: --max-pods="110" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760812 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760817 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760821 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760829 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760835 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760841 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760846 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760856 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 11:11:20.799593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760861 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760890 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760901 2561 flags.go:64] FLAG: --pod-cidr="" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760906 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760915 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760920 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760925 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760928 2561 flags.go:64] FLAG: --port="10250" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760932 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760936 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0562cdd70dfecfc9c" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760941 2561 flags.go:64] FLAG: --qos-reserved="" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760950 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760955 2561 flags.go:64] FLAG: --register-node="true" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760959 2561 flags.go:64] FLAG: --register-with-taints="" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760966 2561 flags.go:64] FLAG: --registry-burst="10" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760971 2561 flags.go:64] FLAG: --registry-qps="5" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760975 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760979 2561 flags.go:64] FLAG: --reserved-memory="" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760985 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760993 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.760998 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761003 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761007 2561 flags.go:64] FLAG: --runonce="false" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761012 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761017 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 11:11:20.800672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761022 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761026 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761031 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761044 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761050 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761056 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761061 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761065 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761070 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761075 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761081 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761090 2561 flags.go:64] FLAG: --system-cgroups="" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761096 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761107 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761112 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761116 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761123 2561 flags.go:64] FLAG: --tls-min-version="" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761127 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761135 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761138 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761142 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761148 2561 flags.go:64] FLAG: --v="2" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761155 2561 flags.go:64] FLAG: --version="false" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761162 2561 flags.go:64] FLAG: --vmodule="" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761168 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 11:11:20.802157 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.761172 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761539 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761547 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761553 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761557 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761561 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761565 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761570 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761574 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761579 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761585 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761592 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761597 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761601 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761606 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761610 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761619 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761623 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761627 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:20.803256 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761632 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761637 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761641 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761645 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761649 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761653 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761657 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761661 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761665 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761673 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761677 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761681 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761685 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761690 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761698 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761702 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761706 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761710 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761714 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761718 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:20.804308 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761721 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761726 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761733 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761737 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761742 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761747 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761751 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761754 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761757 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761760 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761764 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761767 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761771 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761776 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761784 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761788 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761792 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761795 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761800 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761804 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:20.805190 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761808 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761812 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761816 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761820 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761824 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761828 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761833 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761841 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761845 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761849 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761854 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761861 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761866 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761869 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761873 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761877 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761883 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761887 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761891 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:20.912950 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761899 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:20.851797 ip-10-0-142-177 systemd[1]: Started Kubernetes Kubelet. Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761905 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761910 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761914 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761919 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761923 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761929 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761935 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761940 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761945 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761948 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761952 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761960 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761964 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761967 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761970 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761973 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761977 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761982 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:20.913927 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761987 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:20.915662 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761991 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:20.915662 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.761995 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:20.915662 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.765348 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 11:11:20.915662 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.774478 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 11:11:20.915662 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.774493 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 11:11:20.915662 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.774512 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 11:11:20.915662 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.774519 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 11:11:20.915662 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774576 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:20.915662 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774581 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:20.915662 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774585 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:20.915662 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774589 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:20.915662 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774592 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:20.915662 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774595 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:20.915662 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774598 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:20.915662 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774601 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774604 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774607 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774610 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774612 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774615 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774618 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774620 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774623 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774626 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774628 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774631 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774633 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774636 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774639 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774641 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774644 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774647 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774650 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774652 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:20.916760 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774655 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774658 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774660 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774663 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774665 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774668 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774671 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774673 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774676 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774680 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774684 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774689 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774692 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774695 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774699 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774702 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774705 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774709 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774712 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:20.918029 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774715 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774722 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774725 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774728 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774731 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774734 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774737 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774741 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774745 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774748 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774750 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774753 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774755 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774758 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774760 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774763 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774766 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774768 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774771 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774773 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:20.922364 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774776 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774779 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774781 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774783 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774789 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774791 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774794 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774797 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774799 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774802 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774805 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774807 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774810 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774813 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774816 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774819 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774821 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774824 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774826 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774829 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:20.923640 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774831 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:20.924736 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774834 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:20.924736 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774836 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:20.924736 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774839 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:20.924736 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774842 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:20.924736 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774845 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:20.924736 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774847 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:20.924736 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774850 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:20.924736 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774853 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:20.924736 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774855 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:20.924736 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774858 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:20.924736 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774860 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:20.924736 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774863 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:20.924736 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.774868 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 11:11:20.924736 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774974 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 11:11:20.924736 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774979 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774982 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774986 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774988 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774991 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774994 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774996 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.774999 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775001 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775004 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775008 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775011 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775013 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775016 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775018 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775021 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775023 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775026 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775028 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775031 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 11:11:20.926699 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775034 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775037 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775040 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775043 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775046 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775049 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775051 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775054 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775056 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775059 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775061 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775064 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775067 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775069 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775073 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775075 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775078 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775080 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775083 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775085 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 11:11:20.927841 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775088 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775090 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775094 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775097 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775099 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775102 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775105 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775108 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775110 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775113 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775115 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775118 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775120 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775123 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775125 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775128 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775131 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775134 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775137 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 11:11:20.928913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775140 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775144 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775148 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775152 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775154 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775157 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775161 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775165 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775168 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775171 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775174 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775177 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775180 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775182 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775185 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775188 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775191 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775193 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775196 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 11:11:20.930847 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775198 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775201 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775203 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775206 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775208 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775211 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775213 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775216 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775219 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775221 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775232 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775235 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775238 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775241 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775243 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775246 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775248 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775251 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775253 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 11:11:20.931850 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:20.775256 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 11:11:20.933355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.775263 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 11:11:20.933355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.775390 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 11:11:20.933355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.777284 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 11:11:20.933355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.778415 2561 server.go:1019] "Starting client certificate rotation" Jul 14 11:11:20.933355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.778514 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 11:11:20.933355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.778548 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 11:11:20.933355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.780356 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 11:11:20.933355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.781495 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 11:11:20.933355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.805634 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 11:11:20.933355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.817155 2561 log.go:25] "Validated CRI v1 runtime API" Jul 14 11:11:20.933355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.819041 2561 log.go:25] "Validated CRI v1 image API" Jul 14 11:11:20.933355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.819736 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 11:11:20.933987 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.822021 2561 fs.go:135] Filesystem UUIDs: map[2cdaa58f-c7f7-41ec-9527-c116fae0fb59:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f7f19490-ce51-4a26-97be-09715c7f8667:/dev/nvme0n1p3] Jul 14 11:11:20.933987 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.822045 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.827211 2561 manager.go:216] Machine: {Timestamp:2026-07-14 11:11:20.826116629 +0000 UTC m=+0.373369784 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3107504 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec297c61cda057ff7853dfd20e98c3b1 SystemUUID:ec297c61-cda0-57ff-7853-dfd20e98c3b1 BootID:7ab3df43-e6ca-4260-8127-b34842e90556 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:81:21:57:42:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:81:21:57:42:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:dc:44:10:0d:27 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.827331 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.827415 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.833607 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.833639 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-177.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.834231 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.834240 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.834247 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.834261 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.835354 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.838967 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.839078 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.839106 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.839115 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.839130 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.839139 2561 kubelet.go:398] "Adding apiserver pod source" Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.839149 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 11:11:20.935269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.839471 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.839488 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.841272 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.843809 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.843846 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.844035 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.844049 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.844058 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.844067 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.844078 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.844086 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.847195 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.847205 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.847214 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.847221 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.847250 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.847259 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.847850 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.847857 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.850267 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-177.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:20.850287 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:20.850465 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.850943 2561 server.go:1268] "Started kubelet" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.851011 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.851011 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.851069 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.852108 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.852964 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:20.855753 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.856786 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.856793 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:20.856886 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.857269 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.857271 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.857292 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.857404 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.857411 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.857528 2561 factory.go:55] Registering systemd factory Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.857543 2561 factory.go:223] Registration of the systemd container factory successfully Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.857740 2561 factory.go:153] Registering CRI-O factory Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.857752 2561 factory.go:223] Registration of the crio container factory successfully Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.857804 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.857827 2561 factory.go:103] Registering Raw factory Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.857841 2561 manager.go:1196] Started watching for new ooms in manager Jul 14 11:11:20.936135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.858611 2561 manager.go:349] Starting recovery of all containers Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:20.858403 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-177.ec2.internal.18c2238aa9a76a31 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-177.ec2.internal,UID:ip-10-0-142-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-177.ec2.internal,},FirstTimestamp:2026-07-14 11:11:20.850917937 +0000 UTC m=+0.398171093,LastTimestamp:2026-07-14 11:11:20.850917937 +0000 UTC m=+0.398171093,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-177.ec2.internal,}" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.861516 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jngc8" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:20.865466 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:20.865653 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.868438 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jngc8" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.872589 2561 manager.go:354] Recovery completed Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.877025 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.879598 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.879625 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.879637 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.880169 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.880179 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.880180 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.880223 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.881135 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.881163 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.881177 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.882195 2561 policy_none.go:49] "None policy: Start" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.882207 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.882217 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 11:11:20.937864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.884152 2561 policy_none.go:47] "Start" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:20.957002 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.959699 2561 manager.go:337] "Starting Device Plugin manager" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:20.959739 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.959752 2561 server.go:87] "Starting device plugin registration server" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.960038 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.960051 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.960146 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.960253 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:20.960264 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:20.961089 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:20.961132 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-177.ec2.internal\" not found" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.282579 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.283529 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.283560 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.283576 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.283616 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.295865 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.297105 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.297142 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.297163 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:22.297217 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.297835 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:22.297855 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-177.ec2.internal\": node \"ip-10-0-142-177.ec2.internal\" not found" Jul 14 11:11:22.378471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.304893 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:11:22.387969 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:22.386974 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.397990 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal"] Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.398094 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.399847 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.399882 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.399895 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.404009 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.404107 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.404137 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.404727 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.404760 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.404779 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.404791 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.404762 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.404841 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.409065 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.409089 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.409715 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientMemory" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.409743 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.409755 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientPID" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:22.421783 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-177.ec2.internal\" not found" node="ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:22.426483 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-177.ec2.internal\" not found" node="ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.480327 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/342f8b0e0e5d8cd59103fbf014e7c2aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal\" (UID: \"342f8b0e0e5d8cd59103fbf014e7c2aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.480357 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d609c1ee768fe3daa3f23cbaf1c3121-config\") pod \"kube-apiserver-proxy-ip-10-0-142-177.ec2.internal\" (UID: \"8d609c1ee768fe3daa3f23cbaf1c3121\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.480374 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/342f8b0e0e5d8cd59103fbf014e7c2aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal\" (UID: \"342f8b0e0e5d8cd59103fbf014e7c2aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.521554 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:22.488018 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found" Jul 14 11:11:22.696152 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.581232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/342f8b0e0e5d8cd59103fbf014e7c2aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal\" (UID: \"342f8b0e0e5d8cd59103fbf014e7c2aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.696152 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.581261 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/342f8b0e0e5d8cd59103fbf014e7c2aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal\" (UID: \"342f8b0e0e5d8cd59103fbf014e7c2aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.696152 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.581279 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d609c1ee768fe3daa3f23cbaf1c3121-config\") pod \"kube-apiserver-proxy-ip-10-0-142-177.ec2.internal\" (UID: \"8d609c1ee768fe3daa3f23cbaf1c3121\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.696152 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.581326 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d609c1ee768fe3daa3f23cbaf1c3121-config\") pod \"kube-apiserver-proxy-ip-10-0-142-177.ec2.internal\" (UID: \"8d609c1ee768fe3daa3f23cbaf1c3121\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.696152 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.581338 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/342f8b0e0e5d8cd59103fbf014e7c2aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal\" (UID: \"342f8b0e0e5d8cd59103fbf014e7c2aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.696152 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.581361 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/342f8b0e0e5d8cd59103fbf014e7c2aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal\" (UID: \"342f8b0e0e5d8cd59103fbf014e7c2aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.696152 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:22.588319 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found" Jul 14 11:11:22.696152 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:22.689075 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found" Jul 14 11:11:22.874908 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.728297 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.874908 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.728355 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" Jul 14 11:11:22.874908 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:22.789548 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found" Jul 14 11:11:23.080498 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:22.890008 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found" Jul 14 11:11:23.080498 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:22.990476 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found" Jul 14 11:11:23.080498 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.999562 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 11:11:23.080498 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:22.999718 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 11:11:23.305577 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:23.091412 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found" Jul 14 11:11:23.305577 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:23.094903 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 11:06:22 +0000 UTC" deadline="2028-04-13 08:00:34.833399856 +0000 UTC" Jul 14 11:11:23.305577 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:23.094929 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15332h49m11.738474032s" Jul 14 11:11:23.305577 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:23.191978 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found" Jul 14 11:11:23.305577 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:23.199668 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:11:23.305577 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:23.279185 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal" Jul 14 11:11:23.305577 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:23.293776 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 11:11:23.305577 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:23.295074 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" Jul 14 11:11:23.438648 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:23.310620 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 11:11:23.438648 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:23.363905 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:11:23.585191 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:23.565132 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d609c1ee768fe3daa3f23cbaf1c3121.slice/crio-96563b1c2779a88f23a2abe813aa191e770d874330ba8af36539d79bcf2a5080 WatchSource:0}: Error finding container 96563b1c2779a88f23a2abe813aa191e770d874330ba8af36539d79bcf2a5080: Status 404 returned error can't find the container with id 96563b1c2779a88f23a2abe813aa191e770d874330ba8af36539d79bcf2a5080 Jul 14 11:11:23.585191 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:23.565904 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342f8b0e0e5d8cd59103fbf014e7c2aa.slice/crio-e2302e54f961c51a682d5614653de61318839ac3aff630b6fcb6916901ae6f31 WatchSource:0}: Error finding container e2302e54f961c51a682d5614653de61318839ac3aff630b6fcb6916901ae6f31: Status 404 returned error can't find the container with id e2302e54f961c51a682d5614653de61318839ac3aff630b6fcb6916901ae6f31 Jul 14 11:11:23.585191 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:23.573493 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 11:11:23.590176 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:23.590157 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:11:24.062929 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.062890 2561 apiserver.go:52] "Watching apiserver" Jul 14 11:11:24.075471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.075442 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 11:11:24.075808 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.075785 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal","openshift-multus/multus-additional-cni-plugins-f27xq","openshift-multus/network-metrics-daemon-hmxjp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k","openshift-dns/node-resolver-r58z6","openshift-multus/multus-d4w8p","openshift-network-diagnostics/network-check-target-fw8ms","openshift-network-operator/iptables-alerter-kz9z4","openshift-ovn-kubernetes/ovnkube-node-5f7fw","kube-system/global-pull-secret-syncer-7pfjj","kube-system/konnectivity-agent-fkmdx","kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal","openshift-cluster-node-tuning-operator/tuned-bklkq","openshift-image-registry/node-ca-lhdnx"] Jul 14 11:11:24.078290 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.078273 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:24.078374 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.078341 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:24.079779 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.079760 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 11:11:24.080451 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.080431 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.082629 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.082599 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:24.083159 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.082672 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:24.085634 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.085618 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.088037 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.087981 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r58z6" Jul 14 11:11:24.088740 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.088719 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-var-lib-kubelet\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.088801 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.088757 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-host\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.088801 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.088782 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-tuned\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.088882 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.088807 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-modprobe-d\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.088882 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.088851 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-sysconfig\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.088975 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.088882 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-sysctl-conf\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.088975 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.088909 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgw4w\" (UniqueName: \"kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w\") pod \"network-check-target-fw8ms\" (UID: \"1864e70c-c595-4f7a-8c60-63e7e8eb5049\") " pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:24.088975 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.088934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-run\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.088975 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.088957 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmlpv\" (UniqueName: \"kubernetes.io/projected/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-kube-api-access-qmlpv\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.089185 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.088981 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-systemd\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.089185 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.089001 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-lib-modules\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.089185 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.089056 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-tmp\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.089185 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.089079 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-kubernetes\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.089185 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.089100 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-sysctl-d\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.089185 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.089127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-sys\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.089604 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.089485 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 11:11:24.089604 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.089539 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:11:24.090264 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.090247 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.092013 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.091993 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-npkh5\"" Jul 14 11:11:24.093060 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.092600 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 11:11:24.093060 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.092679 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.093231 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.093187 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 11:11:24.093292 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.093232 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 11:11:24.093344 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.093324 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4pr82\"" Jul 14 11:11:24.093617 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.093602 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 11:11:24.093673 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.093616 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rgkcg\"" Jul 14 11:11:24.093838 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.093824 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jkjgp\"" Jul 14 11:11:24.094448 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.094008 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 11:11:24.094448 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.094019 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 11:11:24.094448 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.094251 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 11:11:24.094652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.094509 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 11:11:24.096619 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.094975 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 11:11:24.096619 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.095363 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lhdnx" Jul 14 11:11:24.096619 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.095484 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 11:11:24.098825 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.098631 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.100952 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.100932 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:24.101061 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.101029 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:24.101543 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.101522 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 11:11:24.101664 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.101644 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 11:11:24.103304 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.103282 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fkmdx" Jul 14 11:11:24.104564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.104543 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 11:11:24.104652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.104638 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 11:11:24.105125 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.104769 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 11:11:24.105125 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.104813 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 11:11:24.105125 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.104962 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 11:11:24.105125 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.105009 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6c78x\"" Jul 14 11:11:24.105125 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.105035 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 11:11:24.105125 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.105057 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ph787\"" Jul 14 11:11:24.105125 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.105104 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 11:11:24.105781 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.105760 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kz9z4" Jul 14 11:11:24.106194 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.106102 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 11:11:24.106194 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.106176 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pd8nn\"" Jul 14 11:11:24.110788 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.110660 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:11:24.111978 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.111634 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 11:11:24.111978 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.111744 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 11:11:24.111978 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.111870 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-46tk9\"" Jul 14 11:11:24.111978 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.111978 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 11:11:24.112367 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.112351 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 11:11:24.112436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.112380 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9r85h\"" Jul 14 11:11:24.115326 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.115253 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 11:11:24.180937 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.180914 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 11:11:24.190236 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190193 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-var-lib-cni-bin\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.190369 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190244 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de833d9f-3bca-4b05-9a86-ba9e8190d1db-kubelet-config\") pod \"global-pull-secret-syncer-7pfjj\" (UID: \"de833d9f-3bca-4b05-9a86-ba9e8190d1db\") " pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:24.190369 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190273 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7e645e6-079b-4e74-b3a2-65531e9e97e1-host-slash\") pod \"iptables-alerter-kz9z4\" (UID: \"a7e645e6-079b-4e74-b3a2-65531e9e97e1\") " pod="openshift-network-operator/iptables-alerter-kz9z4" Jul 14 11:11:24.190369 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-systemd\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.190369 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190328 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-run-systemd\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.190571 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190380 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13c62ac1-9cc1-4173-aff2-73f5d52b947a-os-release\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.190571 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190403 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-systemd\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.190571 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190415 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13c62ac1-9cc1-4173-aff2-73f5d52b947a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.190571 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4451af9-77df-48c7-b30e-af0fa19dc5b8-tmp-dir\") pod \"node-resolver-r58z6\" (UID: \"c4451af9-77df-48c7-b30e-af0fa19dc5b8\") " pod="openshift-dns/node-resolver-r58z6" Jul 14 11:11:24.190571 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-modprobe-d\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.190571 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190538 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-sysconfig\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.190571 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-sysctl-conf\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.190879 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190589 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.190879 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190618 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/141a8f07-befb-41e6-b4b2-779001f4c51d-serviceca\") pod \"node-ca-lhdnx\" (UID: \"141a8f07-befb-41e6-b4b2-779001f4c51d\") " pod="openshift-image-registry/node-ca-lhdnx" Jul 14 11:11:24.190879 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190622 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-sysconfig\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.190879 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190651 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-modprobe-d\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.190879 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190641 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edca702e-dc81-46ff-aef0-acce244e82b5-cni-binary-copy\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.190879 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190689 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de833d9f-3bca-4b05-9a86-ba9e8190d1db-dbus\") pod \"global-pull-secret-syncer-7pfjj\" (UID: \"de833d9f-3bca-4b05-9a86-ba9e8190d1db\") " pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:24.190879 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190714 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret\") pod \"global-pull-secret-syncer-7pfjj\" (UID: \"de833d9f-3bca-4b05-9a86-ba9e8190d1db\") " pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:24.190879 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190722 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-sysctl-conf\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.190879 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13c62ac1-9cc1-4173-aff2-73f5d52b947a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.190879 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190761 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-var-lib-openvswitch\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.190879 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190794 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13c62ac1-9cc1-4173-aff2-73f5d52b947a-system-cni-dir\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.190879 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190819 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjxcb\" (UniqueName: \"kubernetes.io/projected/13c62ac1-9cc1-4173-aff2-73f5d52b947a-kube-api-access-cjxcb\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.190879 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190858 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30f4de5a-b5b3-4014-b76a-8bd4cde96a63-agent-certs\") pod \"konnectivity-agent-fkmdx\" (UID: \"30f4de5a-b5b3-4014-b76a-8bd4cde96a63\") " pod="kube-system/konnectivity-agent-fkmdx" Jul 14 11:11:24.190879 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190881 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30f4de5a-b5b3-4014-b76a-8bd4cde96a63-konnectivity-ca\") pod \"konnectivity-agent-fkmdx\" (UID: \"30f4de5a-b5b3-4014-b76a-8bd4cde96a63\") " pod="kube-system/konnectivity-agent-fkmdx" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190903 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhfzv\" (UniqueName: \"kubernetes.io/projected/a7e645e6-079b-4e74-b3a2-65531e9e97e1-kube-api-access-nhfzv\") pod \"iptables-alerter-kz9z4\" (UID: \"a7e645e6-079b-4e74-b3a2-65531e9e97e1\") " pod="openshift-network-operator/iptables-alerter-kz9z4" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.190941 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9309eb9c-300d-4840-a58f-2c93d2c41bfe-ovnkube-config\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191003 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6vxk\" (UniqueName: \"kubernetes.io/projected/9309eb9c-300d-4840-a58f-2c93d2c41bfe-kube-api-access-d6vxk\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191033 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-sysctl-d\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-host\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191081 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-run-openvswitch\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191105 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-run-ovn\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-cni-netd\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-system-cni-dir\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191158 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-host\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191173 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-os-release\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191162 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-sysctl-d\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191218 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-socket-dir\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191245 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-log-socket\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191272 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-run-ovn-kubernetes\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191295 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13c62ac1-9cc1-4173-aff2-73f5d52b947a-cnibin\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.191502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191317 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxpm8\" (UniqueName: \"kubernetes.io/projected/c4451af9-77df-48c7-b30e-af0fa19dc5b8-kube-api-access-gxpm8\") pod \"node-resolver-r58z6\" (UID: \"c4451af9-77df-48c7-b30e-af0fa19dc5b8\") " pod="openshift-dns/node-resolver-r58z6" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191350 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-multus-cni-dir\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191375 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-multus-socket-dir-parent\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191398 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-registration-dir\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191418 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9309eb9c-300d-4840-a58f-2c93d2c41bfe-env-overrides\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edca702e-dc81-46ff-aef0-acce244e82b5-multus-daemon-config\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191472 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-tmp\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191548 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx7cw\" (UniqueName: \"kubernetes.io/projected/e071bfee-a93c-4c4e-92fa-ee406aced61a-kube-api-access-rx7cw\") pod \"network-metrics-daemon-hmxjp\" (UID: \"e071bfee-a93c-4c4e-92fa-ee406aced61a\") " pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191584 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191606 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-etc-selinux\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191646 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-node-log\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191674 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9309eb9c-300d-4840-a58f-2c93d2c41bfe-ovnkube-script-lib\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191687 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/141a8f07-befb-41e6-b4b2-779001f4c51d-host\") pod \"node-ca-lhdnx\" (UID: \"141a8f07-befb-41e6-b4b2-779001f4c51d\") " pod="openshift-image-registry/node-ca-lhdnx" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191702 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13c62ac1-9cc1-4173-aff2-73f5d52b947a-cni-binary-copy\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191753 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-kubernetes\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191777 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-sys\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191774 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 11:11:24.192220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191804 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-var-lib-kubelet\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191827 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-tuned\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191851 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-slash\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191878 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-cnibin\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.191901 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7e645e6-079b-4e74-b3a2-65531e9e97e1-iptables-alerter-script\") pod \"iptables-alerter-kz9z4\" (UID: \"a7e645e6-079b-4e74-b3a2-65531e9e97e1\") " pod="openshift-network-operator/iptables-alerter-kz9z4" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192000 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs\") pod \"network-metrics-daemon-hmxjp\" (UID: \"e071bfee-a93c-4c4e-92fa-ee406aced61a\") " pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192025 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-device-dir\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192056 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-run-netns\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c4451af9-77df-48c7-b30e-af0fa19dc5b8-hosts-file\") pod \"node-resolver-r58z6\" (UID: \"c4451af9-77df-48c7-b30e-af0fa19dc5b8\") " pod="openshift-dns/node-resolver-r58z6" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192104 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-run-k8s-cni-cncf-io\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192142 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-var-lib-kubelet\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgw4w\" (UniqueName: \"kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w\") pod \"network-check-target-fw8ms\" (UID: \"1864e70c-c595-4f7a-8c60-63e7e8eb5049\") " pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmlpv\" (UniqueName: \"kubernetes.io/projected/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-kube-api-access-qmlpv\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192225 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-kubernetes\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192240 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-etc-openvswitch\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-multus-conf-dir\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192286 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-run-multus-certs\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.193031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192292 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-var-lib-kubelet\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-etc-kubernetes\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192145 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-sys\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192418 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-lib-modules\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192444 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-run-netns\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192471 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-hostroot\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192493 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-kubelet\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192518 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-cni-bin\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192541 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9309eb9c-300d-4840-a58f-2c93d2c41bfe-ovn-node-metrics-cert\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.192937 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-lib-modules\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.193098 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxz8m\" (UniqueName: \"kubernetes.io/projected/141a8f07-befb-41e6-b4b2-779001f4c51d-kube-api-access-xxz8m\") pod \"node-ca-lhdnx\" (UID: \"141a8f07-befb-41e6-b4b2-779001f4c51d\") " pod="openshift-image-registry/node-ca-lhdnx" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.193149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-sys-fs\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.193178 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr4qz\" (UniqueName: \"kubernetes.io/projected/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-kube-api-access-fr4qz\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.193224 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-systemd-units\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.193250 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13c62ac1-9cc1-4173-aff2-73f5d52b947a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.193284 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-var-lib-cni-multus\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.193312 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxjs8\" (UniqueName: \"kubernetes.io/projected/edca702e-dc81-46ff-aef0-acce244e82b5-kube-api-access-mxjs8\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.193833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.193345 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-run\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.194679 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.193449 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-run\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.196535 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.196485 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-etc-tuned\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.198460 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.198417 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-tmp\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.200452 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.200426 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v887z" Jul 14 11:11:24.218956 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.218918 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:24.218956 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.218941 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:24.218956 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.218953 2561 projected.go:196] Error preparing data for projected volume kube-api-access-vgw4w for pod openshift-network-diagnostics/network-check-target-fw8ms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:24.219174 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.219022 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w podName:1864e70c-c595-4f7a-8c60-63e7e8eb5049 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:24.718999085 +0000 UTC m=+3.044363598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vgw4w" (UniqueName: "kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w") pod "network-check-target-fw8ms" (UID: "1864e70c-c595-4f7a-8c60-63e7e8eb5049") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:24.232535 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.232470 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v887z" Jul 14 11:11:24.236047 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.236002 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmlpv\" (UniqueName: \"kubernetes.io/projected/e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b-kube-api-access-qmlpv\") pod \"tuned-bklkq\" (UID: \"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b\") " pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.256723 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.256634 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294365 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhfzv\" (UniqueName: \"kubernetes.io/projected/a7e645e6-079b-4e74-b3a2-65531e9e97e1-kube-api-access-nhfzv\") pod \"iptables-alerter-kz9z4\" (UID: \"a7e645e6-079b-4e74-b3a2-65531e9e97e1\") " pod="openshift-network-operator/iptables-alerter-kz9z4" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294402 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9309eb9c-300d-4840-a58f-2c93d2c41bfe-ovnkube-config\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6vxk\" (UniqueName: \"kubernetes.io/projected/9309eb9c-300d-4840-a58f-2c93d2c41bfe-kube-api-access-d6vxk\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294460 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-run-openvswitch\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294485 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-run-ovn\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-cni-netd\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-system-cni-dir\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-os-release\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294579 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-socket-dir\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294602 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-log-socket\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294625 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-run-ovn-kubernetes\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13c62ac1-9cc1-4173-aff2-73f5d52b947a-cnibin\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294677 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxpm8\" (UniqueName: \"kubernetes.io/projected/c4451af9-77df-48c7-b30e-af0fa19dc5b8-kube-api-access-gxpm8\") pod \"node-resolver-r58z6\" (UID: \"c4451af9-77df-48c7-b30e-af0fa19dc5b8\") " pod="openshift-dns/node-resolver-r58z6" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-multus-cni-dir\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294727 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-multus-socket-dir-parent\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294751 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-registration-dir\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.295038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9309eb9c-300d-4840-a58f-2c93d2c41bfe-env-overrides\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294799 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edca702e-dc81-46ff-aef0-acce244e82b5-multus-daemon-config\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294825 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx7cw\" (UniqueName: \"kubernetes.io/projected/e071bfee-a93c-4c4e-92fa-ee406aced61a-kube-api-access-rx7cw\") pod \"network-metrics-daemon-hmxjp\" (UID: \"e071bfee-a93c-4c4e-92fa-ee406aced61a\") " pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294848 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294871 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-etc-selinux\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294893 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-node-log\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294916 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9309eb9c-300d-4840-a58f-2c93d2c41bfe-ovnkube-script-lib\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294939 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/141a8f07-befb-41e6-b4b2-779001f4c51d-host\") pod \"node-ca-lhdnx\" (UID: \"141a8f07-befb-41e6-b4b2-779001f4c51d\") " pod="openshift-image-registry/node-ca-lhdnx" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294962 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13c62ac1-9cc1-4173-aff2-73f5d52b947a-cni-binary-copy\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.294991 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-slash\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-cnibin\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295067 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7e645e6-079b-4e74-b3a2-65531e9e97e1-iptables-alerter-script\") pod \"iptables-alerter-kz9z4\" (UID: \"a7e645e6-079b-4e74-b3a2-65531e9e97e1\") " pod="openshift-network-operator/iptables-alerter-kz9z4" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295090 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs\") pod \"network-metrics-daemon-hmxjp\" (UID: \"e071bfee-a93c-4c4e-92fa-ee406aced61a\") " pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295114 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-device-dir\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295135 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-run-netns\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295151 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9309eb9c-300d-4840-a58f-2c93d2c41bfe-ovnkube-config\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295155 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c4451af9-77df-48c7-b30e-af0fa19dc5b8-hosts-file\") pod \"node-resolver-r58z6\" (UID: \"c4451af9-77df-48c7-b30e-af0fa19dc5b8\") " pod="openshift-dns/node-resolver-r58z6" Jul 14 11:11:24.295997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295247 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-run-k8s-cni-cncf-io\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295269 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c4451af9-77df-48c7-b30e-af0fa19dc5b8-hosts-file\") pod \"node-resolver-r58z6\" (UID: \"c4451af9-77df-48c7-b30e-af0fa19dc5b8\") " pod="openshift-dns/node-resolver-r58z6" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295276 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-var-lib-kubelet\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295318 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-run-k8s-cni-cncf-io\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295340 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-etc-openvswitch\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295356 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-var-lib-kubelet\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295368 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-multus-conf-dir\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295396 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-run-multus-certs\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295422 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-etc-kubernetes\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295448 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-run-netns\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295473 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-hostroot\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295496 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-kubelet\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295522 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-cni-bin\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295550 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9309eb9c-300d-4840-a58f-2c93d2c41bfe-ovn-node-metrics-cert\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295576 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxz8m\" (UniqueName: \"kubernetes.io/projected/141a8f07-befb-41e6-b4b2-779001f4c51d-kube-api-access-xxz8m\") pod \"node-ca-lhdnx\" (UID: \"141a8f07-befb-41e6-b4b2-779001f4c51d\") " pod="openshift-image-registry/node-ca-lhdnx" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295578 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9309eb9c-300d-4840-a58f-2c93d2c41bfe-env-overrides\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-sys-fs\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295632 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr4qz\" (UniqueName: \"kubernetes.io/projected/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-kube-api-access-fr4qz\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.296774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295656 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-systemd-units\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295677 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-run-openvswitch\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295686 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13c62ac1-9cc1-4173-aff2-73f5d52b947a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295692 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-run-ovn-kubernetes\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295717 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-run-ovn\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-var-lib-cni-multus\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295755 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-cni-netd\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295753 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxjs8\" (UniqueName: \"kubernetes.io/projected/edca702e-dc81-46ff-aef0-acce244e82b5-kube-api-access-mxjs8\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295791 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-var-lib-cni-bin\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295821 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de833d9f-3bca-4b05-9a86-ba9e8190d1db-kubelet-config\") pod \"global-pull-secret-syncer-7pfjj\" (UID: \"de833d9f-3bca-4b05-9a86-ba9e8190d1db\") " pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295844 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7e645e6-079b-4e74-b3a2-65531e9e97e1-host-slash\") pod \"iptables-alerter-kz9z4\" (UID: \"a7e645e6-079b-4e74-b3a2-65531e9e97e1\") " pod="openshift-network-operator/iptables-alerter-kz9z4" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295871 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-run-systemd\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295895 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13c62ac1-9cc1-4173-aff2-73f5d52b947a-os-release\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295920 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13c62ac1-9cc1-4173-aff2-73f5d52b947a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295944 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4451af9-77df-48c7-b30e-af0fa19dc5b8-tmp-dir\") pod \"node-resolver-r58z6\" (UID: \"c4451af9-77df-48c7-b30e-af0fa19dc5b8\") " pod="openshift-dns/node-resolver-r58z6" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295974 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296001 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/141a8f07-befb-41e6-b4b2-779001f4c51d-serviceca\") pod \"node-ca-lhdnx\" (UID: \"141a8f07-befb-41e6-b4b2-779001f4c51d\") " pod="openshift-image-registry/node-ca-lhdnx" Jul 14 11:11:24.297652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296027 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edca702e-dc81-46ff-aef0-acce244e82b5-cni-binary-copy\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296050 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de833d9f-3bca-4b05-9a86-ba9e8190d1db-dbus\") pod \"global-pull-secret-syncer-7pfjj\" (UID: \"de833d9f-3bca-4b05-9a86-ba9e8190d1db\") " pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296075 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret\") pod \"global-pull-secret-syncer-7pfjj\" (UID: \"de833d9f-3bca-4b05-9a86-ba9e8190d1db\") " pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296100 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13c62ac1-9cc1-4173-aff2-73f5d52b947a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296128 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-var-lib-openvswitch\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13c62ac1-9cc1-4173-aff2-73f5d52b947a-system-cni-dir\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296180 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjxcb\" (UniqueName: \"kubernetes.io/projected/13c62ac1-9cc1-4173-aff2-73f5d52b947a-kube-api-access-cjxcb\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30f4de5a-b5b3-4014-b76a-8bd4cde96a63-agent-certs\") pod \"konnectivity-agent-fkmdx\" (UID: \"30f4de5a-b5b3-4014-b76a-8bd4cde96a63\") " pod="kube-system/konnectivity-agent-fkmdx" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30f4de5a-b5b3-4014-b76a-8bd4cde96a63-konnectivity-ca\") pod \"konnectivity-agent-fkmdx\" (UID: \"30f4de5a-b5b3-4014-b76a-8bd4cde96a63\") " pod="kube-system/konnectivity-agent-fkmdx" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296312 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edca702e-dc81-46ff-aef0-acce244e82b5-multus-daemon-config\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296358 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-system-cni-dir\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296375 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-multus-socket-dir-parent\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296400 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13c62ac1-9cc1-4173-aff2-73f5d52b947a-cnibin\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296428 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-registration-dir\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296461 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-os-release\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296462 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-var-lib-cni-multus\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296463 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-multus-cni-dir\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.298436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296636 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-var-lib-cni-bin\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296695 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de833d9f-3bca-4b05-9a86-ba9e8190d1db-kubelet-config\") pod \"global-pull-secret-syncer-7pfjj\" (UID: \"de833d9f-3bca-4b05-9a86-ba9e8190d1db\") " pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296736 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296749 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7e645e6-079b-4e74-b3a2-65531e9e97e1-host-slash\") pod \"iptables-alerter-kz9z4\" (UID: \"a7e645e6-079b-4e74-b3a2-65531e9e97e1\") " pod="openshift-network-operator/iptables-alerter-kz9z4" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296804 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-node-log\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296810 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13c62ac1-9cc1-4173-aff2-73f5d52b947a-os-release\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296947 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13c62ac1-9cc1-4173-aff2-73f5d52b947a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296947 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30f4de5a-b5b3-4014-b76a-8bd4cde96a63-konnectivity-ca\") pod \"konnectivity-agent-fkmdx\" (UID: \"30f4de5a-b5b3-4014-b76a-8bd4cde96a63\") " pod="kube-system/konnectivity-agent-fkmdx" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.297033 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-run-netns\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.297079 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/141a8f07-befb-41e6-b4b2-779001f4c51d-host\") pod \"node-ca-lhdnx\" (UID: \"141a8f07-befb-41e6-b4b2-779001f4c51d\") " pod="openshift-image-registry/node-ca-lhdnx" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.297237 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4451af9-77df-48c7-b30e-af0fa19dc5b8-tmp-dir\") pod \"node-resolver-r58z6\" (UID: \"c4451af9-77df-48c7-b30e-af0fa19dc5b8\") " pod="openshift-dns/node-resolver-r58z6" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.297329 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9309eb9c-300d-4840-a58f-2c93d2c41bfe-ovnkube-script-lib\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.297381 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-run-systemd\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295449 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-socket-dir\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.297438 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-hostroot\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.297480 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-kubelet\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.297501 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13c62ac1-9cc1-4173-aff2-73f5d52b947a-cni-binary-copy\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.297537 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-cni-bin\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.299228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.297562 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-slash\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.300006 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.297619 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-cnibin\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.301070 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.301046 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:24.301176 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.301138 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs podName:e071bfee-a93c-4c4e-92fa-ee406aced61a nodeName:}" failed. No retries permitted until 2026-07-14 11:11:24.801119199 +0000 UTC m=+3.126483716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs") pod "network-metrics-daemon-hmxjp" (UID: "e071bfee-a93c-4c4e-92fa-ee406aced61a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:24.301447 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.301428 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-device-dir\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.301532 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.301515 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-run-netns\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.301590 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.301576 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-etc-openvswitch\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.301742 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.301728 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-multus-conf-dir\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.301825 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.301788 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-host-run-multus-certs\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.301878 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.301845 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edca702e-dc81-46ff-aef0-acce244e82b5-etc-kubernetes\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.302017 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.301990 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7e645e6-079b-4e74-b3a2-65531e9e97e1-iptables-alerter-script\") pod \"iptables-alerter-kz9z4\" (UID: \"a7e645e6-079b-4e74-b3a2-65531e9e97e1\") " pod="openshift-network-operator/iptables-alerter-kz9z4" Jul 14 11:11:24.302306 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.302288 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9309eb9c-300d-4840-a58f-2c93d2c41bfe-ovn-node-metrics-cert\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.305711 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.303637 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.306020 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.305813 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de833d9f-3bca-4b05-9a86-ba9e8190d1db-dbus\") pod \"global-pull-secret-syncer-7pfjj\" (UID: \"de833d9f-3bca-4b05-9a86-ba9e8190d1db\") " pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:24.306020 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.304783 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-systemd-units\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.306020 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.296312 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/13c62ac1-9cc1-4173-aff2-73f5d52b947a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.306020 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.305024 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-sys-fs\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.306020 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.305066 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-var-lib-openvswitch\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.306020 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.305091 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13c62ac1-9cc1-4173-aff2-73f5d52b947a-system-cni-dir\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.306020 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.305195 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:24.306392 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.305299 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-etc-selinux\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.306392 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.306062 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret podName:de833d9f-3bca-4b05-9a86-ba9e8190d1db nodeName:}" failed. No retries permitted until 2026-07-14 11:11:24.806044939 +0000 UTC m=+3.131409464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret") pod "global-pull-secret-syncer-7pfjj" (UID: "de833d9f-3bca-4b05-9a86-ba9e8190d1db") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:24.306392 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.305680 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/13c62ac1-9cc1-4173-aff2-73f5d52b947a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.306392 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.295657 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9309eb9c-300d-4840-a58f-2c93d2c41bfe-log-socket\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.306392 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.305989 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edca702e-dc81-46ff-aef0-acce244e82b5-cni-binary-copy\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.306392 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.305641 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/141a8f07-befb-41e6-b4b2-779001f4c51d-serviceca\") pod \"node-ca-lhdnx\" (UID: \"141a8f07-befb-41e6-b4b2-779001f4c51d\") " pod="openshift-image-registry/node-ca-lhdnx" Jul 14 11:11:24.308090 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.308067 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30f4de5a-b5b3-4014-b76a-8bd4cde96a63-agent-certs\") pod \"konnectivity-agent-fkmdx\" (UID: \"30f4de5a-b5b3-4014-b76a-8bd4cde96a63\") " pod="kube-system/konnectivity-agent-fkmdx" Jul 14 11:11:24.308416 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.308370 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" event={"ID":"342f8b0e0e5d8cd59103fbf014e7c2aa","Type":"ContainerStarted","Data":"e2302e54f961c51a682d5614653de61318839ac3aff630b6fcb6916901ae6f31"} Jul 14 11:11:24.309711 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.309685 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal" event={"ID":"8d609c1ee768fe3daa3f23cbaf1c3121","Type":"ContainerStarted","Data":"96563b1c2779a88f23a2abe813aa191e770d874330ba8af36539d79bcf2a5080"} Jul 14 11:11:24.351541 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.351472 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxjs8\" (UniqueName: \"kubernetes.io/projected/edca702e-dc81-46ff-aef0-acce244e82b5-kube-api-access-mxjs8\") pod \"multus-d4w8p\" (UID: \"edca702e-dc81-46ff-aef0-acce244e82b5\") " pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.351667 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.351540 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6vxk\" (UniqueName: \"kubernetes.io/projected/9309eb9c-300d-4840-a58f-2c93d2c41bfe-kube-api-access-d6vxk\") pod \"ovnkube-node-5f7fw\" (UID: \"9309eb9c-300d-4840-a58f-2c93d2c41bfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.363556 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.363507 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr4qz\" (UniqueName: \"kubernetes.io/projected/075b6288-b462-4a6c-a4b6-c7c6aca4ca2e-kube-api-access-fr4qz\") pod \"aws-ebs-csi-driver-node-wms9k\" (UID: \"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.363956 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.363926 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxz8m\" (UniqueName: \"kubernetes.io/projected/141a8f07-befb-41e6-b4b2-779001f4c51d-kube-api-access-xxz8m\") pod \"node-ca-lhdnx\" (UID: \"141a8f07-befb-41e6-b4b2-779001f4c51d\") " pod="openshift-image-registry/node-ca-lhdnx" Jul 14 11:11:24.365136 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.365105 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjxcb\" (UniqueName: \"kubernetes.io/projected/13c62ac1-9cc1-4173-aff2-73f5d52b947a-kube-api-access-cjxcb\") pod \"multus-additional-cni-plugins-f27xq\" (UID: \"13c62ac1-9cc1-4173-aff2-73f5d52b947a\") " pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.366849 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.366826 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx7cw\" (UniqueName: \"kubernetes.io/projected/e071bfee-a93c-4c4e-92fa-ee406aced61a-kube-api-access-rx7cw\") pod \"network-metrics-daemon-hmxjp\" (UID: \"e071bfee-a93c-4c4e-92fa-ee406aced61a\") " pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:24.368424 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.368406 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhfzv\" (UniqueName: \"kubernetes.io/projected/a7e645e6-079b-4e74-b3a2-65531e9e97e1-kube-api-access-nhfzv\") pod \"iptables-alerter-kz9z4\" (UID: \"a7e645e6-079b-4e74-b3a2-65531e9e97e1\") " pod="openshift-network-operator/iptables-alerter-kz9z4" Jul 14 11:11:24.375032 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.374985 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxpm8\" (UniqueName: \"kubernetes.io/projected/c4451af9-77df-48c7-b30e-af0fa19dc5b8-kube-api-access-gxpm8\") pod \"node-resolver-r58z6\" (UID: \"c4451af9-77df-48c7-b30e-af0fa19dc5b8\") " pod="openshift-dns/node-resolver-r58z6" Jul 14 11:11:24.392664 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.392645 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bklkq" Jul 14 11:11:24.400913 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.400875 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" Jul 14 11:11:24.406196 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:24.406162 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode10c4ae6_ef37_46b1_9b61_9942d2bf3b1b.slice/crio-df83d7c76bba41c98f79ea3cd80535a8d02bb156f6be3185f8ee58402b8cc474 WatchSource:0}: Error finding container df83d7c76bba41c98f79ea3cd80535a8d02bb156f6be3185f8ee58402b8cc474: Status 404 returned error can't find the container with id df83d7c76bba41c98f79ea3cd80535a8d02bb156f6be3185f8ee58402b8cc474 Jul 14 11:11:24.408319 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.408144 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r58z6" Jul 14 11:11:24.411966 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:24.411943 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod075b6288_b462_4a6c_a4b6_c7c6aca4ca2e.slice/crio-586095ce0a9cd5ea96a95c8d857af8f2ae9b5309494ca9217678401cf4a5ddb5 WatchSource:0}: Error finding container 586095ce0a9cd5ea96a95c8d857af8f2ae9b5309494ca9217678401cf4a5ddb5: Status 404 returned error can't find the container with id 586095ce0a9cd5ea96a95c8d857af8f2ae9b5309494ca9217678401cf4a5ddb5 Jul 14 11:11:24.414174 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.414155 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d4w8p" Jul 14 11:11:24.417455 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:24.417424 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4451af9_77df_48c7_b30e_af0fa19dc5b8.slice/crio-3a8fd013e7e64ddee7fa6d6ddd0d5dfa6cd34e736da4bcbe0229a6bd0d2b9eb5 WatchSource:0}: Error finding container 3a8fd013e7e64ddee7fa6d6ddd0d5dfa6cd34e736da4bcbe0229a6bd0d2b9eb5: Status 404 returned error can't find the container with id 3a8fd013e7e64ddee7fa6d6ddd0d5dfa6cd34e736da4bcbe0229a6bd0d2b9eb5 Jul 14 11:11:24.422312 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.422276 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:24.424501 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:24.424477 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedca702e_dc81_46ff_aef0_acce244e82b5.slice/crio-a36d87d2883c0ebf3e6166ac3442d0721082842ac62d54a8e6cbfcd4b161ca86 WatchSource:0}: Error finding container a36d87d2883c0ebf3e6166ac3442d0721082842ac62d54a8e6cbfcd4b161ca86: Status 404 returned error can't find the container with id a36d87d2883c0ebf3e6166ac3442d0721082842ac62d54a8e6cbfcd4b161ca86 Jul 14 11:11:24.430324 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.430166 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lhdnx" Jul 14 11:11:24.432741 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:24.432717 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9309eb9c_300d_4840_a58f_2c93d2c41bfe.slice/crio-1b4195a41dfcd5d31ca1e685d26707b130fd0e284dc21115d610501767049636 WatchSource:0}: Error finding container 1b4195a41dfcd5d31ca1e685d26707b130fd0e284dc21115d610501767049636: Status 404 returned error can't find the container with id 1b4195a41dfcd5d31ca1e685d26707b130fd0e284dc21115d610501767049636 Jul 14 11:11:24.437505 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.437351 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f27xq" Jul 14 11:11:24.439307 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:24.439271 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141a8f07_befb_41e6_b4b2_779001f4c51d.slice/crio-43af8da9d318d8ad12b881ca278f75a4adebf8ddf8f4d24557d254dc42fa2c01 WatchSource:0}: Error finding container 43af8da9d318d8ad12b881ca278f75a4adebf8ddf8f4d24557d254dc42fa2c01: Status 404 returned error can't find the container with id 43af8da9d318d8ad12b881ca278f75a4adebf8ddf8f4d24557d254dc42fa2c01 Jul 14 11:11:24.446235 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.446063 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fkmdx" Jul 14 11:11:24.447832 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:24.447805 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c62ac1_9cc1_4173_aff2_73f5d52b947a.slice/crio-6dedf3e2fb59778c57496a76c96979ccb1c30dc92b8f107d0b9b6ee577e7ae7e WatchSource:0}: Error finding container 6dedf3e2fb59778c57496a76c96979ccb1c30dc92b8f107d0b9b6ee577e7ae7e: Status 404 returned error can't find the container with id 6dedf3e2fb59778c57496a76c96979ccb1c30dc92b8f107d0b9b6ee577e7ae7e Jul 14 11:11:24.452940 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.452917 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kz9z4" Jul 14 11:11:24.456853 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:24.456828 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f4de5a_b5b3_4014_b76a_8bd4cde96a63.slice/crio-182e8d63e595b74203372d4ca816b9caa808717b9bbe915bb1ae0cf07f6ad765 WatchSource:0}: Error finding container 182e8d63e595b74203372d4ca816b9caa808717b9bbe915bb1ae0cf07f6ad765: Status 404 returned error can't find the container with id 182e8d63e595b74203372d4ca816b9caa808717b9bbe915bb1ae0cf07f6ad765 Jul 14 11:11:24.464551 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:24.464527 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e645e6_079b_4e74_b3a2_65531e9e97e1.slice/crio-b079fd1dc6ee97cf8e8704fd6ee6cc7dc4d7ad146fad0eb62939f6ae059dc569 WatchSource:0}: Error finding container b079fd1dc6ee97cf8e8704fd6ee6cc7dc4d7ad146fad0eb62939f6ae059dc569: Status 404 returned error can't find the container with id b079fd1dc6ee97cf8e8704fd6ee6cc7dc4d7ad146fad0eb62939f6ae059dc569 Jul 14 11:11:24.801116 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.801076 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgw4w\" (UniqueName: \"kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w\") pod \"network-check-target-fw8ms\" (UID: \"1864e70c-c595-4f7a-8c60-63e7e8eb5049\") " pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:24.801318 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.801280 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:24.801318 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.801306 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:24.801318 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.801319 2561 projected.go:196] Error preparing data for projected volume kube-api-access-vgw4w for pod openshift-network-diagnostics/network-check-target-fw8ms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:24.801466 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.801381 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w podName:1864e70c-c595-4f7a-8c60-63e7e8eb5049 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:25.801363136 +0000 UTC m=+4.126727666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vgw4w" (UniqueName: "kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w") pod "network-check-target-fw8ms" (UID: "1864e70c-c595-4f7a-8c60-63e7e8eb5049") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:24.902372 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.902334 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs\") pod \"network-metrics-daemon-hmxjp\" (UID: \"e071bfee-a93c-4c4e-92fa-ee406aced61a\") " pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:24.902557 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:24.902411 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret\") pod \"global-pull-secret-syncer-7pfjj\" (UID: \"de833d9f-3bca-4b05-9a86-ba9e8190d1db\") " pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:24.902557 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.902496 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:24.902648 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.902560 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret podName:de833d9f-3bca-4b05-9a86-ba9e8190d1db nodeName:}" failed. No retries permitted until 2026-07-14 11:11:25.902542692 +0000 UTC m=+4.227907202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret") pod "global-pull-secret-syncer-7pfjj" (UID: "de833d9f-3bca-4b05-9a86-ba9e8190d1db") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:24.902648 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.902496 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:24.903019 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:24.902991 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs podName:e071bfee-a93c-4c4e-92fa-ee406aced61a nodeName:}" failed. No retries permitted until 2026-07-14 11:11:25.902614083 +0000 UTC m=+4.227978607 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs") pod "network-metrics-daemon-hmxjp" (UID: "e071bfee-a93c-4c4e-92fa-ee406aced61a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:25.236173 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:25.236041 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 11:06:24 +0000 UTC" deadline="2028-01-13 22:49:19.309588985 +0000 UTC" Jul 14 11:11:25.236173 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:25.236109 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13163h37m54.073483724s" Jul 14 11:11:25.297850 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:25.297658 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:25.297850 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:25.297830 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:25.313342 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:25.313259 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d4w8p" event={"ID":"edca702e-dc81-46ff-aef0-acce244e82b5","Type":"ContainerStarted","Data":"a36d87d2883c0ebf3e6166ac3442d0721082842ac62d54a8e6cbfcd4b161ca86"} Jul 14 11:11:25.314939 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:25.314868 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bklkq" event={"ID":"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b","Type":"ContainerStarted","Data":"df83d7c76bba41c98f79ea3cd80535a8d02bb156f6be3185f8ee58402b8cc474"} Jul 14 11:11:25.316169 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:25.316094 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kz9z4" event={"ID":"a7e645e6-079b-4e74-b3a2-65531e9e97e1","Type":"ContainerStarted","Data":"b079fd1dc6ee97cf8e8704fd6ee6cc7dc4d7ad146fad0eb62939f6ae059dc569"} Jul 14 11:11:25.317428 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:25.317367 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f27xq" event={"ID":"13c62ac1-9cc1-4173-aff2-73f5d52b947a","Type":"ContainerStarted","Data":"6dedf3e2fb59778c57496a76c96979ccb1c30dc92b8f107d0b9b6ee577e7ae7e"} Jul 14 11:11:25.318761 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:25.318698 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r58z6" event={"ID":"c4451af9-77df-48c7-b30e-af0fa19dc5b8","Type":"ContainerStarted","Data":"3a8fd013e7e64ddee7fa6d6ddd0d5dfa6cd34e736da4bcbe0229a6bd0d2b9eb5"} Jul 14 11:11:25.320121 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:25.320025 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" event={"ID":"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e","Type":"ContainerStarted","Data":"586095ce0a9cd5ea96a95c8d857af8f2ae9b5309494ca9217678401cf4a5ddb5"} Jul 14 11:11:25.321978 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:25.321951 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fkmdx" event={"ID":"30f4de5a-b5b3-4014-b76a-8bd4cde96a63","Type":"ContainerStarted","Data":"182e8d63e595b74203372d4ca816b9caa808717b9bbe915bb1ae0cf07f6ad765"} Jul 14 11:11:25.324660 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:25.324618 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lhdnx" event={"ID":"141a8f07-befb-41e6-b4b2-779001f4c51d","Type":"ContainerStarted","Data":"43af8da9d318d8ad12b881ca278f75a4adebf8ddf8f4d24557d254dc42fa2c01"} Jul 14 11:11:25.326402 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:25.326310 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" event={"ID":"9309eb9c-300d-4840-a58f-2c93d2c41bfe","Type":"ContainerStarted","Data":"1b4195a41dfcd5d31ca1e685d26707b130fd0e284dc21115d610501767049636"} Jul 14 11:11:25.810065 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:25.810016 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgw4w\" (UniqueName: \"kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w\") pod \"network-check-target-fw8ms\" (UID: \"1864e70c-c595-4f7a-8c60-63e7e8eb5049\") " pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:25.810324 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:25.810261 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:25.810324 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:25.810283 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:25.810324 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:25.810295 2561 projected.go:196] Error preparing data for projected volume kube-api-access-vgw4w for pod openshift-network-diagnostics/network-check-target-fw8ms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:25.810492 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:25.810362 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w podName:1864e70c-c595-4f7a-8c60-63e7e8eb5049 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:27.810343555 +0000 UTC m=+6.135708067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vgw4w" (UniqueName: "kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w") pod "network-check-target-fw8ms" (UID: "1864e70c-c595-4f7a-8c60-63e7e8eb5049") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:25.910459 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:25.910406 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret\") pod \"global-pull-secret-syncer-7pfjj\" (UID: \"de833d9f-3bca-4b05-9a86-ba9e8190d1db\") " pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:25.910642 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:25.910484 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs\") pod \"network-metrics-daemon-hmxjp\" (UID: \"e071bfee-a93c-4c4e-92fa-ee406aced61a\") " pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:25.910642 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:25.910632 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:25.910744 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:25.910696 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs podName:e071bfee-a93c-4c4e-92fa-ee406aced61a nodeName:}" failed. No retries permitted until 2026-07-14 11:11:27.910677312 +0000 UTC m=+6.236041830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs") pod "network-metrics-daemon-hmxjp" (UID: "e071bfee-a93c-4c4e-92fa-ee406aced61a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:25.911111 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:25.911093 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:25.911190 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:25.911147 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret podName:de833d9f-3bca-4b05-9a86-ba9e8190d1db nodeName:}" failed. No retries permitted until 2026-07-14 11:11:27.911133061 +0000 UTC m=+6.236497576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret") pod "global-pull-secret-syncer-7pfjj" (UID: "de833d9f-3bca-4b05-9a86-ba9e8190d1db") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:26.237244 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:26.237183 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 11:06:24 +0000 UTC" deadline="2028-01-27 21:15:16.116820568 +0000 UTC" Jul 14 11:11:26.237244 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:26.237241 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13498h3m49.879584815s" Jul 14 11:11:26.298679 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:26.298539 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:26.298679 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:26.298579 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:26.299373 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:26.298957 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:26.299373 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:26.299063 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:27.298173 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:27.297920 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:27.298670 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:27.298310 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:27.340554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:27.340515 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" event={"ID":"342f8b0e0e5d8cd59103fbf014e7c2aa","Type":"ContainerStarted","Data":"bbbbe14c92545f768341481bf5ef441c9c5b4682359baccb3d3b15edd6493830"} Jul 14 11:11:27.834613 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:27.833955 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgw4w\" (UniqueName: \"kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w\") pod \"network-check-target-fw8ms\" (UID: \"1864e70c-c595-4f7a-8c60-63e7e8eb5049\") " pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:27.834613 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:27.834167 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:27.834613 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:27.834189 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:27.834613 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:27.834217 2561 projected.go:196] Error preparing data for projected volume kube-api-access-vgw4w for pod openshift-network-diagnostics/network-check-target-fw8ms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:27.834613 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:27.834277 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w podName:1864e70c-c595-4f7a-8c60-63e7e8eb5049 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:31.83425941 +0000 UTC m=+10.159623923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vgw4w" (UniqueName: "kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w") pod "network-check-target-fw8ms" (UID: "1864e70c-c595-4f7a-8c60-63e7e8eb5049") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:27.935932 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:27.935089 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret\") pod \"global-pull-secret-syncer-7pfjj\" (UID: \"de833d9f-3bca-4b05-9a86-ba9e8190d1db\") " pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:27.935932 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:27.935162 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs\") pod \"network-metrics-daemon-hmxjp\" (UID: \"e071bfee-a93c-4c4e-92fa-ee406aced61a\") " pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:27.935932 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:27.935328 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:27.935932 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:27.935389 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs podName:e071bfee-a93c-4c4e-92fa-ee406aced61a nodeName:}" failed. No retries permitted until 2026-07-14 11:11:31.935369313 +0000 UTC m=+10.260733830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs") pod "network-metrics-daemon-hmxjp" (UID: "e071bfee-a93c-4c4e-92fa-ee406aced61a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:27.935932 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:27.935788 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:27.935932 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:27.935840 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret podName:de833d9f-3bca-4b05-9a86-ba9e8190d1db nodeName:}" failed. No retries permitted until 2026-07-14 11:11:31.935822356 +0000 UTC m=+10.261186942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret") pod "global-pull-secret-syncer-7pfjj" (UID: "de833d9f-3bca-4b05-9a86-ba9e8190d1db") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:28.298331 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:28.298301 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:28.298775 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:28.298426 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:28.300405 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:28.300383 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:28.300533 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:28.300496 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:28.346919 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:28.346882 2561 generic.go:356] "Generic (PLEG): container finished" podID="342f8b0e0e5d8cd59103fbf014e7c2aa" containerID="bbbbe14c92545f768341481bf5ef441c9c5b4682359baccb3d3b15edd6493830" exitCode=0 Jul 14 11:11:28.347094 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:28.346931 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" event={"ID":"342f8b0e0e5d8cd59103fbf014e7c2aa","Type":"ContainerDied","Data":"bbbbe14c92545f768341481bf5ef441c9c5b4682359baccb3d3b15edd6493830"} Jul 14 11:11:29.298240 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:29.298047 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:29.298240 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:29.298183 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:30.302114 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:30.302084 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:30.302636 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:30.302221 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:30.302636 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:30.302592 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:30.302747 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:30.302701 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:31.297823 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:31.297785 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:31.298011 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:31.297933 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:31.871320 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:31.871280 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgw4w\" (UniqueName: \"kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w\") pod \"network-check-target-fw8ms\" (UID: \"1864e70c-c595-4f7a-8c60-63e7e8eb5049\") " pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:31.871762 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:31.871507 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:31.871762 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:31.871563 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:31.871762 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:31.871580 2561 projected.go:196] Error preparing data for projected volume kube-api-access-vgw4w for pod openshift-network-diagnostics/network-check-target-fw8ms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:31.871762 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:31.871650 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w podName:1864e70c-c595-4f7a-8c60-63e7e8eb5049 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:39.87162833 +0000 UTC m=+18.196992855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vgw4w" (UniqueName: "kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w") pod "network-check-target-fw8ms" (UID: "1864e70c-c595-4f7a-8c60-63e7e8eb5049") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:31.972286 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:31.971960 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret\") pod \"global-pull-secret-syncer-7pfjj\" (UID: \"de833d9f-3bca-4b05-9a86-ba9e8190d1db\") " pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:31.972286 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:31.972034 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs\") pod \"network-metrics-daemon-hmxjp\" (UID: \"e071bfee-a93c-4c4e-92fa-ee406aced61a\") " pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:31.972286 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:31.972168 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:31.972286 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:31.972188 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:31.972286 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:31.972253 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs podName:e071bfee-a93c-4c4e-92fa-ee406aced61a nodeName:}" failed. No retries permitted until 2026-07-14 11:11:39.972231966 +0000 UTC m=+18.297596481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs") pod "network-metrics-daemon-hmxjp" (UID: "e071bfee-a93c-4c4e-92fa-ee406aced61a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:31.972286 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:31.972273 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret podName:de833d9f-3bca-4b05-9a86-ba9e8190d1db nodeName:}" failed. No retries permitted until 2026-07-14 11:11:39.972263203 +0000 UTC m=+18.297627722 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret") pod "global-pull-secret-syncer-7pfjj" (UID: "de833d9f-3bca-4b05-9a86-ba9e8190d1db") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:32.299679 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:32.299078 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:32.299679 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:32.299182 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:32.299679 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:32.299252 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:32.299679 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:32.299356 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:33.298037 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:33.297730 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:33.298037 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:33.297863 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:34.301045 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:34.300967 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:34.301045 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:34.300994 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:34.301486 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:34.301113 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:34.301486 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:34.301242 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:35.298362 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:35.298330 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:35.298464 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:35.298437 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:36.297685 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:36.297621 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:36.297685 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:36.297647 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:36.298616 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:36.297766 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:36.298616 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:36.297883 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:37.297373 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:37.297338 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:37.297564 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:37.297463 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:38.297512 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:38.297474 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:38.297953 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:38.297589 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:38.297953 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:38.297614 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:38.297953 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:38.297712 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:39.297892 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:39.297851 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:39.298325 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:39.297996 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:39.933090 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:39.933054 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgw4w\" (UniqueName: \"kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w\") pod \"network-check-target-fw8ms\" (UID: \"1864e70c-c595-4f7a-8c60-63e7e8eb5049\") " pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:39.933292 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:39.933223 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:39.933292 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:39.933246 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:39.933292 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:39.933258 2561 projected.go:196] Error preparing data for projected volume kube-api-access-vgw4w for pod openshift-network-diagnostics/network-check-target-fw8ms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:39.933410 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:39.933312 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w podName:1864e70c-c595-4f7a-8c60-63e7e8eb5049 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:55.933292641 +0000 UTC m=+34.258657174 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vgw4w" (UniqueName: "kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w") pod "network-check-target-fw8ms" (UID: "1864e70c-c595-4f7a-8c60-63e7e8eb5049") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:40.034016 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:40.033977 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs\") pod \"network-metrics-daemon-hmxjp\" (UID: \"e071bfee-a93c-4c4e-92fa-ee406aced61a\") " pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:40.034195 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:40.034046 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret\") pod \"global-pull-secret-syncer-7pfjj\" (UID: \"de833d9f-3bca-4b05-9a86-ba9e8190d1db\") " pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:40.034195 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:40.034145 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:40.034339 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:40.034228 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs podName:e071bfee-a93c-4c4e-92fa-ee406aced61a nodeName:}" failed. No retries permitted until 2026-07-14 11:11:56.034193599 +0000 UTC m=+34.359558129 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs") pod "network-metrics-daemon-hmxjp" (UID: "e071bfee-a93c-4c4e-92fa-ee406aced61a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:40.034339 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:40.034147 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:40.034339 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:40.034307 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret podName:de833d9f-3bca-4b05-9a86-ba9e8190d1db nodeName:}" failed. No retries permitted until 2026-07-14 11:11:56.034279306 +0000 UTC m=+34.359643830 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret") pod "global-pull-secret-syncer-7pfjj" (UID: "de833d9f-3bca-4b05-9a86-ba9e8190d1db") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:40.297994 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:40.297951 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:40.298464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:40.297963 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:40.298464 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:40.298096 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:40.298464 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:40.298198 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:41.298244 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:41.298192 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:41.298681 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:41.298339 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:42.298852 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:42.298812 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:42.299311 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:42.298917 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:42.299311 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:42.298941 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:42.299311 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:42.299037 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:43.297824 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:43.297786 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:43.298011 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:43.297910 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:44.298428 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.298241 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:44.299030 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.298292 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:44.299030 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:44.298500 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:44.299030 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:44.298585 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:44.377906 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.377869 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r58z6" event={"ID":"c4451af9-77df-48c7-b30e-af0fa19dc5b8","Type":"ContainerStarted","Data":"ec83b8015cb29b0b967051996fa6018f2c562a730d293527ab8381126dba6056"} Jul 14 11:11:44.379436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.379401 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" event={"ID":"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e","Type":"ContainerStarted","Data":"2e145da80cd515c45ba9aaee9318b76b67bd61ced949440ad953f906135b284e"} Jul 14 11:11:44.380791 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.380766 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal" event={"ID":"8d609c1ee768fe3daa3f23cbaf1c3121","Type":"ContainerStarted","Data":"d05e6900f07bc8309fd0598ec4462fd2eccc05f648ec98e6d7ce91cb8a6970bf"} Jul 14 11:11:44.382238 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.382194 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fkmdx" event={"ID":"30f4de5a-b5b3-4014-b76a-8bd4cde96a63","Type":"ContainerStarted","Data":"8c3dd7bb08072259cf329fc3a224f86d841c62c249570eaf964093419dadd83e"} Jul 14 11:11:44.383600 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.383577 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lhdnx" event={"ID":"141a8f07-befb-41e6-b4b2-779001f4c51d","Type":"ContainerStarted","Data":"03f8bfc985311e0aded1035b066dc47f86cc70fdf880517e27ebf773a26fbd6b"} Jul 14 11:11:44.385004 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.384981 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" event={"ID":"9309eb9c-300d-4840-a58f-2c93d2c41bfe","Type":"ContainerStarted","Data":"37229f44bae4cb86906af985b8bfab12d011a24003c34c77860b10e8383c0190"} Jul 14 11:11:44.386618 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.386593 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d4w8p" event={"ID":"edca702e-dc81-46ff-aef0-acce244e82b5","Type":"ContainerStarted","Data":"753b6df3325f11eae170826ff6b3087a12f738eafbbf9025d13a9f8dbe6e84af"} Jul 14 11:11:44.388080 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.388052 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bklkq" event={"ID":"e10c4ae6-ef37-46b1-9b61-9942d2bf3b1b","Type":"ContainerStarted","Data":"088f97a1c13d13dad9ff478ff0bd5f2b7b3c81fdad4a637d6a1a2cd917f597a9"} Jul 14 11:11:44.390259 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.390235 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" event={"ID":"342f8b0e0e5d8cd59103fbf014e7c2aa","Type":"ContainerStarted","Data":"c5b3a80b70497c954f1de098b2a36a81579b5c949484e0ee03fbe5af4909c3e6"} Jul 14 11:11:44.392118 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.392094 2561 generic.go:356] "Generic (PLEG): container finished" podID="13c62ac1-9cc1-4173-aff2-73f5d52b947a" containerID="944e748eded1dde77b224dceaf83b7276acc5f0c3cd0a8b9e819f7771ab6571b" exitCode=0 Jul 14 11:11:44.392252 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.392129 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f27xq" event={"ID":"13c62ac1-9cc1-4173-aff2-73f5d52b947a","Type":"ContainerDied","Data":"944e748eded1dde77b224dceaf83b7276acc5f0c3cd0a8b9e819f7771ab6571b"} Jul 14 11:11:44.424899 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.424856 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r58z6" podStartSLOduration=2.960736487 podStartE2EDuration="22.424839526s" totalImagesPullingTime="19.464103039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:44.398479024 +0000 UTC m=+22.723843569" watchObservedRunningTime="2026-07-14 11:11:44.424839526 +0000 UTC m=+22.750204057" Jul 14 11:11:44.444932 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.444885 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bklkq" podStartSLOduration=2.896470533 podStartE2EDuration="22.444865868s" totalImagesPullingTime="19.548395335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:44.424791018 +0000 UTC m=+22.750155549" watchObservedRunningTime="2026-07-14 11:11:44.444865868 +0000 UTC m=+22.770230402" Jul 14 11:11:44.445469 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.445433 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d4w8p" podStartSLOduration=2.88818596 podStartE2EDuration="22.445417665s" totalImagesPullingTime="19.557231705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:44.444629548 +0000 UTC m=+22.769994079" watchObservedRunningTime="2026-07-14 11:11:44.445417665 +0000 UTC m=+22.770782198" Jul 14 11:11:44.513946 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.513766 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal" podStartSLOduration=21.513751254 podStartE2EDuration="21.513751254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:44.513353667 +0000 UTC m=+22.838718198" watchObservedRunningTime="2026-07-14 11:11:44.513751254 +0000 UTC m=+22.839115815" Jul 14 11:11:44.604409 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.604351 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lhdnx" podStartSLOduration=3.137869343 podStartE2EDuration="22.604335053s" totalImagesPullingTime="19.46646571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:44.540022348 +0000 UTC m=+22.865386889" watchObservedRunningTime="2026-07-14 11:11:44.604335053 +0000 UTC m=+22.929699585" Jul 14 11:11:44.642448 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:44.642405 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fkmdx" podStartSLOduration=3.144914539 podStartE2EDuration="22.642388549s" totalImagesPullingTime="19.49747401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:44.604289309 +0000 UTC m=+22.929653865" watchObservedRunningTime="2026-07-14 11:11:44.642388549 +0000 UTC m=+22.967753082" Jul 14 11:11:45.297426 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:45.297395 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:45.297572 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:45.297518 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:45.399017 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:45.398986 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f7fw_9309eb9c-300d-4840-a58f-2c93d2c41bfe/ovn-acl-logging/0.log" Jul 14 11:11:45.399643 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:45.399419 2561 generic.go:356] "Generic (PLEG): container finished" podID="9309eb9c-300d-4840-a58f-2c93d2c41bfe" containerID="65c51bfdbfbdbd24bebf609b406c6229e93a1a9979c6222b676044bf11fdd5f5" exitCode=1 Jul 14 11:11:45.399643 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:45.399485 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" event={"ID":"9309eb9c-300d-4840-a58f-2c93d2c41bfe","Type":"ContainerStarted","Data":"8ab5078f04b97b646713c963eaa4c01e68e75e34543cb571c01e1d01e88fef70"} Jul 14 11:11:45.399643 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:45.399569 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" event={"ID":"9309eb9c-300d-4840-a58f-2c93d2c41bfe","Type":"ContainerStarted","Data":"605596a881b78ce316983bc119bed0eb0d8afc27864d71be321d1075eb6a99d3"} Jul 14 11:11:45.399643 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:45.399620 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" event={"ID":"9309eb9c-300d-4840-a58f-2c93d2c41bfe","Type":"ContainerStarted","Data":"7df212f4ea4bf057d8423f36cf0a97f137fc3da56699e30abe045f1f7c45c973"} Jul 14 11:11:45.399850 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:45.399665 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" event={"ID":"9309eb9c-300d-4840-a58f-2c93d2c41bfe","Type":"ContainerStarted","Data":"e85c1e7d1820efd3ac3e5b803f6e0544d5939dfa5cd82b37063d2be7285b7380"} Jul 14 11:11:45.399850 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:45.399715 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" event={"ID":"9309eb9c-300d-4840-a58f-2c93d2c41bfe","Type":"ContainerDied","Data":"65c51bfdbfbdbd24bebf609b406c6229e93a1a9979c6222b676044bf11fdd5f5"} Jul 14 11:11:45.402647 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:45.402581 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kz9z4" event={"ID":"a7e645e6-079b-4e74-b3a2-65531e9e97e1","Type":"ContainerStarted","Data":"522e9c7bdd72da08c9353772adb2d2c005e48f2d7a2c65691cf0f531a62a957a"} Jul 14 11:11:45.420595 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:45.420538 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" podStartSLOduration=22.420525861 podStartE2EDuration="22.420525861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:44.642746576 +0000 UTC m=+22.968111109" watchObservedRunningTime="2026-07-14 11:11:45.420525861 +0000 UTC m=+23.745890393" Jul 14 11:11:45.420946 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:45.420923 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kz9z4" podStartSLOduration=3.9311068430000002 podStartE2EDuration="23.420915102s" totalImagesPullingTime="19.489808259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:45.420408411 +0000 UTC m=+23.745772943" watchObservedRunningTime="2026-07-14 11:11:45.420915102 +0000 UTC m=+23.746279634" Jul 14 11:11:45.480603 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:45.480578 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 11:11:45.697450 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:45.697364 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fkmdx" Jul 14 11:11:45.698052 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:45.698032 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fkmdx" Jul 14 11:11:46.194741 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:46.194545 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T11:11:45.48059865Z","UUID":"2998c8ac-4f9b-480c-8f40-7a9bcf548e2b","Handler":null,"Name":"","Endpoint":""} Jul 14 11:11:46.196404 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:46.196383 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 11:11:46.196547 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:46.196429 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 11:11:46.302533 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:46.302506 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:46.302771 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:46.302618 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:46.302771 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:46.302665 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:46.302882 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:46.302782 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:46.406417 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:46.406381 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" event={"ID":"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e","Type":"ContainerStarted","Data":"3dad9878de7878d2752d866c37611cc013543841025cf797776dc11315d1ca00"} Jul 14 11:11:46.407057 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:46.406795 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fkmdx" Jul 14 11:11:46.407286 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:46.407268 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fkmdx" Jul 14 11:11:47.298365 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:47.298338 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:47.298540 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:47.298448 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:47.414816 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:47.414782 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f7fw_9309eb9c-300d-4840-a58f-2c93d2c41bfe/ovn-acl-logging/0.log" Jul 14 11:11:47.415354 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:47.415324 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" event={"ID":"9309eb9c-300d-4840-a58f-2c93d2c41bfe","Type":"ContainerStarted","Data":"6ad6625b0daf7f9a2e61c366f0af8c98d9530651a20293a66bb4fe7a1508756d"} Jul 14 11:11:47.417907 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:47.417879 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" event={"ID":"075b6288-b462-4a6c-a4b6-c7c6aca4ca2e","Type":"ContainerStarted","Data":"674b49c90d2727c7827350d50df1a891c434afc3b5ff198d8f643f8d4325dc74"} Jul 14 11:11:47.448291 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:47.448243 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wms9k" podStartSLOduration=3.772387297 podStartE2EDuration="25.448225383s" totalImagesPullingTime="21.675838086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:47.447554961 +0000 UTC m=+25.772919496" watchObservedRunningTime="2026-07-14 11:11:47.448225383 +0000 UTC m=+25.773589914" Jul 14 11:11:48.297889 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:48.297691 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:48.298072 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:48.297701 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:48.298072 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:48.297973 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:48.298072 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:48.298058 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:49.298326 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:49.298293 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:49.298895 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:49.298406 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:49.424236 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:49.423941 2561 generic.go:356] "Generic (PLEG): container finished" podID="13c62ac1-9cc1-4173-aff2-73f5d52b947a" containerID="46320cf1286489bfdfea38c04e51a8800a1951621521713b2fe9325b1f327a4b" exitCode=0 Jul 14 11:11:49.424236 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:49.424024 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f27xq" event={"ID":"13c62ac1-9cc1-4173-aff2-73f5d52b947a","Type":"ContainerDied","Data":"46320cf1286489bfdfea38c04e51a8800a1951621521713b2fe9325b1f327a4b"} Jul 14 11:11:49.427800 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:49.427782 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f7fw_9309eb9c-300d-4840-a58f-2c93d2c41bfe/ovn-acl-logging/0.log" Jul 14 11:11:49.428135 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:49.428107 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" event={"ID":"9309eb9c-300d-4840-a58f-2c93d2c41bfe","Type":"ContainerStarted","Data":"d8d1c9c96933c3d2d86443f2fa1080a664eb7b2a5f5b23fbaae9ebd68533b879"} Jul 14 11:11:49.428412 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:49.428392 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:49.428575 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:49.428561 2561 scope.go:117] "RemoveContainer" containerID="65c51bfdbfbdbd24bebf609b406c6229e93a1a9979c6222b676044bf11fdd5f5" Jul 14 11:11:49.444729 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:49.444708 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:50.297696 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:50.297663 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:50.297875 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:50.297764 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:50.297875 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:50.297820 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:50.297954 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:50.297910 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:50.434707 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:50.434681 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f7fw_9309eb9c-300d-4840-a58f-2c93d2c41bfe/ovn-acl-logging/0.log" Jul 14 11:11:50.435691 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:50.435579 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" event={"ID":"9309eb9c-300d-4840-a58f-2c93d2c41bfe","Type":"ContainerStarted","Data":"aa8d126c3d58ff88ea91e8089382430734646430070d46c8d63d3b53da996474"} Jul 14 11:11:50.435691 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:50.435689 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 14 11:11:50.436080 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:50.435994 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:50.454465 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:50.454441 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:50.509838 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:50.509016 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" podStartSLOduration=8.804359246 podStartE2EDuration="28.508995951s" totalImagesPullingTime="19.704636705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:11:50.474684345 +0000 UTC m=+28.800048877" watchObservedRunningTime="2026-07-14 11:11:50.508995951 +0000 UTC m=+28.834360486" Jul 14 11:11:51.286927 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:51.286900 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7pfjj"] Jul 14 11:11:51.287142 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:51.287002 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:51.287142 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:51.287100 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:51.289985 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:51.289962 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fw8ms"] Jul 14 11:11:51.290107 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:51.290044 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:51.290155 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:51.290126 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:51.290637 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:51.290614 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hmxjp"] Jul 14 11:11:51.290718 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:51.290705 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:51.290808 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:51.290782 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:51.439835 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:51.439802 2561 generic.go:356] "Generic (PLEG): container finished" podID="13c62ac1-9cc1-4173-aff2-73f5d52b947a" containerID="8d80cd5db79d181f50fc3429b4aa4a794323d15666f43cd44a14d5d8d486e7d1" exitCode=0 Jul 14 11:11:51.440319 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:51.439884 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f27xq" event={"ID":"13c62ac1-9cc1-4173-aff2-73f5d52b947a","Type":"ContainerDied","Data":"8d80cd5db79d181f50fc3429b4aa4a794323d15666f43cd44a14d5d8d486e7d1"} Jul 14 11:11:51.440319 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:51.439947 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 14 11:11:51.651735 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:51.651656 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:11:53.298251 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:53.298053 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:53.298631 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:53.298054 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:53.298631 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:53.298336 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:53.298631 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:53.298105 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:53.298631 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:53.298411 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:53.298631 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:53.298480 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:53.447012 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:53.446927 2561 generic.go:356] "Generic (PLEG): container finished" podID="13c62ac1-9cc1-4173-aff2-73f5d52b947a" containerID="f08fd0c026fdd706decce40e6c9ab578c7b040f6cdfad47d4e88fcabb717c62d" exitCode=0 Jul 14 11:11:53.447170 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:53.447016 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f27xq" event={"ID":"13c62ac1-9cc1-4173-aff2-73f5d52b947a","Type":"ContainerDied","Data":"f08fd0c026fdd706decce40e6c9ab578c7b040f6cdfad47d4e88fcabb717c62d"} Jul 14 11:11:55.297559 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:55.297524 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:55.298248 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:55.297527 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:55.298248 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:55.297646 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:55.298248 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:55.297530 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:55.298248 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:55.297732 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:55.298248 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:55.297801 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:55.952751 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:55.952699 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgw4w\" (UniqueName: \"kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w\") pod \"network-check-target-fw8ms\" (UID: \"1864e70c-c595-4f7a-8c60-63e7e8eb5049\") " pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:55.952937 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:55.952906 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 11:11:55.952998 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:55.952937 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 11:11:55.952998 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:55.952952 2561 projected.go:196] Error preparing data for projected volume kube-api-access-vgw4w for pod openshift-network-diagnostics/network-check-target-fw8ms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:55.953109 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:55.953030 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w podName:1864e70c-c595-4f7a-8c60-63e7e8eb5049 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:27.953009288 +0000 UTC m=+66.278373822 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vgw4w" (UniqueName: "kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w") pod "network-check-target-fw8ms" (UID: "1864e70c-c595-4f7a-8c60-63e7e8eb5049") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 11:11:56.054012 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:56.053980 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs\") pod \"network-metrics-daemon-hmxjp\" (UID: \"e071bfee-a93c-4c4e-92fa-ee406aced61a\") " pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:56.054187 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:56.054069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret\") pod \"global-pull-secret-syncer-7pfjj\" (UID: \"de833d9f-3bca-4b05-9a86-ba9e8190d1db\") " pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:56.054187 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:56.054162 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:56.054187 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:56.054180 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:56.054353 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:56.054249 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret podName:de833d9f-3bca-4b05-9a86-ba9e8190d1db nodeName:}" failed. No retries permitted until 2026-07-14 11:12:28.054230734 +0000 UTC m=+66.379595266 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret") pod "global-pull-secret-syncer-7pfjj" (UID: "de833d9f-3bca-4b05-9a86-ba9e8190d1db") : object "kube-system"/"original-pull-secret" not registered Jul 14 11:11:56.054353 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:56.054268 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs podName:e071bfee-a93c-4c4e-92fa-ee406aced61a nodeName:}" failed. No retries permitted until 2026-07-14 11:12:28.054258464 +0000 UTC m=+66.379622977 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs") pod "network-metrics-daemon-hmxjp" (UID: "e071bfee-a93c-4c4e-92fa-ee406aced61a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 11:11:57.298045 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:57.298013 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:57.298674 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:57.298147 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fw8ms" podUID="1864e70c-c595-4f7a-8c60-63e7e8eb5049" Jul 14 11:11:57.298674 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:57.298153 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:57.298674 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:57.298186 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:57.298674 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:57.298252 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:11:57.298674 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:57.298394 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pfjj" podUID="de833d9f-3bca-4b05-9a86-ba9e8190d1db" Jul 14 11:11:57.987573 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:57.987503 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeReady" Jul 14 11:11:57.987705 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:57.987622 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 11:11:58.047331 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.047299 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-5bmx6"] Jul 14 11:11:58.050103 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.050083 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:11:58.052236 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.052195 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68d9cb8f98-6nhnb"] Jul 14 11:11:58.053603 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.053583 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 14 11:11:58.053603 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.053590 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 14 11:11:58.053783 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.053596 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5tzlr\"" Jul 14 11:11:58.054823 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.054806 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.060050 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.060033 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 11:11:58.060399 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.060385 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 11:11:58.060482 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.060403 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z7n4f\"" Jul 14 11:11:58.060884 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.060870 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 11:11:58.066869 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.066850 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 11:11:58.080313 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.080216 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-5bmx6"] Jul 14 11:11:58.080930 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.080913 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68d9cb8f98-6nhnb"] Jul 14 11:11:58.104222 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.104177 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pvhm4"] Jul 14 11:11:58.106948 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.106933 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gd299"] Jul 14 11:11:58.107071 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.107054 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pvhm4" Jul 14 11:11:58.109582 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.109565 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gd299" Jul 14 11:11:58.112365 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.112330 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 11:11:58.112760 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.112745 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-78vw8\"" Jul 14 11:11:58.112834 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.112775 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 11:11:58.112907 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.112892 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 11:11:58.113725 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.113575 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 11:11:58.113826 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.113805 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 11:11:58.114559 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.114543 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9dwb8\"" Jul 14 11:11:58.139853 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.139828 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gd299"] Jul 14 11:11:58.140368 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.140352 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pvhm4"] Jul 14 11:11:58.168965 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.168930 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.168965 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.168961 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a488e467-3419-45fe-a8e1-8b6707e7752d-trusted-ca\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.169222 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.168985 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a488e467-3419-45fe-a8e1-8b6707e7752d-ca-trust-extracted\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.169222 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.169035 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a488e467-3419-45fe-a8e1-8b6707e7752d-installation-pull-secrets\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.169222 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.169078 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c128d9fa-7cfe-4caf-aee7-367152ecf337-nginx-conf\") pod \"networking-console-plugin-6cf856758c-5bmx6\" (UID: \"c128d9fa-7cfe-4caf-aee7-367152ecf337\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:11:58.169222 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.169114 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-certificates\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.169222 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.169136 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6svgs\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-kube-api-access-6svgs\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.169222 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.169182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a488e467-3419-45fe-a8e1-8b6707e7752d-image-registry-private-configuration\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.169222 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.169221 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-bound-sa-token\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.169466 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.169255 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5bmx6\" (UID: \"c128d9fa-7cfe-4caf-aee7-367152ecf337\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:11:58.269882 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.269845 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a488e467-3419-45fe-a8e1-8b6707e7752d-ca-trust-extracted\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.269882 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.269884 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a488e467-3419-45fe-a8e1-8b6707e7752d-installation-pull-secrets\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.270115 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.269904 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c128d9fa-7cfe-4caf-aee7-367152ecf337-nginx-conf\") pod \"networking-console-plugin-6cf856758c-5bmx6\" (UID: \"c128d9fa-7cfe-4caf-aee7-367152ecf337\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:11:58.270115 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.269921 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-certificates\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.270115 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.269946 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6svgs\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-kube-api-access-6svgs\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.270115 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.269976 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/abf7ad10-3167-4df7-b172-5dfe1082217e-config-volume\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:11:58.270115 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.269998 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:11:58.270115 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.270046 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a488e467-3419-45fe-a8e1-8b6707e7752d-image-registry-private-configuration\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.270115 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.270071 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-bound-sa-token\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.270115 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.270107 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16977b8e-7c4e-4d57-b39b-8d4e5f8cf730-cert\") pod \"ingress-canary-pvhm4\" (UID: \"16977b8e-7c4e-4d57-b39b-8d4e5f8cf730\") " pod="openshift-ingress-canary/ingress-canary-pvhm4" Jul 14 11:11:58.270527 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.270146 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5bmx6\" (UID: \"c128d9fa-7cfe-4caf-aee7-367152ecf337\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:11:58.270527 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.270186 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abf7ad10-3167-4df7-b172-5dfe1082217e-tmp-dir\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:11:58.270527 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.270232 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpxf5\" (UniqueName: \"kubernetes.io/projected/16977b8e-7c4e-4d57-b39b-8d4e5f8cf730-kube-api-access-lpxf5\") pod \"ingress-canary-pvhm4\" (UID: \"16977b8e-7c4e-4d57-b39b-8d4e5f8cf730\") " pod="openshift-ingress-canary/ingress-canary-pvhm4" Jul 14 11:11:58.270527 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.270272 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.270527 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.270294 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a488e467-3419-45fe-a8e1-8b6707e7752d-trusted-ca\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.270527 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:58.270305 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 11:11:58.270527 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.270319 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfpdx\" (UniqueName: \"kubernetes.io/projected/abf7ad10-3167-4df7-b172-5dfe1082217e-kube-api-access-qfpdx\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:11:58.270527 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:58.270355 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 11:11:58.270527 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:58.270371 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d9cb8f98-6nhnb: secret "image-registry-tls" not found Jul 14 11:11:58.270527 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:58.270362 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert podName:c128d9fa-7cfe-4caf-aee7-367152ecf337 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:58.77034434 +0000 UTC m=+37.095708869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-5bmx6" (UID: "c128d9fa-7cfe-4caf-aee7-367152ecf337") : secret "networking-console-plugin-cert" not found Jul 14 11:11:58.270527 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.270426 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a488e467-3419-45fe-a8e1-8b6707e7752d-ca-trust-extracted\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.270527 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:58.270439 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls podName:a488e467-3419-45fe-a8e1-8b6707e7752d nodeName:}" failed. No retries permitted until 2026-07-14 11:11:58.770423569 +0000 UTC m=+37.095788079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls") pod "image-registry-68d9cb8f98-6nhnb" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d") : secret "image-registry-tls" not found Jul 14 11:11:58.270971 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.270730 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-certificates\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.270971 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.270890 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c128d9fa-7cfe-4caf-aee7-367152ecf337-nginx-conf\") pod \"networking-console-plugin-6cf856758c-5bmx6\" (UID: \"c128d9fa-7cfe-4caf-aee7-367152ecf337\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:11:58.271121 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.271104 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a488e467-3419-45fe-a8e1-8b6707e7752d-trusted-ca\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.274251 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.274119 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a488e467-3419-45fe-a8e1-8b6707e7752d-image-registry-private-configuration\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.274363 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.274172 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a488e467-3419-45fe-a8e1-8b6707e7752d-installation-pull-secrets\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.286505 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.286484 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6svgs\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-kube-api-access-6svgs\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.286605 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.286528 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-bound-sa-token\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.370917 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.370883 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/abf7ad10-3167-4df7-b172-5dfe1082217e-config-volume\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:11:58.370917 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.370921 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:11:58.371602 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.370965 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16977b8e-7c4e-4d57-b39b-8d4e5f8cf730-cert\") pod \"ingress-canary-pvhm4\" (UID: \"16977b8e-7c4e-4d57-b39b-8d4e5f8cf730\") " pod="openshift-ingress-canary/ingress-canary-pvhm4" Jul 14 11:11:58.371602 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.371019 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abf7ad10-3167-4df7-b172-5dfe1082217e-tmp-dir\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:11:58.371602 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.371042 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpxf5\" (UniqueName: \"kubernetes.io/projected/16977b8e-7c4e-4d57-b39b-8d4e5f8cf730-kube-api-access-lpxf5\") pod \"ingress-canary-pvhm4\" (UID: \"16977b8e-7c4e-4d57-b39b-8d4e5f8cf730\") " pod="openshift-ingress-canary/ingress-canary-pvhm4" Jul 14 11:11:58.371602 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:58.371056 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:11:58.371602 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:58.371131 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls podName:abf7ad10-3167-4df7-b172-5dfe1082217e nodeName:}" failed. No retries permitted until 2026-07-14 11:11:58.871109311 +0000 UTC m=+37.196473840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls") pod "dns-default-gd299" (UID: "abf7ad10-3167-4df7-b172-5dfe1082217e") : secret "dns-default-metrics-tls" not found Jul 14 11:11:58.371602 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.371301 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfpdx\" (UniqueName: \"kubernetes.io/projected/abf7ad10-3167-4df7-b172-5dfe1082217e-kube-api-access-qfpdx\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:11:58.371602 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.371334 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abf7ad10-3167-4df7-b172-5dfe1082217e-tmp-dir\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:11:58.371602 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.371497 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/abf7ad10-3167-4df7-b172-5dfe1082217e-config-volume\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:11:58.373463 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.373439 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16977b8e-7c4e-4d57-b39b-8d4e5f8cf730-cert\") pod \"ingress-canary-pvhm4\" (UID: \"16977b8e-7c4e-4d57-b39b-8d4e5f8cf730\") " pod="openshift-ingress-canary/ingress-canary-pvhm4" Jul 14 11:11:58.388252 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.388230 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpxf5\" (UniqueName: \"kubernetes.io/projected/16977b8e-7c4e-4d57-b39b-8d4e5f8cf730-kube-api-access-lpxf5\") pod \"ingress-canary-pvhm4\" (UID: \"16977b8e-7c4e-4d57-b39b-8d4e5f8cf730\") " pod="openshift-ingress-canary/ingress-canary-pvhm4" Jul 14 11:11:58.391036 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.391018 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfpdx\" (UniqueName: \"kubernetes.io/projected/abf7ad10-3167-4df7-b172-5dfe1082217e-kube-api-access-qfpdx\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:11:58.415992 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.415960 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pvhm4" Jul 14 11:11:58.462215 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.462162 2561 generic.go:356] "Generic (PLEG): container finished" podID="13c62ac1-9cc1-4173-aff2-73f5d52b947a" containerID="5e1bd01683b412b1cac2f7e33d8e0686213a38181f19a98921e98dc2c58d0d86" exitCode=0 Jul 14 11:11:58.462379 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.462242 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f27xq" event={"ID":"13c62ac1-9cc1-4173-aff2-73f5d52b947a","Type":"ContainerDied","Data":"5e1bd01683b412b1cac2f7e33d8e0686213a38181f19a98921e98dc2c58d0d86"} Jul 14 11:11:58.556938 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.556912 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:11:58.582927 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.582890 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pvhm4"] Jul 14 11:11:58.586192 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:11:58.586150 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16977b8e_7c4e_4d57_b39b_8d4e5f8cf730.slice/crio-2a2a470163d5777e3ff6822dc7e595200506b104faa3271b1cb20506545ae513 WatchSource:0}: Error finding container 2a2a470163d5777e3ff6822dc7e595200506b104faa3271b1cb20506545ae513: Status 404 returned error can't find the container with id 2a2a470163d5777e3ff6822dc7e595200506b104faa3271b1cb20506545ae513 Jul 14 11:11:58.709565 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.709534 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:11:58.774282 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.774251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5bmx6\" (UID: \"c128d9fa-7cfe-4caf-aee7-367152ecf337\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:11:58.774418 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.774301 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:58.774418 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:58.774387 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 11:11:58.774418 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:58.774402 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d9cb8f98-6nhnb: secret "image-registry-tls" not found Jul 14 11:11:58.774418 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:58.774387 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 11:11:58.774553 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:58.774448 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls podName:a488e467-3419-45fe-a8e1-8b6707e7752d nodeName:}" failed. No retries permitted until 2026-07-14 11:11:59.774435755 +0000 UTC m=+38.099800266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls") pod "image-registry-68d9cb8f98-6nhnb" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d") : secret "image-registry-tls" not found Jul 14 11:11:58.774553 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:58.774460 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert podName:c128d9fa-7cfe-4caf-aee7-367152ecf337 nodeName:}" failed. No retries permitted until 2026-07-14 11:11:59.774454191 +0000 UTC m=+38.099818700 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-5bmx6" (UID: "c128d9fa-7cfe-4caf-aee7-367152ecf337") : secret "networking-console-plugin-cert" not found Jul 14 11:11:58.874717 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:58.874617 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:11:58.874870 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:58.874790 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:11:58.874870 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:58.874862 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls podName:abf7ad10-3167-4df7-b172-5dfe1082217e nodeName:}" failed. No retries permitted until 2026-07-14 11:11:59.874842392 +0000 UTC m=+38.200206919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls") pod "dns-default-gd299" (UID: "abf7ad10-3167-4df7-b172-5dfe1082217e") : secret "dns-default-metrics-tls" not found Jul 14 11:11:59.206344 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.206259 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:11:59.297372 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.297337 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:11:59.297552 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.297384 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:11:59.297552 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.297336 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:11:59.300263 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.300241 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 11:11:59.301266 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.301245 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qblx9\"" Jul 14 11:11:59.301392 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.301375 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 11:11:59.301453 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.301445 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-56vkg\"" Jul 14 11:11:59.301487 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.301479 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 11:11:59.301531 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.301515 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 11:11:59.348519 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.348481 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:11:59.445655 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.445623 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:11:59.467891 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.467811 2561 generic.go:356] "Generic (PLEG): container finished" podID="13c62ac1-9cc1-4173-aff2-73f5d52b947a" containerID="61695d8deb308c6fb72e220643b051306d8c64b298b847dfc7f81c86f2ba2dd7" exitCode=0 Jul 14 11:11:59.467891 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.467881 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f27xq" event={"ID":"13c62ac1-9cc1-4173-aff2-73f5d52b947a","Type":"ContainerDied","Data":"61695d8deb308c6fb72e220643b051306d8c64b298b847dfc7f81c86f2ba2dd7"} Jul 14 11:11:59.469287 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.469161 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pvhm4" event={"ID":"16977b8e-7c4e-4d57-b39b-8d4e5f8cf730","Type":"ContainerStarted","Data":"2a2a470163d5777e3ff6822dc7e595200506b104faa3271b1cb20506545ae513"} Jul 14 11:11:59.542555 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.542383 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:11:59.784365 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.784329 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5bmx6\" (UID: \"c128d9fa-7cfe-4caf-aee7-367152ecf337\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:11:59.784559 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.784386 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:11:59.784559 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:59.784493 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 11:11:59.784559 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:59.784514 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 11:11:59.784559 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:59.784524 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d9cb8f98-6nhnb: secret "image-registry-tls" not found Jul 14 11:11:59.784756 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:59.784569 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert podName:c128d9fa-7cfe-4caf-aee7-367152ecf337 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:01.784549141 +0000 UTC m=+40.109913655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-5bmx6" (UID: "c128d9fa-7cfe-4caf-aee7-367152ecf337") : secret "networking-console-plugin-cert" not found Jul 14 11:11:59.784756 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:59.784588 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls podName:a488e467-3419-45fe-a8e1-8b6707e7752d nodeName:}" failed. No retries permitted until 2026-07-14 11:12:01.78457975 +0000 UTC m=+40.109944261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls") pod "image-registry-68d9cb8f98-6nhnb" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d") : secret "image-registry-tls" not found Jul 14 11:11:59.885162 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:11:59.885127 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:11:59.885348 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:59.885318 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:11:59.885424 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:11:59.885410 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls podName:abf7ad10-3167-4df7-b172-5dfe1082217e nodeName:}" failed. No retries permitted until 2026-07-14 11:12:01.88538924 +0000 UTC m=+40.210753754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls") pod "dns-default-gd299" (UID: "abf7ad10-3167-4df7-b172-5dfe1082217e") : secret "dns-default-metrics-tls" not found Jul 14 11:12:00.279374 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:00.279315 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:00.379502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:00.379467 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:00.475082 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:00.475040 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f27xq" event={"ID":"13c62ac1-9cc1-4173-aff2-73f5d52b947a","Type":"ContainerStarted","Data":"af52cbb308368eee590834da5de189322b94906dbd245747d15e5e2f6db823dd"} Jul 14 11:12:00.879271 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:00.879234 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:00.962601 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:00.962563 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:01.219625 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:01.219593 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:01.479390 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:01.479299 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pvhm4" event={"ID":"16977b8e-7c4e-4d57-b39b-8d4e5f8cf730","Type":"ContainerStarted","Data":"619277d5ecb171b285f2b7de9d6e5fe6c06b716d26f1231ca1da8cae9a056faf"} Jul 14 11:12:01.497071 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:01.497024 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f27xq" podStartSLOduration=8.786600165 podStartE2EDuration="39.497005779s" totalImagesPullingTime="30.710405614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:00.526112132 +0000 UTC m=+38.851476664" watchObservedRunningTime="2026-07-14 11:12:01.497005779 +0000 UTC m=+39.822370313" Jul 14 11:12:01.497725 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:01.497698 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pvhm4" podStartSLOduration=0.999346318 podStartE2EDuration="3.497689309s" totalImagesPullingTime="2.498342991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:11:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:01.497157477 +0000 UTC m=+39.822521994" watchObservedRunningTime="2026-07-14 11:12:01.497689309 +0000 UTC m=+39.823053842" Jul 14 11:12:01.565446 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:01.565415 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:01.630358 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:01.630318 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:01.801448 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:01.801406 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:12:01.801583 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:01.801508 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5bmx6\" (UID: \"c128d9fa-7cfe-4caf-aee7-367152ecf337\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:12:01.801583 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:01.801564 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 11:12:01.801667 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:01.801584 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d9cb8f98-6nhnb: secret "image-registry-tls" not found Jul 14 11:12:01.801667 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:01.801597 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 11:12:01.801667 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:01.801639 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls podName:a488e467-3419-45fe-a8e1-8b6707e7752d nodeName:}" failed. No retries permitted until 2026-07-14 11:12:05.801623173 +0000 UTC m=+44.126987704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls") pod "image-registry-68d9cb8f98-6nhnb" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d") : secret "image-registry-tls" not found Jul 14 11:12:01.801667 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:01.801653 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert podName:c128d9fa-7cfe-4caf-aee7-367152ecf337 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:05.801647271 +0000 UTC m=+44.127011780 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-5bmx6" (UID: "c128d9fa-7cfe-4caf-aee7-367152ecf337") : secret "networking-console-plugin-cert" not found Jul 14 11:12:01.901845 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:01.901805 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:12:01.902003 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:01.901956 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:12:01.902047 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:01.902014 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls podName:abf7ad10-3167-4df7-b172-5dfe1082217e nodeName:}" failed. No retries permitted until 2026-07-14 11:12:05.901999964 +0000 UTC m=+44.227364474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls") pod "dns-default-gd299" (UID: "abf7ad10-3167-4df7-b172-5dfe1082217e") : secret "dns-default-metrics-tls" not found Jul 14 11:12:01.924615 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:01.924577 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:02.040305 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:02.040276 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:02.347828 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:02.347798 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:02.423282 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:02.423253 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:04.779635 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:04.779597 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:04.907337 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:04.907313 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:05.831988 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:05.831947 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5bmx6\" (UID: \"c128d9fa-7cfe-4caf-aee7-367152ecf337\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:12:05.832384 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:05.832003 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:12:05.832384 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:05.832081 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 11:12:05.832384 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:05.832142 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert podName:c128d9fa-7cfe-4caf-aee7-367152ecf337 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:13.832127228 +0000 UTC m=+52.157491738 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-5bmx6" (UID: "c128d9fa-7cfe-4caf-aee7-367152ecf337") : secret "networking-console-plugin-cert" not found Jul 14 11:12:05.832384 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:05.832089 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 11:12:05.832384 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:05.832186 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d9cb8f98-6nhnb: secret "image-registry-tls" not found Jul 14 11:12:05.832384 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:05.832239 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls podName:a488e467-3419-45fe-a8e1-8b6707e7752d nodeName:}" failed. No retries permitted until 2026-07-14 11:12:13.832227221 +0000 UTC m=+52.157591731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls") pod "image-registry-68d9cb8f98-6nhnb" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d") : secret "image-registry-tls" not found Jul 14 11:12:05.932930 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:05.932901 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:12:05.933096 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:05.933002 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:12:05.933096 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:05.933050 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls podName:abf7ad10-3167-4df7-b172-5dfe1082217e nodeName:}" failed. No retries permitted until 2026-07-14 11:12:13.933036381 +0000 UTC m=+52.258400891 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls") pod "dns-default-gd299" (UID: "abf7ad10-3167-4df7-b172-5dfe1082217e") : secret "dns-default-metrics-tls" not found Jul 14 11:12:10.955563 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:10.955527 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:11.020181 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:11.020146 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:13.884111 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:13.884075 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5bmx6\" (UID: \"c128d9fa-7cfe-4caf-aee7-367152ecf337\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:12:13.884514 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:13.884130 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:12:13.884514 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:13.884252 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 11:12:13.884514 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:13.884318 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert podName:c128d9fa-7cfe-4caf-aee7-367152ecf337 nodeName:}" failed. No retries permitted until 2026-07-14 11:12:29.884302325 +0000 UTC m=+68.209666838 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-5bmx6" (UID: "c128d9fa-7cfe-4caf-aee7-367152ecf337") : secret "networking-console-plugin-cert" not found Jul 14 11:12:13.884514 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:13.884255 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 11:12:13.884514 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:13.884351 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d9cb8f98-6nhnb: secret "image-registry-tls" not found Jul 14 11:12:13.884514 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:13.884391 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls podName:a488e467-3419-45fe-a8e1-8b6707e7752d nodeName:}" failed. No retries permitted until 2026-07-14 11:12:29.884379814 +0000 UTC m=+68.209744324 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls") pod "image-registry-68d9cb8f98-6nhnb" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d") : secret "image-registry-tls" not found Jul 14 11:12:13.984746 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:13.984710 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:12:13.984882 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:13.984859 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:12:13.984935 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:13.984925 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls podName:abf7ad10-3167-4df7-b172-5dfe1082217e nodeName:}" failed. No retries permitted until 2026-07-14 11:12:29.984910228 +0000 UTC m=+68.310274738 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls") pod "dns-default-gd299" (UID: "abf7ad10-3167-4df7-b172-5dfe1082217e") : secret "dns-default-metrics-tls" not found Jul 14 11:12:15.323614 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:15.323577 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:15.387250 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:15.387199 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:16.757671 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:16.757638 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:23.457931 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:23.457898 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5f7fw" Jul 14 11:12:23.659537 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:23.659502 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:23.820441 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:23.820412 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:25.575597 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:25.575565 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:25.641735 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:25.641702 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:25.703774 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:25.703746 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:27.989467 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:27.989423 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgw4w\" (UniqueName: \"kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w\") pod \"network-check-target-fw8ms\" (UID: \"1864e70c-c595-4f7a-8c60-63e7e8eb5049\") " pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:12:27.992655 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:27.992627 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 11:12:28.002878 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:28.002851 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 11:12:28.014002 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:28.013981 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgw4w\" (UniqueName: \"kubernetes.io/projected/1864e70c-c595-4f7a-8c60-63e7e8eb5049-kube-api-access-vgw4w\") pod \"network-check-target-fw8ms\" (UID: \"1864e70c-c595-4f7a-8c60-63e7e8eb5049\") " pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:12:28.090522 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:28.090479 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret\") pod \"global-pull-secret-syncer-7pfjj\" (UID: \"de833d9f-3bca-4b05-9a86-ba9e8190d1db\") " pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:12:28.090681 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:28.090552 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs\") pod \"network-metrics-daemon-hmxjp\" (UID: \"e071bfee-a93c-4c4e-92fa-ee406aced61a\") " pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:12:28.093402 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:28.093385 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 11:12:28.093507 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:28.093487 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 11:12:28.100821 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:28.100805 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 11:12:28.100887 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:28.100859 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs podName:e071bfee-a93c-4c4e-92fa-ee406aced61a nodeName:}" failed. No retries permitted until 2026-07-14 11:13:32.100844374 +0000 UTC m=+130.426208887 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs") pod "network-metrics-daemon-hmxjp" (UID: "e071bfee-a93c-4c4e-92fa-ee406aced61a") : secret "metrics-daemon-secret" not found Jul 14 11:12:28.102848 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:28.102824 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de833d9f-3bca-4b05-9a86-ba9e8190d1db-original-pull-secret\") pod \"global-pull-secret-syncer-7pfjj\" (UID: \"de833d9f-3bca-4b05-9a86-ba9e8190d1db\") " pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:12:28.113060 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:28.113043 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pfjj" Jul 14 11:12:28.121609 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:28.121588 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-56vkg\"" Jul 14 11:12:28.129063 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:28.129043 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:12:28.239384 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:28.239345 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7pfjj"] Jul 14 11:12:28.242546 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:12:28.242519 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde833d9f_3bca_4b05_9a86_ba9e8190d1db.slice/crio-d7323b5a932e7e8a10a02f8bd603a58efe388d805802ddd12bfd4f4e9e326cb7 WatchSource:0}: Error finding container d7323b5a932e7e8a10a02f8bd603a58efe388d805802ddd12bfd4f4e9e326cb7: Status 404 returned error can't find the container with id d7323b5a932e7e8a10a02f8bd603a58efe388d805802ddd12bfd4f4e9e326cb7 Jul 14 11:12:28.256037 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:28.256012 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fw8ms"] Jul 14 11:12:28.258114 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:12:28.258091 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1864e70c_c595_4f7a_8c60_63e7e8eb5049.slice/crio-1e6f708cf7124d057b2ca89091ede24223eca172b717b2b932f69fc82f2e31a0 WatchSource:0}: Error finding container 1e6f708cf7124d057b2ca89091ede24223eca172b717b2b932f69fc82f2e31a0: Status 404 returned error can't find the container with id 1e6f708cf7124d057b2ca89091ede24223eca172b717b2b932f69fc82f2e31a0 Jul 14 11:12:28.543214 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:28.543163 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fw8ms" event={"ID":"1864e70c-c595-4f7a-8c60-63e7e8eb5049","Type":"ContainerStarted","Data":"1e6f708cf7124d057b2ca89091ede24223eca172b717b2b932f69fc82f2e31a0"} Jul 14 11:12:28.544178 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:28.544149 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7pfjj" event={"ID":"de833d9f-3bca-4b05-9a86-ba9e8190d1db","Type":"ContainerStarted","Data":"d7323b5a932e7e8a10a02f8bd603a58efe388d805802ddd12bfd4f4e9e326cb7"} Jul 14 11:12:29.907102 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:29.907065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:12:29.907586 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:29.907168 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5bmx6\" (UID: \"c128d9fa-7cfe-4caf-aee7-367152ecf337\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:12:29.907586 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:29.907319 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 11:12:29.907586 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:29.907386 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert podName:c128d9fa-7cfe-4caf-aee7-367152ecf337 nodeName:}" failed. No retries permitted until 2026-07-14 11:13:01.90736612 +0000 UTC m=+100.232730634 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-5bmx6" (UID: "c128d9fa-7cfe-4caf-aee7-367152ecf337") : secret "networking-console-plugin-cert" not found Jul 14 11:12:29.907586 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:29.907524 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 11:12:29.907586 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:29.907546 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d9cb8f98-6nhnb: secret "image-registry-tls" not found Jul 14 11:12:29.907863 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:29.907642 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls podName:a488e467-3419-45fe-a8e1-8b6707e7752d nodeName:}" failed. No retries permitted until 2026-07-14 11:13:01.907623281 +0000 UTC m=+100.232987799 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls") pod "image-registry-68d9cb8f98-6nhnb" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d") : secret "image-registry-tls" not found Jul 14 11:12:30.008050 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:30.008011 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:12:30.008246 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:30.008171 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:12:30.008314 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:12:30.008276 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls podName:abf7ad10-3167-4df7-b172-5dfe1082217e nodeName:}" failed. No retries permitted until 2026-07-14 11:13:02.008253378 +0000 UTC m=+100.333617904 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls") pod "dns-default-gd299" (UID: "abf7ad10-3167-4df7-b172-5dfe1082217e") : secret "dns-default-metrics-tls" not found Jul 14 11:12:33.558137 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:33.558099 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fw8ms" event={"ID":"1864e70c-c595-4f7a-8c60-63e7e8eb5049","Type":"ContainerStarted","Data":"3e80131dfd4709a514f979a900b770d5b26015108ea7cfced26af2126e7b9562"} Jul 14 11:12:33.558551 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:33.558240 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:12:33.559572 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:33.559551 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7pfjj" event={"ID":"de833d9f-3bca-4b05-9a86-ba9e8190d1db","Type":"ContainerStarted","Data":"6b3a25abd072a71d0b1b0b6fe3140dfe5fcee2efea2de74d41ffd9ae7bf88323"} Jul 14 11:12:33.574484 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:33.574447 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fw8ms" podStartSLOduration=67.010012019 podStartE2EDuration="1m11.574435276s" totalImagesPullingTime="4.564423257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:33.573244089 +0000 UTC m=+71.898608623" watchObservedRunningTime="2026-07-14 11:12:33.574435276 +0000 UTC m=+71.899799808" Jul 14 11:12:33.587751 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:33.587714 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7pfjj" podStartSLOduration=67.003410417 podStartE2EDuration="1m11.587702562s" totalImagesPullingTime="4.584292145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:12:33.58708639 +0000 UTC m=+71.912450937" watchObservedRunningTime="2026-07-14 11:12:33.587702562 +0000 UTC m=+71.913067094" Jul 14 11:12:37.292335 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:37.292297 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:37.395052 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:37.395021 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:12:37.492900 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:12:37.492857 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:13:01.932654 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:13:01.932616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5bmx6\" (UID: \"c128d9fa-7cfe-4caf-aee7-367152ecf337\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:13:01.932654 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:13:01.932664 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:13:01.933187 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:13:01.932795 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 11:13:01.933293 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:13:01.933238 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 11:13:01.933293 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:13:01.933264 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d9cb8f98-6nhnb: secret "image-registry-tls" not found Jul 14 11:13:01.933389 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:13:01.933350 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls podName:a488e467-3419-45fe-a8e1-8b6707e7752d nodeName:}" failed. No retries permitted until 2026-07-14 11:14:05.933329745 +0000 UTC m=+164.258694270 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls") pod "image-registry-68d9cb8f98-6nhnb" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d") : secret "image-registry-tls" not found Jul 14 11:13:01.934287 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:13:01.934251 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert podName:c128d9fa-7cfe-4caf-aee7-367152ecf337 nodeName:}" failed. No retries permitted until 2026-07-14 11:14:05.934138926 +0000 UTC m=+164.259503449 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-5bmx6" (UID: "c128d9fa-7cfe-4caf-aee7-367152ecf337") : secret "networking-console-plugin-cert" not found Jul 14 11:13:02.033854 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:13:02.033801 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:13:02.034039 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:13:02.033967 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:13:02.034039 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:13:02.034030 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls podName:abf7ad10-3167-4df7-b172-5dfe1082217e nodeName:}" failed. No retries permitted until 2026-07-14 11:14:06.034015353 +0000 UTC m=+164.359379863 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls") pod "dns-default-gd299" (UID: "abf7ad10-3167-4df7-b172-5dfe1082217e") : secret "dns-default-metrics-tls" not found Jul 14 11:13:04.564345 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:13:04.564314 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fw8ms" Jul 14 11:13:32.153384 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:13:32.153326 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs\") pod \"network-metrics-daemon-hmxjp\" (UID: \"e071bfee-a93c-4c4e-92fa-ee406aced61a\") " pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:13:32.153930 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:13:32.153470 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 11:13:32.153930 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:13:32.153542 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs podName:e071bfee-a93c-4c4e-92fa-ee406aced61a nodeName:}" failed. No retries permitted until 2026-07-14 11:15:34.153526216 +0000 UTC m=+252.478890726 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs") pod "network-metrics-daemon-hmxjp" (UID: "e071bfee-a93c-4c4e-92fa-ee406aced61a") : secret "metrics-daemon-secret" not found Jul 14 11:14:01.059521 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:14:01.059478 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" podUID="c128d9fa-7cfe-4caf-aee7-367152ecf337" Jul 14 11:14:01.064797 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:14:01.064760 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" podUID="a488e467-3419-45fe-a8e1-8b6707e7752d" Jul 14 11:14:01.121135 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:14:01.121060 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gd299" podUID="abf7ad10-3167-4df7-b172-5dfe1082217e" Jul 14 11:14:01.764557 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:14:01.764525 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:14:01.764747 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:14:01.764525 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:14:01.764747 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:14:01.764525 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gd299" Jul 14 11:14:02.307045 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:14:02.307007 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:14:05.991801 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:14:05.991756 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5bmx6\" (UID: \"c128d9fa-7cfe-4caf-aee7-367152ecf337\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:14:05.992343 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:14:05.991825 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:14:05.992343 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:14:05.991910 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 11:14:05.992343 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:14:05.991961 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 11:14:05.992343 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:14:05.991980 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d9cb8f98-6nhnb: secret "image-registry-tls" not found Jul 14 11:14:05.992343 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:14:05.991964 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert podName:c128d9fa-7cfe-4caf-aee7-367152ecf337 nodeName:}" failed. No retries permitted until 2026-07-14 11:16:07.991949278 +0000 UTC m=+286.317313792 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-5bmx6" (UID: "c128d9fa-7cfe-4caf-aee7-367152ecf337") : secret "networking-console-plugin-cert" not found Jul 14 11:14:05.992343 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:14:05.992028 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls podName:a488e467-3419-45fe-a8e1-8b6707e7752d nodeName:}" failed. No retries permitted until 2026-07-14 11:16:07.992013132 +0000 UTC m=+286.317377642 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls") pod "image-registry-68d9cb8f98-6nhnb" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d") : secret "image-registry-tls" not found Jul 14 11:14:06.092377 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:14:06.092324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:14:06.092529 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:14:06.092466 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 11:14:06.092529 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:14:06.092526 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls podName:abf7ad10-3167-4df7-b172-5dfe1082217e nodeName:}" failed. No retries permitted until 2026-07-14 11:16:08.092510401 +0000 UTC m=+286.417874916 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls") pod "dns-default-gd299" (UID: "abf7ad10-3167-4df7-b172-5dfe1082217e") : secret "dns-default-metrics-tls" not found Jul 14 11:14:17.297386 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:14:17.297347 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:14:53.744600 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:14:53.744543 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:07.642384 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:07.642353 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:24.157283 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:24.157249 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:34.203685 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:34.203631 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs\") pod \"network-metrics-daemon-hmxjp\" (UID: \"e071bfee-a93c-4c4e-92fa-ee406aced61a\") " pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:15:34.204089 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:34.203776 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 11:15:34.204089 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:34.203841 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs podName:e071bfee-a93c-4c4e-92fa-ee406aced61a nodeName:}" failed. No retries permitted until 2026-07-14 11:17:36.203825226 +0000 UTC m=+374.529189736 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs") pod "network-metrics-daemon-hmxjp" (UID: "e071bfee-a93c-4c4e-92fa-ee406aced61a") : secret "metrics-daemon-secret" not found Jul 14 11:15:43.422621 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.422589 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j"] Jul 14 11:15:43.425479 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.425461 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j" Jul 14 11:15:43.428606 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.428583 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-xvxhc"] Jul 14 11:15:43.429001 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.428971 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:15:43.429110 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.428981 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 14 11:15:43.429340 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.429323 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 14 11:15:43.430027 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.430006 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 14 11:15:43.430131 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.430011 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rfm4w\"" Jul 14 11:15:43.431293 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.431273 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k"] Jul 14 11:15:43.431422 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.431405 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:15:43.434291 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.434274 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 14 11:15:43.434291 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.434284 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5"] Jul 14 11:15:43.434429 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.434322 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-b4lc2\"" Jul 14 11:15:43.434429 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.434405 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" Jul 14 11:15:43.434594 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.434573 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 14 11:15:43.435523 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.435509 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 14 11:15:43.436386 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.436370 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:15:43.436909 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.436890 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" Jul 14 11:15:43.442086 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.442061 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 14 11:15:43.442605 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.442583 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 11:15:43.442697 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.442655 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 11:15:43.442958 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.442928 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-grwrf\"" Jul 14 11:15:43.443388 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.443370 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j"] Jul 14 11:15:43.444734 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.444716 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 14 11:15:43.444881 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.444820 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 14 11:15:43.444956 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.444825 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:15:43.444956 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.444824 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lsxj7\"" Jul 14 11:15:43.445067 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.444867 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 14 11:15:43.445067 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.444873 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 14 11:15:43.457181 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.457160 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k"] Jul 14 11:15:43.460826 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.460802 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5"] Jul 14 11:15:43.461653 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.461632 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-xvxhc"] Jul 14 11:15:43.472560 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.472538 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26b43cc7-353e-42f8-ac60-29fb5bd6c510-serving-cert\") pod \"console-operator-7866497494-xvxhc\" (UID: \"26b43cc7-353e-42f8-ac60-29fb5bd6c510\") " pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:15:43.472677 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.472566 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcz6c\" (UniqueName: \"kubernetes.io/projected/dc7acf92-5cb9-48e3-8901-75e719e72682-kube-api-access-mcz6c\") pod \"cluster-monitoring-operator-5f7f494dd4-rj5j5\" (UID: \"dc7acf92-5cb9-48e3-8901-75e719e72682\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" Jul 14 11:15:43.472677 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.472587 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rj5j5\" (UID: \"dc7acf92-5cb9-48e3-8901-75e719e72682\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" Jul 14 11:15:43.472677 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.472624 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2cf3e52-07c6-449f-9b50-eed99435c099-config\") pod \"service-ca-operator-7695fc6c8c-p8v6j\" (UID: \"b2cf3e52-07c6-449f-9b50-eed99435c099\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j" Jul 14 11:15:43.472677 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.472656 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7jmf\" (UniqueName: \"kubernetes.io/projected/266dc7d8-4f90-4cfd-9255-77de3870cebe-kube-api-access-k7jmf\") pod \"cluster-samples-operator-65db858894-dx68k\" (UID: \"266dc7d8-4f90-4cfd-9255-77de3870cebe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" Jul 14 11:15:43.472817 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.472712 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2cf3e52-07c6-449f-9b50-eed99435c099-serving-cert\") pod \"service-ca-operator-7695fc6c8c-p8v6j\" (UID: \"b2cf3e52-07c6-449f-9b50-eed99435c099\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j" Jul 14 11:15:43.472817 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.472734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78p98\" (UniqueName: \"kubernetes.io/projected/b2cf3e52-07c6-449f-9b50-eed99435c099-kube-api-access-78p98\") pod \"service-ca-operator-7695fc6c8c-p8v6j\" (UID: \"b2cf3e52-07c6-449f-9b50-eed99435c099\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j" Jul 14 11:15:43.472817 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.472758 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26b43cc7-353e-42f8-ac60-29fb5bd6c510-config\") pod \"console-operator-7866497494-xvxhc\" (UID: \"26b43cc7-353e-42f8-ac60-29fb5bd6c510\") " pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:15:43.472817 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.472793 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26b43cc7-353e-42f8-ac60-29fb5bd6c510-trusted-ca\") pod \"console-operator-7866497494-xvxhc\" (UID: \"26b43cc7-353e-42f8-ac60-29fb5bd6c510\") " pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:15:43.472943 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.472836 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dc7acf92-5cb9-48e3-8901-75e719e72682-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-rj5j5\" (UID: \"dc7acf92-5cb9-48e3-8901-75e719e72682\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" Jul 14 11:15:43.472943 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.472861 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6tsg\" (UniqueName: \"kubernetes.io/projected/26b43cc7-353e-42f8-ac60-29fb5bd6c510-kube-api-access-t6tsg\") pod \"console-operator-7866497494-xvxhc\" (UID: \"26b43cc7-353e-42f8-ac60-29fb5bd6c510\") " pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:15:43.472943 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.472932 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dx68k\" (UID: \"266dc7d8-4f90-4cfd-9255-77de3870cebe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" Jul 14 11:15:43.573447 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.573413 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dx68k\" (UID: \"266dc7d8-4f90-4cfd-9255-77de3870cebe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" Jul 14 11:15:43.573447 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.573452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26b43cc7-353e-42f8-ac60-29fb5bd6c510-serving-cert\") pod \"console-operator-7866497494-xvxhc\" (UID: \"26b43cc7-353e-42f8-ac60-29fb5bd6c510\") " pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:15:43.573716 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.573470 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcz6c\" (UniqueName: \"kubernetes.io/projected/dc7acf92-5cb9-48e3-8901-75e719e72682-kube-api-access-mcz6c\") pod \"cluster-monitoring-operator-5f7f494dd4-rj5j5\" (UID: \"dc7acf92-5cb9-48e3-8901-75e719e72682\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" Jul 14 11:15:43.573716 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.573491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rj5j5\" (UID: \"dc7acf92-5cb9-48e3-8901-75e719e72682\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" Jul 14 11:15:43.573716 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.573514 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2cf3e52-07c6-449f-9b50-eed99435c099-config\") pod \"service-ca-operator-7695fc6c8c-p8v6j\" (UID: \"b2cf3e52-07c6-449f-9b50-eed99435c099\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j" Jul 14 11:15:43.573716 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:43.573577 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 11:15:43.573716 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:43.573648 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls podName:266dc7d8-4f90-4cfd-9255-77de3870cebe nodeName:}" failed. No retries permitted until 2026-07-14 11:15:44.073628176 +0000 UTC m=+262.398992700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls") pod "cluster-samples-operator-65db858894-dx68k" (UID: "266dc7d8-4f90-4cfd-9255-77de3870cebe") : secret "samples-operator-tls" not found Jul 14 11:15:43.573716 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:43.573590 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 11:15:43.574072 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.573690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7jmf\" (UniqueName: \"kubernetes.io/projected/266dc7d8-4f90-4cfd-9255-77de3870cebe-kube-api-access-k7jmf\") pod \"cluster-samples-operator-65db858894-dx68k\" (UID: \"266dc7d8-4f90-4cfd-9255-77de3870cebe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" Jul 14 11:15:43.574072 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:43.573759 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls podName:dc7acf92-5cb9-48e3-8901-75e719e72682 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:44.073742239 +0000 UTC m=+262.399106752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rj5j5" (UID: "dc7acf92-5cb9-48e3-8901-75e719e72682") : secret "cluster-monitoring-operator-tls" not found Jul 14 11:15:43.574072 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.573818 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2cf3e52-07c6-449f-9b50-eed99435c099-serving-cert\") pod \"service-ca-operator-7695fc6c8c-p8v6j\" (UID: \"b2cf3e52-07c6-449f-9b50-eed99435c099\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j" Jul 14 11:15:43.574072 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.573858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78p98\" (UniqueName: \"kubernetes.io/projected/b2cf3e52-07c6-449f-9b50-eed99435c099-kube-api-access-78p98\") pod \"service-ca-operator-7695fc6c8c-p8v6j\" (UID: \"b2cf3e52-07c6-449f-9b50-eed99435c099\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j" Jul 14 11:15:43.574072 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.573996 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26b43cc7-353e-42f8-ac60-29fb5bd6c510-config\") pod \"console-operator-7866497494-xvxhc\" (UID: \"26b43cc7-353e-42f8-ac60-29fb5bd6c510\") " pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:15:43.574072 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.574043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26b43cc7-353e-42f8-ac60-29fb5bd6c510-trusted-ca\") pod \"console-operator-7866497494-xvxhc\" (UID: \"26b43cc7-353e-42f8-ac60-29fb5bd6c510\") " pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:15:43.574378 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.574115 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dc7acf92-5cb9-48e3-8901-75e719e72682-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-rj5j5\" (UID: \"dc7acf92-5cb9-48e3-8901-75e719e72682\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" Jul 14 11:15:43.574378 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.574144 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2cf3e52-07c6-449f-9b50-eed99435c099-config\") pod \"service-ca-operator-7695fc6c8c-p8v6j\" (UID: \"b2cf3e52-07c6-449f-9b50-eed99435c099\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j" Jul 14 11:15:43.574378 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.574155 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6tsg\" (UniqueName: \"kubernetes.io/projected/26b43cc7-353e-42f8-ac60-29fb5bd6c510-kube-api-access-t6tsg\") pod \"console-operator-7866497494-xvxhc\" (UID: \"26b43cc7-353e-42f8-ac60-29fb5bd6c510\") " pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:15:43.574766 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.574742 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26b43cc7-353e-42f8-ac60-29fb5bd6c510-config\") pod \"console-operator-7866497494-xvxhc\" (UID: \"26b43cc7-353e-42f8-ac60-29fb5bd6c510\") " pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:15:43.574838 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.574766 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dc7acf92-5cb9-48e3-8901-75e719e72682-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-rj5j5\" (UID: \"dc7acf92-5cb9-48e3-8901-75e719e72682\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" Jul 14 11:15:43.575150 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.575131 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26b43cc7-353e-42f8-ac60-29fb5bd6c510-trusted-ca\") pod \"console-operator-7866497494-xvxhc\" (UID: \"26b43cc7-353e-42f8-ac60-29fb5bd6c510\") " pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:15:43.575841 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.575820 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26b43cc7-353e-42f8-ac60-29fb5bd6c510-serving-cert\") pod \"console-operator-7866497494-xvxhc\" (UID: \"26b43cc7-353e-42f8-ac60-29fb5bd6c510\") " pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:15:43.576027 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.576010 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2cf3e52-07c6-449f-9b50-eed99435c099-serving-cert\") pod \"service-ca-operator-7695fc6c8c-p8v6j\" (UID: \"b2cf3e52-07c6-449f-9b50-eed99435c099\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j" Jul 14 11:15:43.584882 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.584862 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78p98\" (UniqueName: \"kubernetes.io/projected/b2cf3e52-07c6-449f-9b50-eed99435c099-kube-api-access-78p98\") pod \"service-ca-operator-7695fc6c8c-p8v6j\" (UID: \"b2cf3e52-07c6-449f-9b50-eed99435c099\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j" Jul 14 11:15:43.585098 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.585075 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7jmf\" (UniqueName: \"kubernetes.io/projected/266dc7d8-4f90-4cfd-9255-77de3870cebe-kube-api-access-k7jmf\") pod \"cluster-samples-operator-65db858894-dx68k\" (UID: \"266dc7d8-4f90-4cfd-9255-77de3870cebe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" Jul 14 11:15:43.585375 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.585359 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6tsg\" (UniqueName: \"kubernetes.io/projected/26b43cc7-353e-42f8-ac60-29fb5bd6c510-kube-api-access-t6tsg\") pod \"console-operator-7866497494-xvxhc\" (UID: \"26b43cc7-353e-42f8-ac60-29fb5bd6c510\") " pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:15:43.585455 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.585439 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcz6c\" (UniqueName: \"kubernetes.io/projected/dc7acf92-5cb9-48e3-8901-75e719e72682-kube-api-access-mcz6c\") pod \"cluster-monitoring-operator-5f7f494dd4-rj5j5\" (UID: \"dc7acf92-5cb9-48e3-8901-75e719e72682\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" Jul 14 11:15:43.735218 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.735121 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j" Jul 14 11:15:43.741981 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.741962 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:15:43.805265 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.805168 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:43.872752 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.872722 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j"] Jul 14 11:15:43.874794 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:15:43.874769 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2cf3e52_07c6_449f_9b50_eed99435c099.slice/crio-2ac8e58669925537d77c30adb694c5a701051ac5a3989be95d4b6c66c228d660 WatchSource:0}: Error finding container 2ac8e58669925537d77c30adb694c5a701051ac5a3989be95d4b6c66c228d660: Status 404 returned error can't find the container with id 2ac8e58669925537d77c30adb694c5a701051ac5a3989be95d4b6c66c228d660 Jul 14 11:15:43.881596 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.881494 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-xvxhc"] Jul 14 11:15:43.883376 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:15:43.883353 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b43cc7_353e_42f8_ac60_29fb5bd6c510.slice/crio-11e002870b6ff0bd356136eb733f0c20dbb814dd3c498557eb2aaf0683589169 WatchSource:0}: Error finding container 11e002870b6ff0bd356136eb733f0c20dbb814dd3c498557eb2aaf0683589169: Status 404 returned error can't find the container with id 11e002870b6ff0bd356136eb733f0c20dbb814dd3c498557eb2aaf0683589169 Jul 14 11:15:43.890097 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:43.890074 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:44.002748 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:44.002716 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xvxhc" event={"ID":"26b43cc7-353e-42f8-ac60-29fb5bd6c510","Type":"ContainerStarted","Data":"11e002870b6ff0bd356136eb733f0c20dbb814dd3c498557eb2aaf0683589169"} Jul 14 11:15:44.003639 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:44.003611 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j" event={"ID":"b2cf3e52-07c6-449f-9b50-eed99435c099","Type":"ContainerStarted","Data":"2ac8e58669925537d77c30adb694c5a701051ac5a3989be95d4b6c66c228d660"} Jul 14 11:15:44.079079 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:44.079051 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dx68k\" (UID: \"266dc7d8-4f90-4cfd-9255-77de3870cebe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" Jul 14 11:15:44.079244 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:44.079089 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rj5j5\" (UID: \"dc7acf92-5cb9-48e3-8901-75e719e72682\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" Jul 14 11:15:44.079244 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:44.079232 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 11:15:44.079333 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:44.079292 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls podName:dc7acf92-5cb9-48e3-8901-75e719e72682 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:45.07927865 +0000 UTC m=+263.404643160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rj5j5" (UID: "dc7acf92-5cb9-48e3-8901-75e719e72682") : secret "cluster-monitoring-operator-tls" not found Jul 14 11:15:44.079333 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:44.079233 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 11:15:44.079333 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:44.079329 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls podName:266dc7d8-4f90-4cfd-9255-77de3870cebe nodeName:}" failed. No retries permitted until 2026-07-14 11:15:45.079319751 +0000 UTC m=+263.404684262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls") pod "cluster-samples-operator-65db858894-dx68k" (UID: "266dc7d8-4f90-4cfd-9255-77de3870cebe") : secret "samples-operator-tls" not found Jul 14 11:15:45.086996 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:45.086956 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dx68k\" (UID: \"266dc7d8-4f90-4cfd-9255-77de3870cebe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" Jul 14 11:15:45.087461 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:45.087009 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rj5j5\" (UID: \"dc7acf92-5cb9-48e3-8901-75e719e72682\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" Jul 14 11:15:45.087461 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:45.087136 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 11:15:45.087461 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:45.087138 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 11:15:45.087461 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:45.087224 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls podName:266dc7d8-4f90-4cfd-9255-77de3870cebe nodeName:}" failed. No retries permitted until 2026-07-14 11:15:47.087192359 +0000 UTC m=+265.412556868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls") pod "cluster-samples-operator-65db858894-dx68k" (UID: "266dc7d8-4f90-4cfd-9255-77de3870cebe") : secret "samples-operator-tls" not found Jul 14 11:15:45.087461 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:45.087242 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls podName:dc7acf92-5cb9-48e3-8901-75e719e72682 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:47.087233621 +0000 UTC m=+265.412598131 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rj5j5" (UID: "dc7acf92-5cb9-48e3-8901-75e719e72682") : secret "cluster-monitoring-operator-tls" not found Jul 14 11:15:45.902915 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:45.902886 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:45.999396 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:45.999356 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:47.013718 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.013690 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvxhc_26b43cc7-353e-42f8-ac60-29fb5bd6c510/console-operator/0.log" Jul 14 11:15:47.014138 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.013735 2561 generic.go:356] "Generic (PLEG): container finished" podID="26b43cc7-353e-42f8-ac60-29fb5bd6c510" containerID="180de59ad23de605b38e3ce1bf8fa93bd95660246fd844f3d3ecdfc72c8be90a" exitCode=255 Jul 14 11:15:47.014138 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.013819 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xvxhc" event={"ID":"26b43cc7-353e-42f8-ac60-29fb5bd6c510","Type":"ContainerDied","Data":"180de59ad23de605b38e3ce1bf8fa93bd95660246fd844f3d3ecdfc72c8be90a"} Jul 14 11:15:47.014138 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.014035 2561 scope.go:117] "RemoveContainer" containerID="180de59ad23de605b38e3ce1bf8fa93bd95660246fd844f3d3ecdfc72c8be90a" Jul 14 11:15:47.015235 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.015192 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j" event={"ID":"b2cf3e52-07c6-449f-9b50-eed99435c099","Type":"ContainerStarted","Data":"b419af3b67be70f76f2ea6f3915dc86c911f9d0fc3d80c1a4520441d05873978"} Jul 14 11:15:47.052331 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.052281 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j" podStartSLOduration=1.486223721 podStartE2EDuration="4.052264914s" totalImagesPullingTime="2.566041193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:15:47.051324026 +0000 UTC m=+265.376688558" watchObservedRunningTime="2026-07-14 11:15:47.052264914 +0000 UTC m=+265.377629446" Jul 14 11:15:47.104802 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.104414 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dx68k\" (UID: \"266dc7d8-4f90-4cfd-9255-77de3870cebe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" Jul 14 11:15:47.104802 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.104484 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rj5j5\" (UID: \"dc7acf92-5cb9-48e3-8901-75e719e72682\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" Jul 14 11:15:47.105105 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:47.105076 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 11:15:47.105445 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:47.105162 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls podName:266dc7d8-4f90-4cfd-9255-77de3870cebe nodeName:}" failed. No retries permitted until 2026-07-14 11:15:51.105131899 +0000 UTC m=+269.430496414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls") pod "cluster-samples-operator-65db858894-dx68k" (UID: "266dc7d8-4f90-4cfd-9255-77de3870cebe") : secret "samples-operator-tls" not found Jul 14 11:15:47.105543 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:47.105456 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 11:15:47.105543 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:47.105504 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls podName:dc7acf92-5cb9-48e3-8901-75e719e72682 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:51.105488193 +0000 UTC m=+269.430852718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rj5j5" (UID: "dc7acf92-5cb9-48e3-8901-75e719e72682") : secret "cluster-monitoring-operator-tls" not found Jul 14 11:15:47.369694 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.369618 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2svxb"] Jul 14 11:15:47.372756 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.372735 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:47.376467 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.376438 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 11:15:47.376689 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.376661 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 11:15:47.376810 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.376734 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v758q\"" Jul 14 11:15:47.376810 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.376661 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 11:15:47.381680 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.381659 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 11:15:47.390242 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.390192 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2svxb"] Jul 14 11:15:47.406462 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.406433 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f1a4782-8431-43b5-a631-283f314c86bf-data-volume\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:47.406589 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.406493 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:47.406672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.406654 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:47.406705 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.406689 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f1a4782-8431-43b5-a631-283f314c86bf-crio-socket\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:47.406788 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.406769 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xzxm\" (UniqueName: \"kubernetes.io/projected/2f1a4782-8431-43b5-a631-283f314c86bf-kube-api-access-4xzxm\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:47.441375 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.441340 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:47.507535 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.507499 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f1a4782-8431-43b5-a631-283f314c86bf-crio-socket\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:47.507704 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.507561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xzxm\" (UniqueName: \"kubernetes.io/projected/2f1a4782-8431-43b5-a631-283f314c86bf-kube-api-access-4xzxm\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:47.507704 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.507582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f1a4782-8431-43b5-a631-283f314c86bf-data-volume\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:47.507704 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.507610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:47.507704 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.507632 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f1a4782-8431-43b5-a631-283f314c86bf-crio-socket\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:47.507704 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.507671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:47.507879 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:47.507740 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:15:47.507879 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:47.507746 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:15:47.507879 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:47.507796 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls podName:2f1a4782-8431-43b5-a631-283f314c86bf nodeName:}" failed. No retries permitted until 2026-07-14 11:15:48.00778131 +0000 UTC m=+266.333145820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2svxb" (UID: "2f1a4782-8431-43b5-a631-283f314c86bf") : secret "insights-runtime-extractor-tls" not found Jul 14 11:15:47.507879 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:47.507810 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm podName:2f1a4782-8431-43b5-a631-283f314c86bf nodeName:}" failed. No retries permitted until 2026-07-14 11:15:48.007803496 +0000 UTC m=+266.333168007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2svxb" (UID: "2f1a4782-8431-43b5-a631-283f314c86bf") : configmap "kube-rbac-proxy" not found Jul 14 11:15:47.508039 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.507959 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f1a4782-8431-43b5-a631-283f314c86bf-data-volume\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:47.516346 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.516321 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xzxm\" (UniqueName: \"kubernetes.io/projected/2f1a4782-8431-43b5-a631-283f314c86bf-kube-api-access-4xzxm\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:47.530616 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.530590 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:47.896719 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.896672 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:47.900571 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.900543 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9zllc"] Jul 14 11:15:47.903800 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.903777 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9zllc" Jul 14 11:15:47.906404 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.906387 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-z5rmb\"" Jul 14 11:15:47.906605 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.906590 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 14 11:15:47.906654 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.906623 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 14 11:15:47.914978 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.914955 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9zllc"] Jul 14 11:15:47.988151 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:47.988120 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:48.011432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:48.011389 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f72sb\" (UniqueName: \"kubernetes.io/projected/88d2c81b-cf6f-49d3-b787-ff15880cecac-kube-api-access-f72sb\") pod \"migrator-7f59b54f6c-9zllc\" (UID: \"88d2c81b-cf6f-49d3-b787-ff15880cecac\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9zllc" Jul 14 11:15:48.011556 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:48.011459 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:48.011556 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:48.011514 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:48.011660 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:48.011583 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:15:48.011660 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:48.011595 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:15:48.011660 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:48.011629 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm podName:2f1a4782-8431-43b5-a631-283f314c86bf nodeName:}" failed. No retries permitted until 2026-07-14 11:15:49.01161712 +0000 UTC m=+267.336981630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2svxb" (UID: "2f1a4782-8431-43b5-a631-283f314c86bf") : configmap "kube-rbac-proxy" not found Jul 14 11:15:48.011660 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:48.011640 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls podName:2f1a4782-8431-43b5-a631-283f314c86bf nodeName:}" failed. No retries permitted until 2026-07-14 11:15:49.011634698 +0000 UTC m=+267.336999209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2svxb" (UID: "2f1a4782-8431-43b5-a631-283f314c86bf") : secret "insights-runtime-extractor-tls" not found Jul 14 11:15:48.019425 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:48.019406 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvxhc_26b43cc7-353e-42f8-ac60-29fb5bd6c510/console-operator/1.log" Jul 14 11:15:48.019829 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:48.019812 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvxhc_26b43cc7-353e-42f8-ac60-29fb5bd6c510/console-operator/0.log" Jul 14 11:15:48.019901 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:48.019853 2561 generic.go:356] "Generic (PLEG): container finished" podID="26b43cc7-353e-42f8-ac60-29fb5bd6c510" containerID="d449f63d14829e58a597617801bc7ef177740ff76d94c71103e83ae6f1de4ffe" exitCode=255 Jul 14 11:15:48.019949 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:48.019931 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xvxhc" event={"ID":"26b43cc7-353e-42f8-ac60-29fb5bd6c510","Type":"ContainerDied","Data":"d449f63d14829e58a597617801bc7ef177740ff76d94c71103e83ae6f1de4ffe"} Jul 14 11:15:48.019997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:48.019979 2561 scope.go:117] "RemoveContainer" containerID="180de59ad23de605b38e3ce1bf8fa93bd95660246fd844f3d3ecdfc72c8be90a" Jul 14 11:15:48.020161 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:48.020148 2561 scope.go:117] "RemoveContainer" containerID="d449f63d14829e58a597617801bc7ef177740ff76d94c71103e83ae6f1de4ffe" Jul 14 11:15:48.020354 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:48.020337 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xvxhc_openshift-console-operator(26b43cc7-353e-42f8-ac60-29fb5bd6c510)\"" pod="openshift-console-operator/console-operator-7866497494-xvxhc" podUID="26b43cc7-353e-42f8-ac60-29fb5bd6c510" Jul 14 11:15:48.051640 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:48.051616 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:48.113054 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:48.113015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f72sb\" (UniqueName: \"kubernetes.io/projected/88d2c81b-cf6f-49d3-b787-ff15880cecac-kube-api-access-f72sb\") pod \"migrator-7f59b54f6c-9zllc\" (UID: \"88d2c81b-cf6f-49d3-b787-ff15880cecac\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9zllc" Jul 14 11:15:48.122139 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:48.122108 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f72sb\" (UniqueName: \"kubernetes.io/projected/88d2c81b-cf6f-49d3-b787-ff15880cecac-kube-api-access-f72sb\") pod \"migrator-7f59b54f6c-9zllc\" (UID: \"88d2c81b-cf6f-49d3-b787-ff15880cecac\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9zllc" Jul 14 11:15:48.212153 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:48.212065 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9zllc" Jul 14 11:15:48.212414 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:48.212390 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:48.311312 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:48.311276 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:48.337730 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:48.337699 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9zllc"] Jul 14 11:15:48.340280 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:15:48.340250 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d2c81b_cf6f_49d3_b787_ff15880cecac.slice/crio-84b36f2ce97f471ff4026a62545728bcbaf175e8f1a43fdfd90e1cb03bf3a0e1 WatchSource:0}: Error finding container 84b36f2ce97f471ff4026a62545728bcbaf175e8f1a43fdfd90e1cb03bf3a0e1: Status 404 returned error can't find the container with id 84b36f2ce97f471ff4026a62545728bcbaf175e8f1a43fdfd90e1cb03bf3a0e1 Jul 14 11:15:49.020643 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.020603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:49.021095 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:49.020711 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:15:49.021095 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.020716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:49.021095 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:49.020767 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls podName:2f1a4782-8431-43b5-a631-283f314c86bf nodeName:}" failed. No retries permitted until 2026-07-14 11:15:51.020751556 +0000 UTC m=+269.346116067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2svxb" (UID: "2f1a4782-8431-43b5-a631-283f314c86bf") : secret "insights-runtime-extractor-tls" not found Jul 14 11:15:49.021095 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:49.020811 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:15:49.021095 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:49.020866 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm podName:2f1a4782-8431-43b5-a631-283f314c86bf nodeName:}" failed. No retries permitted until 2026-07-14 11:15:51.020851569 +0000 UTC m=+269.346216094 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2svxb" (UID: "2f1a4782-8431-43b5-a631-283f314c86bf") : configmap "kube-rbac-proxy" not found Jul 14 11:15:49.024149 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.024129 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvxhc_26b43cc7-353e-42f8-ac60-29fb5bd6c510/console-operator/1.log" Jul 14 11:15:49.024506 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.024483 2561 scope.go:117] "RemoveContainer" containerID="d449f63d14829e58a597617801bc7ef177740ff76d94c71103e83ae6f1de4ffe" Jul 14 11:15:49.024683 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:49.024664 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xvxhc_openshift-console-operator(26b43cc7-353e-42f8-ac60-29fb5bd6c510)\"" pod="openshift-console-operator/console-operator-7866497494-xvxhc" podUID="26b43cc7-353e-42f8-ac60-29fb5bd6c510" Jul 14 11:15:49.025321 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.025301 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9zllc" event={"ID":"88d2c81b-cf6f-49d3-b787-ff15880cecac","Type":"ContainerStarted","Data":"84b36f2ce97f471ff4026a62545728bcbaf175e8f1a43fdfd90e1cb03bf3a0e1"} Jul 14 11:15:49.151353 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.151326 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r58z6_c4451af9-77df-48c7-b30e-af0fa19dc5b8/dns-node-resolver/0.log" Jul 14 11:15:49.837762 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.837691 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-hm8z5"] Jul 14 11:15:49.840625 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.840609 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-hm8z5" Jul 14 11:15:49.843604 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.843587 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 14 11:15:49.843741 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.843721 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-ls54t\"" Jul 14 11:15:49.844806 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.844791 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 14 11:15:49.844858 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.844836 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 14 11:15:49.845063 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.845046 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 14 11:15:49.849415 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.849395 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-hm8z5"] Jul 14 11:15:49.890345 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.890304 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:49.928558 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.928528 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7cf95c4a-d389-4f2a-ae5c-7bf3902acc51-signing-key\") pod \"service-ca-79f68b9f4f-hm8z5\" (UID: \"7cf95c4a-d389-4f2a-ae5c-7bf3902acc51\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hm8z5" Jul 14 11:15:49.928699 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.928653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7cf95c4a-d389-4f2a-ae5c-7bf3902acc51-signing-cabundle\") pod \"service-ca-79f68b9f4f-hm8z5\" (UID: \"7cf95c4a-d389-4f2a-ae5c-7bf3902acc51\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hm8z5" Jul 14 11:15:49.928735 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:49.928693 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljw46\" (UniqueName: \"kubernetes.io/projected/7cf95c4a-d389-4f2a-ae5c-7bf3902acc51-kube-api-access-ljw46\") pod \"service-ca-79f68b9f4f-hm8z5\" (UID: \"7cf95c4a-d389-4f2a-ae5c-7bf3902acc51\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hm8z5" Jul 14 11:15:50.029096 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:50.029064 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7cf95c4a-d389-4f2a-ae5c-7bf3902acc51-signing-cabundle\") pod \"service-ca-79f68b9f4f-hm8z5\" (UID: \"7cf95c4a-d389-4f2a-ae5c-7bf3902acc51\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hm8z5" Jul 14 11:15:50.029554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:50.029114 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljw46\" (UniqueName: \"kubernetes.io/projected/7cf95c4a-d389-4f2a-ae5c-7bf3902acc51-kube-api-access-ljw46\") pod \"service-ca-79f68b9f4f-hm8z5\" (UID: \"7cf95c4a-d389-4f2a-ae5c-7bf3902acc51\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hm8z5" Jul 14 11:15:50.029554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:50.029173 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7cf95c4a-d389-4f2a-ae5c-7bf3902acc51-signing-key\") pod \"service-ca-79f68b9f4f-hm8z5\" (UID: \"7cf95c4a-d389-4f2a-ae5c-7bf3902acc51\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hm8z5" Jul 14 11:15:50.029855 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:50.029834 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7cf95c4a-d389-4f2a-ae5c-7bf3902acc51-signing-cabundle\") pod \"service-ca-79f68b9f4f-hm8z5\" (UID: \"7cf95c4a-d389-4f2a-ae5c-7bf3902acc51\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hm8z5" Jul 14 11:15:50.029935 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:50.029848 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9zllc" event={"ID":"88d2c81b-cf6f-49d3-b787-ff15880cecac","Type":"ContainerStarted","Data":"c4f5b5c88600a689f9d77b3114162492166e8abb66b023439c995b60d3d7a8b5"} Jul 14 11:15:50.029935 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:50.029910 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9zllc" event={"ID":"88d2c81b-cf6f-49d3-b787-ff15880cecac","Type":"ContainerStarted","Data":"c6742cfbd8c0734b6b503fcb7f57f582df57d5f89c6a9ae7501acd0ea9846522"} Jul 14 11:15:50.031719 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:50.031703 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7cf95c4a-d389-4f2a-ae5c-7bf3902acc51-signing-key\") pod \"service-ca-79f68b9f4f-hm8z5\" (UID: \"7cf95c4a-d389-4f2a-ae5c-7bf3902acc51\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hm8z5" Jul 14 11:15:50.037155 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:50.037127 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:50.041369 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:50.041350 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljw46\" (UniqueName: \"kubernetes.io/projected/7cf95c4a-d389-4f2a-ae5c-7bf3902acc51-kube-api-access-ljw46\") pod \"service-ca-79f68b9f4f-hm8z5\" (UID: \"7cf95c4a-d389-4f2a-ae5c-7bf3902acc51\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hm8z5" Jul 14 11:15:50.056445 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:50.056402 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-9zllc" podStartSLOduration=1.86668917 podStartE2EDuration="3.056388598s" totalImagesPullingTime="1.189699428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:15:50.055176067 +0000 UTC m=+268.380540599" watchObservedRunningTime="2026-07-14 11:15:50.056388598 +0000 UTC m=+268.381753149" Jul 14 11:15:50.150109 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:50.150023 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-hm8z5" Jul 14 11:15:50.166104 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:50.166071 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:50.254066 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:50.254036 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:50.278356 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:50.278325 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-hm8z5"] Jul 14 11:15:50.281654 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:15:50.281634 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cf95c4a_d389_4f2a_ae5c_7bf3902acc51.slice/crio-542d1054d17f730850ca20371c96060953bf42cb32536660d08e08c11182c99d WatchSource:0}: Error finding container 542d1054d17f730850ca20371c96060953bf42cb32536660d08e08c11182c99d: Status 404 returned error can't find the container with id 542d1054d17f730850ca20371c96060953bf42cb32536660d08e08c11182c99d Jul 14 11:15:50.350190 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:50.350166 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lhdnx_141a8f07-befb-41e6-b4b2-779001f4c51d/node-ca/0.log" Jul 14 11:15:51.034815 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:51.034776 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-hm8z5" event={"ID":"7cf95c4a-d389-4f2a-ae5c-7bf3902acc51","Type":"ContainerStarted","Data":"373437ba37af635d5c1e5af6c6c231ee0c44d3dab47d6f2f877d31132ed5e665"} Jul 14 11:15:51.035263 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:51.034831 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-hm8z5" event={"ID":"7cf95c4a-d389-4f2a-ae5c-7bf3902acc51","Type":"ContainerStarted","Data":"542d1054d17f730850ca20371c96060953bf42cb32536660d08e08c11182c99d"} Jul 14 11:15:51.038332 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:51.038311 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:51.038436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:51.038385 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:51.038496 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:51.038455 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:15:51.038548 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:51.038506 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:15:51.038600 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:51.038512 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls podName:2f1a4782-8431-43b5-a631-283f314c86bf nodeName:}" failed. No retries permitted until 2026-07-14 11:15:55.038496715 +0000 UTC m=+273.363861242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2svxb" (UID: "2f1a4782-8431-43b5-a631-283f314c86bf") : secret "insights-runtime-extractor-tls" not found Jul 14 11:15:51.038600 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:51.038584 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm podName:2f1a4782-8431-43b5-a631-283f314c86bf nodeName:}" failed. No retries permitted until 2026-07-14 11:15:55.038564702 +0000 UTC m=+273.363929227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2svxb" (UID: "2f1a4782-8431-43b5-a631-283f314c86bf") : configmap "kube-rbac-proxy" not found Jul 14 11:15:51.039787 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:51.039763 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:51.052680 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:51.052631 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-hm8z5" podStartSLOduration=2.052614493 podStartE2EDuration="2.052614493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:15:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:15:51.052106564 +0000 UTC m=+269.377471098" watchObservedRunningTime="2026-07-14 11:15:51.052614493 +0000 UTC m=+269.377979026" Jul 14 11:15:51.138884 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:51.138842 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dx68k\" (UID: \"266dc7d8-4f90-4cfd-9255-77de3870cebe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" Jul 14 11:15:51.139062 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:51.138919 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rj5j5\" (UID: \"dc7acf92-5cb9-48e3-8901-75e719e72682\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" Jul 14 11:15:51.139530 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:51.139515 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 11:15:51.139603 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:51.139572 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls podName:266dc7d8-4f90-4cfd-9255-77de3870cebe nodeName:}" failed. No retries permitted until 2026-07-14 11:15:59.139554484 +0000 UTC m=+277.464919003 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls") pod "cluster-samples-operator-65db858894-dx68k" (UID: "266dc7d8-4f90-4cfd-9255-77de3870cebe") : secret "samples-operator-tls" not found Jul 14 11:15:51.140886 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:51.140162 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 11:15:51.140886 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:51.140239 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls podName:dc7acf92-5cb9-48e3-8901-75e719e72682 nodeName:}" failed. No retries permitted until 2026-07-14 11:15:59.14022225 +0000 UTC m=+277.465586769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-rj5j5" (UID: "dc7acf92-5cb9-48e3-8901-75e719e72682") : secret "cluster-monitoring-operator-tls" not found Jul 14 11:15:51.141785 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:51.141756 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:51.322067 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:51.321983 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:51.353319 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:51.353295 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pvhm4_16977b8e-7c4e-4d57-b39b-8d4e5f8cf730/serve-healthcheck-canary/0.log" Jul 14 11:15:51.421504 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:51.421467 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:51.574485 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:51.574379 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:52.017566 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:52.017540 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:52.604895 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:52.604864 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:52.997442 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:52.997395 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:53.408287 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:53.408167 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:53.623415 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:53.623383 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:53.743040 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:53.743012 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:15:53.743228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:53.743074 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:15:53.743496 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:53.743479 2561 scope.go:117] "RemoveContainer" containerID="d449f63d14829e58a597617801bc7ef177740ff76d94c71103e83ae6f1de4ffe" Jul 14 11:15:53.743668 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:53.743647 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xvxhc_openshift-console-operator(26b43cc7-353e-42f8-ac60-29fb5bd6c510)\"" pod="openshift-console-operator/console-operator-7866497494-xvxhc" podUID="26b43cc7-353e-42f8-ac60-29fb5bd6c510" Jul 14 11:15:53.754525 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:53.754499 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:54.202832 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:54.202733 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:54.598755 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:54.598726 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:54.915288 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:54.915146 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:55.016573 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:55.016542 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:55.070181 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:55.070151 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:55.076376 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:55.076345 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:55.076487 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:55.076468 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 11:15:55.076552 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:55.076536 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:15:55.076552 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:55.076547 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm podName:2f1a4782-8431-43b5-a631-283f314c86bf nodeName:}" failed. No retries permitted until 2026-07-14 11:16:03.076526236 +0000 UTC m=+281.401890748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2svxb" (UID: "2f1a4782-8431-43b5-a631-283f314c86bf") : configmap "kube-rbac-proxy" not found Jul 14 11:15:55.076669 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:55.076657 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 11:15:55.076719 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:15:55.076709 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls podName:2f1a4782-8431-43b5-a631-283f314c86bf nodeName:}" failed. No retries permitted until 2026-07-14 11:16:03.076694688 +0000 UTC m=+281.402059200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2svxb" (UID: "2f1a4782-8431-43b5-a631-283f314c86bf") : secret "insights-runtime-extractor-tls" not found Jul 14 11:15:55.208601 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:55.208513 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:55.849548 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:55.849512 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:56.198458 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:56.198357 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:56.598650 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:56.598611 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:56.998074 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:56.998035 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:57.399093 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:57.399004 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:57.600934 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:57.600901 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:57.660405 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:57.660329 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:58.210736 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:58.210697 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:58.618494 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:58.618465 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:58.799992 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:58.799958 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:59.115526 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:59.115496 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:59.213262 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:59.213229 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dx68k\" (UID: \"266dc7d8-4f90-4cfd-9255-77de3870cebe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" Jul 14 11:15:59.213421 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:59.213268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rj5j5\" (UID: \"dc7acf92-5cb9-48e3-8901-75e719e72682\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" Jul 14 11:15:59.215694 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:59.215668 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7acf92-5cb9-48e3-8901-75e719e72682-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-rj5j5\" (UID: \"dc7acf92-5cb9-48e3-8901-75e719e72682\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" Jul 14 11:15:59.215814 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:59.215766 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/266dc7d8-4f90-4cfd-9255-77de3870cebe-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dx68k\" (UID: \"266dc7d8-4f90-4cfd-9255-77de3870cebe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" Jul 14 11:15:59.216103 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:59.216086 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:15:59.349267 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:59.349221 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" Jul 14 11:15:59.354244 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:59.354226 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" Jul 14 11:15:59.499475 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:59.499446 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k"] Jul 14 11:15:59.514825 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:59.514791 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5"] Jul 14 11:15:59.521380 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:15:59.521349 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7acf92_5cb9_48e3_8901_75e719e72682.slice/crio-c8f1cc4df2098e42955223ee25b3cd4320c110ffce15636674afc9e8fb6c72eb WatchSource:0}: Error finding container c8f1cc4df2098e42955223ee25b3cd4320c110ffce15636674afc9e8fb6c72eb: Status 404 returned error can't find the container with id c8f1cc4df2098e42955223ee25b3cd4320c110ffce15636674afc9e8fb6c72eb Jul 14 11:15:59.992506 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:15:59.992469 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:00.063360 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:00.063323 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" event={"ID":"266dc7d8-4f90-4cfd-9255-77de3870cebe","Type":"ContainerStarted","Data":"00bd92d77c280fe06301751ad4c01159a9022a08b3eebafc60f93d2f18590e2a"} Jul 14 11:16:00.064437 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:00.064411 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" event={"ID":"dc7acf92-5cb9-48e3-8901-75e719e72682","Type":"ContainerStarted","Data":"c8f1cc4df2098e42955223ee25b3cd4320c110ffce15636674afc9e8fb6c72eb"} Jul 14 11:16:00.204091 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:00.204057 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:00.596549 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:00.596471 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:00.652866 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:00.652835 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:00.806103 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:00.806064 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:01.002742 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:01.002705 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:01.598867 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:01.598830 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:01.793364 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:01.793337 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:02.074918 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:02.074880 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" event={"ID":"266dc7d8-4f90-4cfd-9255-77de3870cebe","Type":"ContainerStarted","Data":"78e94efcdfcd0a5692e05aefc187bb520eaa722bccd932ec1f5f520bdf6495cb"} Jul 14 11:16:02.075427 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:02.074940 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" event={"ID":"266dc7d8-4f90-4cfd-9255-77de3870cebe","Type":"ContainerStarted","Data":"f4fb4bd69cd46a3ab4544535da09e0a291fd0e7dadd783e799e57f65cc59c953"} Jul 14 11:16:02.076398 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:02.076375 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" event={"ID":"dc7acf92-5cb9-48e3-8901-75e719e72682","Type":"ContainerStarted","Data":"f7ba78f4d5584ba716d74ee3ec5f9ce7b3cf5cb09e52160baaeeb553c85fd6e0"} Jul 14 11:16:02.092292 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:02.092239 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dx68k" podStartSLOduration=16.788891049 podStartE2EDuration="19.092223983s" totalImagesPullingTime="2.303332934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:02.091111104 +0000 UTC m=+280.416475661" watchObservedRunningTime="2026-07-14 11:16:02.092223983 +0000 UTC m=+280.417588506" Jul 14 11:16:02.109392 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:02.109301 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" podStartSLOduration=16.783937899 podStartE2EDuration="19.109283743s" totalImagesPullingTime="2.325345844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:02.108633261 +0000 UTC m=+280.433997792" watchObservedRunningTime="2026-07-14 11:16:02.109283743 +0000 UTC m=+280.434648275" Jul 14 11:16:02.171565 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:02.171535 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:02.272085 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:02.272052 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:02.371700 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:02.371612 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:03.098038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:03.098008 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:03.145618 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:03.145577 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:16:03.145788 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:03.145671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:16:03.146148 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:03.146121 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f1a4782-8431-43b5-a631-283f314c86bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:16:03.147896 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:03.147870 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f1a4782-8431-43b5-a631-283f314c86bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2svxb\" (UID: \"2f1a4782-8431-43b5-a631-283f314c86bf\") " pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:16:03.283712 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:03.283672 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2svxb" Jul 14 11:16:03.411873 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:03.411845 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2svxb"] Jul 14 11:16:03.414130 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:16:03.414106 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f1a4782_8431_43b5_a631_283f314c86bf.slice/crio-65929d5a731c39c02b256b87230a41331bab3bcb051a23cab1b32df3b7043424 WatchSource:0}: Error finding container 65929d5a731c39c02b256b87230a41331bab3bcb051a23cab1b32df3b7043424: Status 404 returned error can't find the container with id 65929d5a731c39c02b256b87230a41331bab3bcb051a23cab1b32df3b7043424 Jul 14 11:16:04.085511 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:04.085452 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2svxb" event={"ID":"2f1a4782-8431-43b5-a631-283f314c86bf","Type":"ContainerStarted","Data":"65929d5a731c39c02b256b87230a41331bab3bcb051a23cab1b32df3b7043424"} Jul 14 11:16:04.765166 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:16:04.765049 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" podUID="c128d9fa-7cfe-4caf-aee7-367152ecf337" Jul 14 11:16:04.765166 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:16:04.765074 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gd299" podUID="abf7ad10-3167-4df7-b172-5dfe1082217e" Jul 14 11:16:04.765166 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:16:04.765058 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" podUID="a488e467-3419-45fe-a8e1-8b6707e7752d" Jul 14 11:16:05.088186 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:05.088098 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:16:05.088355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:05.088111 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:16:05.088355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:05.088111 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gd299" Jul 14 11:16:05.298455 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:05.298426 2561 scope.go:117] "RemoveContainer" containerID="d449f63d14829e58a597617801bc7ef177740ff76d94c71103e83ae6f1de4ffe" Jul 14 11:16:07.096608 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:07.096586 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvxhc_26b43cc7-353e-42f8-ac60-29fb5bd6c510/console-operator/1.log" Jul 14 11:16:07.096992 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:07.096681 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xvxhc" event={"ID":"26b43cc7-353e-42f8-ac60-29fb5bd6c510","Type":"ContainerStarted","Data":"e626c95800173b8bbd2a9121b606e4b9890b057524118220c3fc33027ab7eb36"} Jul 14 11:16:07.096992 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:07.096951 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:16:07.098376 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:07.098351 2561 patch_prober.go:28] interesting pod/console-operator-7866497494-xvxhc container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" start-of-body= Jul 14 11:16:07.098470 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:07.098399 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7866497494-xvxhc" podUID="26b43cc7-353e-42f8-ac60-29fb5bd6c510" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" Jul 14 11:16:07.115779 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:07.115726 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-xvxhc" podStartSLOduration=21.561661975 podStartE2EDuration="24.115707052s" totalImagesPullingTime="2.554045077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:07.114141755 +0000 UTC m=+285.439506287" watchObservedRunningTime="2026-07-14 11:16:07.115707052 +0000 UTC m=+285.441071585" Jul 14 11:16:07.948520 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:07.948442 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:08.060698 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.060665 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:08.088935 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.088900 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5bmx6\" (UID: \"c128d9fa-7cfe-4caf-aee7-367152ecf337\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:16:08.089097 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.088939 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:16:08.091498 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.091467 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c128d9fa-7cfe-4caf-aee7-367152ecf337-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-5bmx6\" (UID: \"c128d9fa-7cfe-4caf-aee7-367152ecf337\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:16:08.091592 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.091467 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls\") pod \"image-registry-68d9cb8f98-6nhnb\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:16:08.101736 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.101711 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2svxb" event={"ID":"2f1a4782-8431-43b5-a631-283f314c86bf","Type":"ContainerStarted","Data":"d0a7c748e3e70a207c52017edf6a75fdd03752fc097a5c8cc10cf42ac728d46b"} Jul 14 11:16:08.102016 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.101767 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2svxb" event={"ID":"2f1a4782-8431-43b5-a631-283f314c86bf","Type":"ContainerStarted","Data":"e6a1f2d2909a38c54b291b576b4b003b886d854bebe5515e5ae8efe95859a0b4"} Jul 14 11:16:08.106040 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.106018 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-xvxhc" Jul 14 11:16:08.189603 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.189531 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:16:08.192243 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.192215 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/abf7ad10-3167-4df7-b172-5dfe1082217e-metrics-tls\") pod \"dns-default-gd299\" (UID: \"abf7ad10-3167-4df7-b172-5dfe1082217e\") " pod="openshift-dns/dns-default-gd299" Jul 14 11:16:08.241219 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.241115 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:08.393644 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.393611 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z7n4f\"" Jul 14 11:16:08.393644 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.393639 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9dwb8\"" Jul 14 11:16:08.393886 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.393641 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5tzlr\"" Jul 14 11:16:08.399693 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.399668 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gd299" Jul 14 11:16:08.399821 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.399747 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" Jul 14 11:16:08.399821 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.399770 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:16:08.609006 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.608970 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gd299"] Jul 14 11:16:08.614620 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:16:08.614587 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabf7ad10_3167_4df7_b172_5dfe1082217e.slice/crio-47c3f83712ed7c03efdfc287b3b4b839a909e798f877903f2254cccb7c6824bf WatchSource:0}: Error finding container 47c3f83712ed7c03efdfc287b3b4b839a909e798f877903f2254cccb7c6824bf: Status 404 returned error can't find the container with id 47c3f83712ed7c03efdfc287b3b4b839a909e798f877903f2254cccb7c6824bf Jul 14 11:16:08.644066 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.644033 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68d9cb8f98-6nhnb"] Jul 14 11:16:08.647353 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:16:08.647324 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda488e467_3419_45fe_a8e1_8b6707e7752d.slice/crio-b118a1c7ac5f133f6886a0c79a8ad92a5179f2ada4a8896c5f855a5d7e82a479 WatchSource:0}: Error finding container b118a1c7ac5f133f6886a0c79a8ad92a5179f2ada4a8896c5f855a5d7e82a479: Status 404 returned error can't find the container with id b118a1c7ac5f133f6886a0c79a8ad92a5179f2ada4a8896c5f855a5d7e82a479 Jul 14 11:16:08.650247 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.650177 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-5bmx6"] Jul 14 11:16:08.651846 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.651822 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:08.653539 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:16:08.653517 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc128d9fa_7cfe_4caf_aee7_367152ecf337.slice/crio-56e44bd05f16bb487e7c44acbe2604e46da94bcb9c54fbe68a63cabe7db88dd3 WatchSource:0}: Error finding container 56e44bd05f16bb487e7c44acbe2604e46da94bcb9c54fbe68a63cabe7db88dd3: Status 404 returned error can't find the container with id 56e44bd05f16bb487e7c44acbe2604e46da94bcb9c54fbe68a63cabe7db88dd3 Jul 14 11:16:08.768163 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:08.768078 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:09.010847 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:09.010799 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:09.116284 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:09.115902 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" event={"ID":"a488e467-3419-45fe-a8e1-8b6707e7752d","Type":"ContainerStarted","Data":"eb385a2c4d77c9426b6fc4d520c335ace47ace3a698981788bfcdff5a193b5fe"} Jul 14 11:16:09.116284 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:09.115997 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" event={"ID":"a488e467-3419-45fe-a8e1-8b6707e7752d","Type":"ContainerStarted","Data":"b118a1c7ac5f133f6886a0c79a8ad92a5179f2ada4a8896c5f855a5d7e82a479"} Jul 14 11:16:09.116284 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:09.116048 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:16:09.118782 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:09.118712 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gd299" event={"ID":"abf7ad10-3167-4df7-b172-5dfe1082217e","Type":"ContainerStarted","Data":"47c3f83712ed7c03efdfc287b3b4b839a909e798f877903f2254cccb7c6824bf"} Jul 14 11:16:09.122492 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:09.122431 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" event={"ID":"c128d9fa-7cfe-4caf-aee7-367152ecf337","Type":"ContainerStarted","Data":"56e44bd05f16bb487e7c44acbe2604e46da94bcb9c54fbe68a63cabe7db88dd3"} Jul 14 11:16:09.500981 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:09.500945 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:09.646684 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:09.646608 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:09.798991 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:09.798847 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:10.028161 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:10.028127 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:10.827942 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:10.827903 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:10.928155 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:10.928119 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:12.133471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:12.133435 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gd299" event={"ID":"abf7ad10-3167-4df7-b172-5dfe1082217e","Type":"ContainerStarted","Data":"138ebdfda42987dd274b37548570b4bb55589843a21e6e2dcd7664f9371f8aa9"} Jul 14 11:16:12.133896 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:12.133491 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gd299" event={"ID":"abf7ad10-3167-4df7-b172-5dfe1082217e","Type":"ContainerStarted","Data":"bf429deed587698ce9e222036add62be4c6cc0117f31aa48811793a4820e125c"} Jul 14 11:16:12.133896 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:12.133523 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gd299" Jul 14 11:16:12.134956 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:12.134930 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" event={"ID":"c128d9fa-7cfe-4caf-aee7-367152ecf337","Type":"ContainerStarted","Data":"474cf51c86dba65ee65bd112b4a534a2ce4fbed3c49edf26adf7a286181dd8cd"} Jul 14 11:16:12.136735 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:12.136714 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2svxb" event={"ID":"2f1a4782-8431-43b5-a631-283f314c86bf","Type":"ContainerStarted","Data":"fee2755461cbd5c72582bb4720799b1c6b05199e7d28c8b7076b6fb5b799aa4d"} Jul 14 11:16:12.153679 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:12.153641 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gd299" podStartSLOduration=251.514267185 podStartE2EDuration="4m14.153625462s" totalImagesPullingTime="2.639358277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:11:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:12.152297622 +0000 UTC m=+290.477662154" watchObservedRunningTime="2026-07-14 11:16:12.153625462 +0000 UTC m=+290.478989994" Jul 14 11:16:12.153882 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:12.153863 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" podStartSLOduration=289.153855279 podStartE2EDuration="4m49.153855279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:11:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:09.139618074 +0000 UTC m=+287.464982607" watchObservedRunningTime="2026-07-14 11:16:12.153855279 +0000 UTC m=+290.479219811" Jul 14 11:16:12.168669 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:12.168625 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-5bmx6" podStartSLOduration=271.573395745 podStartE2EDuration="4m34.168609144s" totalImagesPullingTime="2.595213399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:11:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:12.167698766 +0000 UTC m=+290.493063298" watchObservedRunningTime="2026-07-14 11:16:12.168609144 +0000 UTC m=+290.493973678" Jul 14 11:16:12.187388 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:12.187333 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2svxb" podStartSLOduration=17.488034898 podStartE2EDuration="25.187313198s" totalImagesPullingTime="7.6992783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:15:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:12.185798617 +0000 UTC m=+290.511163198" watchObservedRunningTime="2026-07-14 11:16:12.187313198 +0000 UTC m=+290.512677731" Jul 14 11:16:12.262665 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:12.262633 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:12.363568 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:12.363537 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:12.430846 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:12.430755 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:13.033829 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:13.033794 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:15.315704 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:15.315673 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:15.457309 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:15.457274 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:17.517862 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.517832 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:17.739255 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.739199 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:17.810232 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.810138 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-srt42"] Jul 14 11:16:17.815686 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.815662 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:17.822482 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.822459 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7q96l\"" Jul 14 11:16:17.822677 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.822451 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 11:16:17.823048 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.822489 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 14 11:16:17.824521 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.824505 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 14 11:16:17.824906 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.824605 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 14 11:16:17.829317 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.829297 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-srt42"] Jul 14 11:16:17.838344 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.838310 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:17.838724 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.838708 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-prfv7"] Jul 14 11:16:17.841923 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.841904 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:17.846054 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.846036 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 11:16:17.846243 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.846225 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 11:16:17.846472 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.846453 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f9kn4\"" Jul 14 11:16:17.846560 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.846510 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 11:16:17.969355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.969305 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/168511fb-aecd-4b62-9304-8c989d617fe0-node-exporter-wtmp\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:17.969355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.969355 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f8j9\" (UniqueName: \"kubernetes.io/projected/168511fb-aecd-4b62-9304-8c989d617fe0-kube-api-access-7f8j9\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:17.969588 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.969391 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkvxz\" (UniqueName: \"kubernetes.io/projected/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-kube-api-access-pkvxz\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:17.969588 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.969420 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:17.969588 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.969448 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/168511fb-aecd-4b62-9304-8c989d617fe0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:17.969588 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.969474 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/168511fb-aecd-4b62-9304-8c989d617fe0-node-exporter-accelerators-collector-config\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:17.969729 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.969599 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/168511fb-aecd-4b62-9304-8c989d617fe0-sys\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:17.969729 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.969637 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/168511fb-aecd-4b62-9304-8c989d617fe0-node-exporter-textfile\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:17.969729 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.969672 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:17.969729 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.969703 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/168511fb-aecd-4b62-9304-8c989d617fe0-node-exporter-tls\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:17.969870 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.969754 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:17.969870 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.969824 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/168511fb-aecd-4b62-9304-8c989d617fe0-root\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:17.969937 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.969869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:17.969937 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.969894 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/168511fb-aecd-4b62-9304-8c989d617fe0-metrics-client-ca\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:17.969937 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:17.969925 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:18.005730 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.005692 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:18.070729 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.070644 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/168511fb-aecd-4b62-9304-8c989d617fe0-root\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.070729 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.070707 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:18.070919 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.070735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/168511fb-aecd-4b62-9304-8c989d617fe0-metrics-client-ca\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.070919 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.070766 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:18.070919 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.070768 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/168511fb-aecd-4b62-9304-8c989d617fe0-root\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.070919 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.070793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/168511fb-aecd-4b62-9304-8c989d617fe0-node-exporter-wtmp\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.070919 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.070826 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f8j9\" (UniqueName: \"kubernetes.io/projected/168511fb-aecd-4b62-9304-8c989d617fe0-kube-api-access-7f8j9\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.070919 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.070852 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkvxz\" (UniqueName: \"kubernetes.io/projected/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-kube-api-access-pkvxz\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:18.070919 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:16:18.070892 2561 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 14 11:16:18.071297 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:16:18.070960 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-kube-state-metrics-tls podName:a8fa4ac0-b61a-469b-86b1-0b463075cbe3 nodeName:}" failed. No retries permitted until 2026-07-14 11:16:18.570942329 +0000 UTC m=+296.896306846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-srt42" (UID: "a8fa4ac0-b61a-469b-86b1-0b463075cbe3") : secret "kube-state-metrics-tls" not found Jul 14 11:16:18.071372 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.071312 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/168511fb-aecd-4b62-9304-8c989d617fe0-node-exporter-wtmp\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.071372 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.071351 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:18.071478 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.071382 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/168511fb-aecd-4b62-9304-8c989d617fe0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.071478 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.071411 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/168511fb-aecd-4b62-9304-8c989d617fe0-node-exporter-accelerators-collector-config\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.071478 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.071467 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/168511fb-aecd-4b62-9304-8c989d617fe0-sys\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.071630 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.071490 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/168511fb-aecd-4b62-9304-8c989d617fe0-node-exporter-textfile\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.071630 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.071520 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:18.071630 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.071528 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/168511fb-aecd-4b62-9304-8c989d617fe0-metrics-client-ca\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.071630 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.071548 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/168511fb-aecd-4b62-9304-8c989d617fe0-node-exporter-tls\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.071630 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.071556 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:18.071630 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.071576 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:18.071928 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.071917 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:18.072078 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.072056 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/168511fb-aecd-4b62-9304-8c989d617fe0-sys\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.072195 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.072170 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:18.072341 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.072316 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/168511fb-aecd-4b62-9304-8c989d617fe0-node-exporter-accelerators-collector-config\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.072618 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.072599 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/168511fb-aecd-4b62-9304-8c989d617fe0-node-exporter-textfile\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.074416 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.074390 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/168511fb-aecd-4b62-9304-8c989d617fe0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.074516 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.074486 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/168511fb-aecd-4b62-9304-8c989d617fe0-node-exporter-tls\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.074575 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.074516 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:18.082456 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.082426 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkvxz\" (UniqueName: \"kubernetes.io/projected/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-kube-api-access-pkvxz\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:18.083073 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.083055 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f8j9\" (UniqueName: \"kubernetes.io/projected/168511fb-aecd-4b62-9304-8c989d617fe0-kube-api-access-7f8j9\") pod \"node-exporter-prfv7\" (UID: \"168511fb-aecd-4b62-9304-8c989d617fe0\") " pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.132672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.132642 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:18.152723 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.152692 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-prfv7" Jul 14 11:16:18.164954 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:16:18.164929 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168511fb_aecd_4b62_9304_8c989d617fe0.slice/crio-7eb03536015bbc2f02c5beeaa0a8793d4157a9a049a80bf07025b33ca176d4af WatchSource:0}: Error finding container 7eb03536015bbc2f02c5beeaa0a8793d4157a9a049a80bf07025b33ca176d4af: Status 404 returned error can't find the container with id 7eb03536015bbc2f02c5beeaa0a8793d4157a9a049a80bf07025b33ca176d4af Jul 14 11:16:18.234941 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.234895 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:18.336907 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.336814 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:18.574971 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.574929 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:18.577461 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.577437 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8fa4ac0-b61a-469b-86b1-0b463075cbe3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-srt42\" (UID: \"a8fa4ac0-b61a-469b-86b1-0b463075cbe3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:18.717661 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.717584 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:18.728103 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.728074 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" Jul 14 11:16:18.900463 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.900427 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-srt42"] Jul 14 11:16:18.921432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:18.921396 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:19.038528 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.038486 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:19.072600 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:16:19.072573 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8fa4ac0_b61a_469b_86b1_0b463075cbe3.slice/crio-3cc0f09750e29a4b50efec0cb495e63577c09ca74ce724c346532a6891d5ef9a WatchSource:0}: Error finding container 3cc0f09750e29a4b50efec0cb495e63577c09ca74ce724c346532a6891d5ef9a: Status 404 returned error can't find the container with id 3cc0f09750e29a4b50efec0cb495e63577c09ca74ce724c346532a6891d5ef9a Jul 14 11:16:19.159989 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.159953 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" event={"ID":"a8fa4ac0-b61a-469b-86b1-0b463075cbe3","Type":"ContainerStarted","Data":"3cc0f09750e29a4b50efec0cb495e63577c09ca74ce724c346532a6891d5ef9a"} Jul 14 11:16:19.161098 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.161076 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prfv7" event={"ID":"168511fb-aecd-4b62-9304-8c989d617fe0","Type":"ContainerStarted","Data":"7eb03536015bbc2f02c5beeaa0a8793d4157a9a049a80bf07025b33ca176d4af"} Jul 14 11:16:19.190072 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.190049 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 11:16:19.193620 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.193602 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.202305 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.202286 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 14 11:16:19.205714 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.205691 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 14 11:16:19.205839 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.205727 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 14 11:16:19.205839 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.205729 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 14 11:16:19.205839 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.205767 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 14 11:16:19.205971 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.205847 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8rnxw\"" Jul 14 11:16:19.206707 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.206693 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 14 11:16:19.206826 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.206785 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 14 11:16:19.207188 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.207172 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 14 11:16:19.212916 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.212896 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 14 11:16:19.217383 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.217359 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:19.222541 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.222509 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 11:16:19.359024 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.358949 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:19.383097 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.383068 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-config-out\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.383236 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.383101 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.383236 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.383123 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.383236 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.383176 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.383236 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.383230 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-web-config\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.383373 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.383264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.383373 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.383286 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.383431 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.383385 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.383431 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.383420 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.383492 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.383447 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.383492 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.383474 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.383547 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.383501 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.383579 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.383549 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdnth\" (UniqueName: \"kubernetes.io/projected/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-kube-api-access-vdnth\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.484162 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.484120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdnth\" (UniqueName: \"kubernetes.io/projected/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-kube-api-access-vdnth\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.484380 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.484172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-config-out\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.484380 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.484199 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.484380 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.484241 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.484380 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.484271 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.484380 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.484293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-web-config\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.484380 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.484326 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.484380 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.484353 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.484723 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.484427 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.484723 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.484452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.484723 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.484483 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.484723 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.484509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.484723 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.484543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.485555 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.485523 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.485827 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.485803 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.486074 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.486019 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.487650 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.487605 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.488228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.488173 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.488311 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.488262 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.488311 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.488263 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-config-out\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.488446 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.488365 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.488540 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.488514 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.488853 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.488828 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.489077 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.489055 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.489845 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.489830 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-web-config\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.498466 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.498442 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdnth\" (UniqueName: \"kubernetes.io/projected/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-kube-api-access-vdnth\") pod \"alertmanager-main-0\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.503304 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.503277 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:16:19.659222 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:19.659135 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 11:16:19.662690 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:16:19.662662 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89fa1093_a5c5_42f3_8c1b_455e24dbd7c8.slice/crio-9c8e51e73c4e71aea6c9c1af8bcfe0c2c475169785e3a1ba1843860dc90f01c8 WatchSource:0}: Error finding container 9c8e51e73c4e71aea6c9c1af8bcfe0c2c475169785e3a1ba1843860dc90f01c8: Status 404 returned error can't find the container with id 9c8e51e73c4e71aea6c9c1af8bcfe0c2c475169785e3a1ba1843860dc90f01c8 Jul 14 11:16:20.165687 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:20.165652 2561 generic.go:356] "Generic (PLEG): container finished" podID="168511fb-aecd-4b62-9304-8c989d617fe0" containerID="ac0c36c66bbb2249f9fede08b61961d1e0f3b14a0ceadde383cf848f7257bb4c" exitCode=0 Jul 14 11:16:20.165873 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:20.165744 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prfv7" event={"ID":"168511fb-aecd-4b62-9304-8c989d617fe0","Type":"ContainerDied","Data":"ac0c36c66bbb2249f9fede08b61961d1e0f3b14a0ceadde383cf848f7257bb4c"} Jul 14 11:16:20.166939 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:20.166919 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8","Type":"ContainerStarted","Data":"9c8e51e73c4e71aea6c9c1af8bcfe0c2c475169785e3a1ba1843860dc90f01c8"} Jul 14 11:16:20.298837 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:16:20.298801 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hmxjp" podUID="e071bfee-a93c-4c4e-92fa-ee406aced61a" Jul 14 11:16:20.811194 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:20.811150 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:20.914567 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:20.914529 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:21.012100 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:21.012062 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:21.161488 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:21.161457 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:21.171855 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:21.171814 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prfv7" event={"ID":"168511fb-aecd-4b62-9304-8c989d617fe0","Type":"ContainerStarted","Data":"7078cbf7f179a7472779d5fe0b83e0ca5552ec62fec5f236cc6b23fe0fff9f24"} Jul 14 11:16:22.098541 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.098515 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvxhc_26b43cc7-353e-42f8-ac60-29fb5bd6c510/console-operator/1.log" Jul 14 11:16:22.099550 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.099529 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvxhc_26b43cc7-353e-42f8-ac60-29fb5bd6c510/console-operator/1.log" Jul 14 11:16:22.104696 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.104679 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f7fw_9309eb9c-300d-4840-a58f-2c93d2c41bfe/ovn-acl-logging/0.log" Jul 14 11:16:22.105483 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.105458 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f7fw_9309eb9c-300d-4840-a58f-2c93d2c41bfe/ovn-acl-logging/0.log" Jul 14 11:16:22.109162 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.109144 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 11:16:22.141586 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.141560 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gd299" Jul 14 11:16:22.179572 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.179535 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" event={"ID":"a8fa4ac0-b61a-469b-86b1-0b463075cbe3","Type":"ContainerStarted","Data":"8a5a5caca6e8447b2ba38ecc5d9cdcdf7ebd2513c756aa94636327027424c5cb"} Jul 14 11:16:22.179746 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.179604 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" event={"ID":"a8fa4ac0-b61a-469b-86b1-0b463075cbe3","Type":"ContainerStarted","Data":"899c025a984933f525486ff2174cff07f72ddea285afed3a8e39cb4f68813d27"} Jul 14 11:16:22.179746 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.179637 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" event={"ID":"a8fa4ac0-b61a-469b-86b1-0b463075cbe3","Type":"ContainerStarted","Data":"234365e629eb03d88e69da921f4a026ff339f04a21656295244781201c2aa82c"} Jul 14 11:16:22.181992 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.181963 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-prfv7" event={"ID":"168511fb-aecd-4b62-9304-8c989d617fe0","Type":"ContainerStarted","Data":"ecd9642c32c2f8203376cd69d7cf85bffbd2fb5424338cfe1ce6d6c194ab4149"} Jul 14 11:16:22.184269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.184245 2561 generic.go:356] "Generic (PLEG): container finished" podID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerID="6e274dd32888399893be90e12934b51bb1e21cf9a83452a6bfc9c020fe8a23a0" exitCode=0 Jul 14 11:16:22.184385 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.184294 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8","Type":"ContainerDied","Data":"6e274dd32888399893be90e12934b51bb1e21cf9a83452a6bfc9c020fe8a23a0"} Jul 14 11:16:22.185432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.185410 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-594bb87885-fsgds"] Jul 14 11:16:22.202098 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.202048 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-srt42" podStartSLOduration=2.886551878 podStartE2EDuration="5.20203349s" totalImagesPullingTime="2.315481612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:22.201427026 +0000 UTC m=+300.526791560" watchObservedRunningTime="2026-07-14 11:16:22.20203349 +0000 UTC m=+300.527398022" Jul 14 11:16:22.219379 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.219352 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-594bb87885-fsgds"] Jul 14 11:16:22.219379 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.219372 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.223147 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.223080 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 14 11:16:22.224992 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.223899 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 14 11:16:22.224992 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.223962 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-buqgqdg0vsnqq\"" Jul 14 11:16:22.224992 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.224093 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 14 11:16:22.224992 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.224548 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 14 11:16:22.225856 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.225789 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6x7ps\"" Jul 14 11:16:22.255016 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.254966 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-prfv7" podStartSLOduration=4.236909484 podStartE2EDuration="5.254950992s" totalImagesPullingTime="952.156126ms" totalInitContainerRuntime="65.885382ms" isStatefulPod=true podCreationTimestamp="2026-07-14 11:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:22.229067548 +0000 UTC m=+300.554432119" watchObservedRunningTime="2026-07-14 11:16:22.254950992 +0000 UTC m=+300.580315584" Jul 14 11:16:22.407949 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.407764 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6fad3790-890d-4f01-8afe-db4024a5d463-secret-metrics-server-tls\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.407949 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.407802 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqcpg\" (UniqueName: \"kubernetes.io/projected/6fad3790-890d-4f01-8afe-db4024a5d463-kube-api-access-lqcpg\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.407949 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.407870 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6fad3790-890d-4f01-8afe-db4024a5d463-secret-metrics-server-client-certs\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.407949 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.407905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fad3790-890d-4f01-8afe-db4024a5d463-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.407949 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.407931 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6fad3790-890d-4f01-8afe-db4024a5d463-audit-log\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.746775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.407971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6fad3790-890d-4f01-8afe-db4024a5d463-metrics-server-audit-profiles\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.746775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.407993 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fad3790-890d-4f01-8afe-db4024a5d463-client-ca-bundle\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.746775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.509268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6fad3790-890d-4f01-8afe-db4024a5d463-secret-metrics-server-client-certs\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.746775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.509314 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fad3790-890d-4f01-8afe-db4024a5d463-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.746775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.509339 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6fad3790-890d-4f01-8afe-db4024a5d463-audit-log\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.746775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.509376 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6fad3790-890d-4f01-8afe-db4024a5d463-metrics-server-audit-profiles\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.746775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.509396 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fad3790-890d-4f01-8afe-db4024a5d463-client-ca-bundle\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.746775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.509417 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6fad3790-890d-4f01-8afe-db4024a5d463-secret-metrics-server-tls\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.746775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.509443 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqcpg\" (UniqueName: \"kubernetes.io/projected/6fad3790-890d-4f01-8afe-db4024a5d463-kube-api-access-lqcpg\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.746775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.510022 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6fad3790-890d-4f01-8afe-db4024a5d463-audit-log\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.746775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.510094 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fad3790-890d-4f01-8afe-db4024a5d463-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.746775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.510361 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6fad3790-890d-4f01-8afe-db4024a5d463-metrics-server-audit-profiles\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.746775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.511831 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6fad3790-890d-4f01-8afe-db4024a5d463-secret-metrics-server-tls\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.746775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.511963 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6fad3790-890d-4f01-8afe-db4024a5d463-client-ca-bundle\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.746775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.512102 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6fad3790-890d-4f01-8afe-db4024a5d463-secret-metrics-server-client-certs\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.746775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.522279 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:22.747368 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.523375 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqcpg\" (UniqueName: \"kubernetes.io/projected/6fad3790-890d-4f01-8afe-db4024a5d463-kube-api-access-lqcpg\") pod \"metrics-server-594bb87885-fsgds\" (UID: \"6fad3790-890d-4f01-8afe-db4024a5d463\") " pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.747368 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.532081 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:22.747368 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.594661 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:22.747368 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.686922 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-594bb87885-fsgds"] Jul 14 11:16:22.747368 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:16:22.689325 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fad3790_890d_4f01_8afe_db4024a5d463.slice/crio-c251283bcf8a23ed1005751ca8109f26c5f022496f79b74b513693b4ba8fa61c WatchSource:0}: Error finding container c251283bcf8a23ed1005751ca8109f26c5f022496f79b74b513693b4ba8fa61c: Status 404 returned error can't find the container with id c251283bcf8a23ed1005751ca8109f26c5f022496f79b74b513693b4ba8fa61c Jul 14 11:16:22.747368 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:22.714123 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:23.191593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:23.191504 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-594bb87885-fsgds" event={"ID":"6fad3790-890d-4f01-8afe-db4024a5d463","Type":"ContainerStarted","Data":"c251283bcf8a23ed1005751ca8109f26c5f022496f79b74b513693b4ba8fa61c"} Jul 14 11:16:24.037825 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.037782 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:24.044367 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.044333 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:16:24.060528 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.060493 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.063917 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.063891 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 14 11:16:24.064085 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.063997 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 14 11:16:24.064085 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.064032 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 14 11:16:24.064241 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.064097 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 14 11:16:24.064358 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.064341 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 14 11:16:24.064460 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.064384 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-69qgrrksj7aqo\"" Jul 14 11:16:24.064460 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.064445 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-89kws\"" Jul 14 11:16:24.064599 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.064585 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 14 11:16:24.064664 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.064613 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 14 11:16:24.065103 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.064888 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 14 11:16:24.065103 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.064937 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 14 11:16:24.065103 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.064953 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 14 11:16:24.065103 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.064988 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 14 11:16:24.065103 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.064939 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 14 11:16:24.065420 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.065150 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 14 11:16:24.065548 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.065528 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:16:24.066864 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.066843 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 14 11:16:24.130220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.129959 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130007 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130043 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-web-config\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130069 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130132 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130159 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130220 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130199 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbkgg\" (UniqueName: \"kubernetes.io/projected/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-kube-api-access-bbkgg\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130747 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130248 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130747 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130274 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130747 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130346 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130747 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130388 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130747 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130409 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130747 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130747 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130507 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130747 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130551 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130747 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130593 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130747 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130650 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-config\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130747 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130675 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.130747 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.130698 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-config-out\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.231151 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231109 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.231623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231159 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.231623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231192 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.231623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231234 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.231623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231265 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.231623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.231623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-config\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.231623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231368 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.231623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231394 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-config-out\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.231623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231425 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.231623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.231623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231480 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-web-config\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.231623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231505 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.231623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231542 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.231623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.231623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.232451 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231637 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.232451 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231642 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbkgg\" (UniqueName: \"kubernetes.io/projected/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-kube-api-access-bbkgg\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.232451 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231699 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.232451 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231733 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.232451 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.231793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.232451 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.232272 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.232849 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.232816 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.233045 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.233015 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.233119 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.233043 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.235957 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.235300 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.235957 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.235911 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.236127 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.235984 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.237611 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.237109 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.237611 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.237183 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.237611 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.237243 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-config\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.237611 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.237571 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.237611 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.237582 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.237909 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.237743 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.238193 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.238174 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-config-out\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.238358 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.238313 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.238990 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.238972 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.239679 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.239657 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.239772 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.239698 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-web-config\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.246663 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.246640 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbkgg\" (UniqueName: \"kubernetes.io/projected/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-kube-api-access-bbkgg\") pod \"prometheus-k8s-0\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:24.371843 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:24.371761 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:25.129057 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:25.129008 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:16:25.131557 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:16:25.131531 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2d3b6c_2ae1_4b2c_b1d2_aa2422647a59.slice/crio-13bb21af805d3c0357afe752e40a94e88792a84177094336bed031d47fb16fb3 WatchSource:0}: Error finding container 13bb21af805d3c0357afe752e40a94e88792a84177094336bed031d47fb16fb3: Status 404 returned error can't find the container with id 13bb21af805d3c0357afe752e40a94e88792a84177094336bed031d47fb16fb3 Jul 14 11:16:25.202489 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:25.202463 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8","Type":"ContainerStarted","Data":"a9f631cc4318f1646ffcc656840a585a397eb9d2cfc59921664f629a9da3e5b9"} Jul 14 11:16:25.203830 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:25.203808 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-594bb87885-fsgds" event={"ID":"6fad3790-890d-4f01-8afe-db4024a5d463","Type":"ContainerStarted","Data":"b31332e9df8f798a2748b7fca3eaf3223507ee00479b0f1465e978da532e8a36"} Jul 14 11:16:25.205114 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:25.205068 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59","Type":"ContainerStarted","Data":"13bb21af805d3c0357afe752e40a94e88792a84177094336bed031d47fb16fb3"} Jul 14 11:16:25.223658 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:25.223616 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-594bb87885-fsgds" podStartSLOduration=0.927657096 podStartE2EDuration="3.223602111s" totalImagesPullingTime="2.295945015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:25.22241884 +0000 UTC m=+303.547783373" watchObservedRunningTime="2026-07-14 11:16:25.223602111 +0000 UTC m=+303.548966643" Jul 14 11:16:25.671902 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:25.671774 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 11:16:25.825747 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:25.825705 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:26.212323 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:26.212227 2561 generic.go:356] "Generic (PLEG): container finished" podID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerID="d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a" exitCode=0 Jul 14 11:16:26.212488 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:26.212312 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59","Type":"ContainerDied","Data":"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a"} Jul 14 11:16:26.216447 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:26.216418 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8","Type":"ContainerStarted","Data":"28a3ba48641be1f550cfd713525c7e2993e15491e45e7305094ce8ef4ab7e621"} Jul 14 11:16:26.216566 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:26.216512 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8","Type":"ContainerStarted","Data":"9dc0c8026db3e847698aaf13b94b0d7bbd71e6a8ac17254a427e3b1f38e85de6"} Jul 14 11:16:26.216626 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:26.216565 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8","Type":"ContainerStarted","Data":"249cce3182a6ac2ba01663915ef94bdaaf4e3853e9618d5689ab19666b8cc2ca"} Jul 14 11:16:26.216626 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:26.216599 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8","Type":"ContainerStarted","Data":"8a5b6cea199152b53975ab116ac007533da300e8dafecd95a36ca5ce0bd6504d"} Jul 14 11:16:27.224997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:27.224910 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8","Type":"ContainerStarted","Data":"83cae9a4460763afa95224664184f3376d929ad9a7bfdb2f4ada6f2bbdc4f852"} Jul 14 11:16:27.254860 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:27.254804 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.493073621 podStartE2EDuration="8.254785624s" totalImagesPullingTime="5.739361846s" totalInitContainerRuntime="22.350157ms" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:27.252083387 +0000 UTC m=+305.577447920" watchObservedRunningTime="2026-07-14 11:16:27.254785624 +0000 UTC m=+305.580150156" Jul 14 11:16:28.405010 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:28.404974 2561 patch_prober.go:28] interesting pod/image-registry-68d9cb8f98-6nhnb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 11:16:28.405408 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:28.405037 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" podUID="a488e467-3419-45fe-a8e1-8b6707e7752d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 11:16:29.821663 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:29.821576 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:30.130816 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:30.130744 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:16:30.197685 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:30.197652 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:30.240672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:30.240641 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59","Type":"ContainerStarted","Data":"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe"} Jul 14 11:16:30.240804 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:30.240729 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59","Type":"ContainerStarted","Data":"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28"} Jul 14 11:16:30.295054 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:30.295004 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:30.445117 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:30.445018 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:30.516503 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:30.516467 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:31.268601 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:31.268564 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:31.297627 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:31.297587 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:16:31.322188 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:31.322153 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:32.199054 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:32.199022 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68d9cb8f98-6nhnb"] Jul 14 11:16:32.251812 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:32.251775 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59","Type":"ContainerStarted","Data":"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc"} Jul 14 11:16:32.251948 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:32.251835 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59","Type":"ContainerStarted","Data":"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32"} Jul 14 11:16:32.251948 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:32.251861 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59","Type":"ContainerStarted","Data":"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3"} Jul 14 11:16:32.251948 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:32.251886 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59","Type":"ContainerStarted","Data":"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb"} Jul 14 11:16:32.282884 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:32.282850 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:32.296229 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:32.296157 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.221401906 podStartE2EDuration="8.29614279s" totalImagesPullingTime="5.047353946s" totalInitContainerRuntime="27.386938ms" isStatefulPod=false podCreationTimestamp="2026-07-14 11:16:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:16:32.295227461 +0000 UTC m=+310.620591983" watchObservedRunningTime="2026-07-14 11:16:32.29614279 +0000 UTC m=+310.621507321" Jul 14 11:16:32.393496 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:32.393465 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:34.372528 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:34.372497 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:16:35.107303 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:35.107267 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:35.164977 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:35.164941 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:41.839617 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:41.839574 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:41.940423 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:41.940390 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:42.533101 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:42.533066 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:42.533279 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:42.533126 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:16:43.029933 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:43.029894 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:43.130190 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:43.130156 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:45.231415 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:45.231384 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:45.291447 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:45.291412 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:46.029100 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:46.029066 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:46.087196 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:46.087160 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:49.313928 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:49.313888 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:49.419914 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:49.419869 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:54.292681 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:54.292646 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:54.351907 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:54.351869 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:16:57.219876 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.219813 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" podUID="a488e467-3419-45fe-a8e1-8b6707e7752d" containerName="registry" containerID="cri-o://eb385a2c4d77c9426b6fc4d520c335ace47ace3a698981788bfcdff5a193b5fe" gracePeriod=30 Jul 14 11:16:57.349945 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.349914 2561 generic.go:356] "Generic (PLEG): container finished" podID="a488e467-3419-45fe-a8e1-8b6707e7752d" containerID="eb385a2c4d77c9426b6fc4d520c335ace47ace3a698981788bfcdff5a193b5fe" exitCode=0 Jul 14 11:16:57.350091 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.349995 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" event={"ID":"a488e467-3419-45fe-a8e1-8b6707e7752d","Type":"ContainerDied","Data":"eb385a2c4d77c9426b6fc4d520c335ace47ace3a698981788bfcdff5a193b5fe"} Jul 14 11:16:57.472327 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.472253 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:16:57.649151 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.649118 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls\") pod \"a488e467-3419-45fe-a8e1-8b6707e7752d\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " Jul 14 11:16:57.649366 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.649176 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-certificates\") pod \"a488e467-3419-45fe-a8e1-8b6707e7752d\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " Jul 14 11:16:57.649366 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.649238 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6svgs\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-kube-api-access-6svgs\") pod \"a488e467-3419-45fe-a8e1-8b6707e7752d\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " Jul 14 11:16:57.649366 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.649265 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a488e467-3419-45fe-a8e1-8b6707e7752d-trusted-ca\") pod \"a488e467-3419-45fe-a8e1-8b6707e7752d\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " Jul 14 11:16:57.649366 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.649297 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a488e467-3419-45fe-a8e1-8b6707e7752d-image-registry-private-configuration\") pod \"a488e467-3419-45fe-a8e1-8b6707e7752d\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " Jul 14 11:16:57.649576 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.649391 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a488e467-3419-45fe-a8e1-8b6707e7752d-ca-trust-extracted\") pod \"a488e467-3419-45fe-a8e1-8b6707e7752d\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " Jul 14 11:16:57.649576 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.649443 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a488e467-3419-45fe-a8e1-8b6707e7752d-installation-pull-secrets\") pod \"a488e467-3419-45fe-a8e1-8b6707e7752d\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " Jul 14 11:16:57.649576 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.649477 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-bound-sa-token\") pod \"a488e467-3419-45fe-a8e1-8b6707e7752d\" (UID: \"a488e467-3419-45fe-a8e1-8b6707e7752d\") " Jul 14 11:16:57.649735 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.649614 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a488e467-3419-45fe-a8e1-8b6707e7752d" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:16:57.650155 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.649799 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-certificates\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:16:57.650155 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.650068 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a488e467-3419-45fe-a8e1-8b6707e7752d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a488e467-3419-45fe-a8e1-8b6707e7752d" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:16:57.651888 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.651863 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a488e467-3419-45fe-a8e1-8b6707e7752d" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:16:57.652051 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.652011 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-kube-api-access-6svgs" (OuterVolumeSpecName: "kube-api-access-6svgs") pod "a488e467-3419-45fe-a8e1-8b6707e7752d" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d"). InnerVolumeSpecName "kube-api-access-6svgs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:16:57.652131 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.652063 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a488e467-3419-45fe-a8e1-8b6707e7752d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a488e467-3419-45fe-a8e1-8b6707e7752d" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:16:57.652189 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.652171 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a488e467-3419-45fe-a8e1-8b6707e7752d" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:16:57.652311 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.652285 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a488e467-3419-45fe-a8e1-8b6707e7752d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a488e467-3419-45fe-a8e1-8b6707e7752d" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:16:57.657909 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.657884 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a488e467-3419-45fe-a8e1-8b6707e7752d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a488e467-3419-45fe-a8e1-8b6707e7752d" (UID: "a488e467-3419-45fe-a8e1-8b6707e7752d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:16:57.750421 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.750391 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6svgs\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-kube-api-access-6svgs\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:16:57.750421 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.750420 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a488e467-3419-45fe-a8e1-8b6707e7752d-trusted-ca\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:16:57.750610 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.750430 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a488e467-3419-45fe-a8e1-8b6707e7752d-image-registry-private-configuration\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:16:57.750610 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.750439 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a488e467-3419-45fe-a8e1-8b6707e7752d-ca-trust-extracted\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:16:57.750610 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.750448 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a488e467-3419-45fe-a8e1-8b6707e7752d-installation-pull-secrets\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:16:57.750610 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.750456 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-bound-sa-token\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:16:57.750610 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:57.750464 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a488e467-3419-45fe-a8e1-8b6707e7752d-registry-tls\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:16:58.355485 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:58.355453 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" Jul 14 11:16:58.355890 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:58.355484 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68d9cb8f98-6nhnb" event={"ID":"a488e467-3419-45fe-a8e1-8b6707e7752d","Type":"ContainerDied","Data":"b118a1c7ac5f133f6886a0c79a8ad92a5179f2ada4a8896c5f855a5d7e82a479"} Jul 14 11:16:58.355890 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:58.355543 2561 scope.go:117] "RemoveContainer" containerID="eb385a2c4d77c9426b6fc4d520c335ace47ace3a698981788bfcdff5a193b5fe" Jul 14 11:16:58.378221 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:58.378171 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68d9cb8f98-6nhnb"] Jul 14 11:16:58.384197 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:16:58.384171 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68d9cb8f98-6nhnb"] Jul 14 11:17:00.267854 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:00.267808 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:17:00.305510 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:00.305472 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a488e467-3419-45fe-a8e1-8b6707e7752d" path="/var/lib/kubelet/pods/a488e467-3419-45fe-a8e1-8b6707e7752d/volumes" Jul 14 11:17:00.376073 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:00.376043 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:17:02.372502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:02.372466 2561 generic.go:356] "Generic (PLEG): container finished" podID="b2cf3e52-07c6-449f-9b50-eed99435c099" containerID="b419af3b67be70f76f2ea6f3915dc86c911f9d0fc3d80c1a4520441d05873978" exitCode=0 Jul 14 11:17:02.372502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:02.372506 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j" event={"ID":"b2cf3e52-07c6-449f-9b50-eed99435c099","Type":"ContainerDied","Data":"b419af3b67be70f76f2ea6f3915dc86c911f9d0fc3d80c1a4520441d05873978"} Jul 14 11:17:02.372961 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:02.372803 2561 scope.go:117] "RemoveContainer" containerID="b419af3b67be70f76f2ea6f3915dc86c911f9d0fc3d80c1a4520441d05873978" Jul 14 11:17:02.537669 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:02.537640 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:17:02.541511 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:02.541484 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-594bb87885-fsgds" Jul 14 11:17:03.378437 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:03.378395 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p8v6j" event={"ID":"b2cf3e52-07c6-449f-9b50-eed99435c099","Type":"ContainerStarted","Data":"979a4559dc6701e3dc3d960ec9f6638292cff07dba9c2ec1e4491c69a6a40cde"} Jul 14 11:17:15.260817 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:15.260731 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:17:15.325922 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:15.325889 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:17:24.372077 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:24.372042 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:24.390159 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:24.390127 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:24.477701 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:24.477673 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:36.294266 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:36.294227 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs\") pod \"network-metrics-daemon-hmxjp\" (UID: \"e071bfee-a93c-4c4e-92fa-ee406aced61a\") " pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:17:36.296490 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:36.296464 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e071bfee-a93c-4c4e-92fa-ee406aced61a-metrics-certs\") pod \"network-metrics-daemon-hmxjp\" (UID: \"e071bfee-a93c-4c4e-92fa-ee406aced61a\") " pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:17:36.402221 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:36.402167 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qblx9\"" Jul 14 11:17:36.409945 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:36.409918 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hmxjp" Jul 14 11:17:36.540311 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:36.540284 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hmxjp"] Jul 14 11:17:36.542913 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:17:36.542866 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode071bfee_a93c_4c4e_92fa_ee406aced61a.slice/crio-4149510dc3a137fb842db5bc7177c9f01c6b37e52405ea75dd13ed3529306197 WatchSource:0}: Error finding container 4149510dc3a137fb842db5bc7177c9f01c6b37e52405ea75dd13ed3529306197: Status 404 returned error can't find the container with id 4149510dc3a137fb842db5bc7177c9f01c6b37e52405ea75dd13ed3529306197 Jul 14 11:17:37.515278 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:37.515241 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hmxjp" event={"ID":"e071bfee-a93c-4c4e-92fa-ee406aced61a","Type":"ContainerStarted","Data":"4149510dc3a137fb842db5bc7177c9f01c6b37e52405ea75dd13ed3529306197"} Jul 14 11:17:37.517485 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:37.517464 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-rj5j5_dc7acf92-5cb9-48e3-8901-75e719e72682/cluster-monitoring-operator/0.log" Jul 14 11:17:37.517610 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:37.517506 2561 generic.go:356] "Generic (PLEG): container finished" podID="dc7acf92-5cb9-48e3-8901-75e719e72682" containerID="f7ba78f4d5584ba716d74ee3ec5f9ce7b3cf5cb09e52160baaeeb553c85fd6e0" exitCode=2 Jul 14 11:17:37.517690 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:37.517605 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" event={"ID":"dc7acf92-5cb9-48e3-8901-75e719e72682","Type":"ContainerDied","Data":"f7ba78f4d5584ba716d74ee3ec5f9ce7b3cf5cb09e52160baaeeb553c85fd6e0"} Jul 14 11:17:37.518010 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:37.517992 2561 scope.go:117] "RemoveContainer" containerID="f7ba78f4d5584ba716d74ee3ec5f9ce7b3cf5cb09e52160baaeeb553c85fd6e0" Jul 14 11:17:38.523178 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:38.523139 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hmxjp" event={"ID":"e071bfee-a93c-4c4e-92fa-ee406aced61a","Type":"ContainerStarted","Data":"b09b80100ee23916a1010d82f501f60fef750e31032a696187282eb84436590c"} Jul 14 11:17:38.523646 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:38.523218 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hmxjp" event={"ID":"e071bfee-a93c-4c4e-92fa-ee406aced61a","Type":"ContainerStarted","Data":"65b39eda113743dbf2c10b6cf9f56bebc259c2eeeb83728f4e93b6a6bcd56bf2"} Jul 14 11:17:38.525025 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:38.525006 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-rj5j5_dc7acf92-5cb9-48e3-8901-75e719e72682/cluster-monitoring-operator/0.log" Jul 14 11:17:38.525125 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:38.525055 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-rj5j5" event={"ID":"dc7acf92-5cb9-48e3-8901-75e719e72682","Type":"ContainerStarted","Data":"680805a9cfb91ec70ceb1488453a61b8ef6789be3a490ef2e93f61264927b2f6"} Jul 14 11:17:38.543795 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:38.543748 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hmxjp" podStartSLOduration=375.605227907 podStartE2EDuration="6m16.543732403s" totalImagesPullingTime="938.504496ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:17:38.542336712 +0000 UTC m=+376.867701280" watchObservedRunningTime="2026-07-14 11:17:38.543732403 +0000 UTC m=+376.869096935" Jul 14 11:17:38.693369 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:38.693325 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:17:38.792318 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:38.792240 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:17:39.632270 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:39.632233 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:17:39.754228 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:39.754180 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:17:41.182180 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:41.182140 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:17:41.388938 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:41.388905 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:17:42.128549 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.128513 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 11:17:42.128802 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.128769 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="alertmanager" containerID="cri-o://a9f631cc4318f1646ffcc656840a585a397eb9d2cfc59921664f629a9da3e5b9" gracePeriod=120 Jul 14 11:17:42.128886 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.128853 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="kube-rbac-proxy-metric" containerID="cri-o://28a3ba48641be1f550cfd713525c7e2993e15491e45e7305094ce8ef4ab7e621" gracePeriod=120 Jul 14 11:17:42.128943 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.128886 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="prom-label-proxy" containerID="cri-o://83cae9a4460763afa95224664184f3376d929ad9a7bfdb2f4ada6f2bbdc4f852" gracePeriod=120 Jul 14 11:17:42.128987 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.128897 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="config-reloader" containerID="cri-o://8a5b6cea199152b53975ab116ac007533da300e8dafecd95a36ca5ce0bd6504d" gracePeriod=120 Jul 14 11:17:42.129040 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.128866 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="kube-rbac-proxy-web" containerID="cri-o://249cce3182a6ac2ba01663915ef94bdaaf4e3853e9618d5689ab19666b8cc2ca" gracePeriod=120 Jul 14 11:17:42.129040 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.128997 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="kube-rbac-proxy" containerID="cri-o://9dc0c8026db3e847698aaf13b94b0d7bbd71e6a8ac17254a427e3b1f38e85de6" gracePeriod=120 Jul 14 11:17:42.543924 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.543887 2561 generic.go:356] "Generic (PLEG): container finished" podID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerID="83cae9a4460763afa95224664184f3376d929ad9a7bfdb2f4ada6f2bbdc4f852" exitCode=0 Jul 14 11:17:42.543924 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.543916 2561 generic.go:356] "Generic (PLEG): container finished" podID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerID="28a3ba48641be1f550cfd713525c7e2993e15491e45e7305094ce8ef4ab7e621" exitCode=0 Jul 14 11:17:42.543924 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.543924 2561 generic.go:356] "Generic (PLEG): container finished" podID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerID="9dc0c8026db3e847698aaf13b94b0d7bbd71e6a8ac17254a427e3b1f38e85de6" exitCode=0 Jul 14 11:17:42.543924 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.543932 2561 generic.go:356] "Generic (PLEG): container finished" podID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerID="8a5b6cea199152b53975ab116ac007533da300e8dafecd95a36ca5ce0bd6504d" exitCode=0 Jul 14 11:17:42.544419 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.543940 2561 generic.go:356] "Generic (PLEG): container finished" podID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerID="a9f631cc4318f1646ffcc656840a585a397eb9d2cfc59921664f629a9da3e5b9" exitCode=0 Jul 14 11:17:42.544419 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.543953 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8","Type":"ContainerDied","Data":"83cae9a4460763afa95224664184f3376d929ad9a7bfdb2f4ada6f2bbdc4f852"} Jul 14 11:17:42.544419 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.544013 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8","Type":"ContainerDied","Data":"28a3ba48641be1f550cfd713525c7e2993e15491e45e7305094ce8ef4ab7e621"} Jul 14 11:17:42.544419 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.544038 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8","Type":"ContainerDied","Data":"9dc0c8026db3e847698aaf13b94b0d7bbd71e6a8ac17254a427e3b1f38e85de6"} Jul 14 11:17:42.544419 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.544063 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8","Type":"ContainerDied","Data":"8a5b6cea199152b53975ab116ac007533da300e8dafecd95a36ca5ce0bd6504d"} Jul 14 11:17:42.544419 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:42.544087 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8","Type":"ContainerDied","Data":"a9f631cc4318f1646ffcc656840a585a397eb9d2cfc59921664f629a9da3e5b9"} Jul 14 11:17:43.377610 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.377583 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:43.454179 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.454148 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-alertmanager-trusted-ca-bundle\") pod \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " Jul 14 11:17:43.454355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.454186 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " Jul 14 11:17:43.454355 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.454249 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-config-out\") pod \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " Jul 14 11:17:43.454488 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.454460 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdnth\" (UniqueName: \"kubernetes.io/projected/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-kube-api-access-vdnth\") pod \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " Jul 14 11:17:43.454546 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.454517 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-main-tls\") pod \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " Jul 14 11:17:43.454607 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.454549 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-config-volume\") pod \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " Jul 14 11:17:43.454607 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.454558 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" (UID: "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:17:43.454607 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.454586 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy\") pod \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " Jul 14 11:17:43.454816 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.454634 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-tls-assets\") pod \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " Jul 14 11:17:43.454816 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.454658 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-metrics-client-ca\") pod \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " Jul 14 11:17:43.454816 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.454690 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-web-config\") pod \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " Jul 14 11:17:43.454816 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.454727 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-alertmanager-main-db\") pod \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " Jul 14 11:17:43.454816 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.454760 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " Jul 14 11:17:43.455065 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.455051 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:43.455297 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.455270 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" (UID: "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:17:43.455877 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.455831 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" (UID: "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:17:43.457409 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.457356 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" (UID: "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:43.457633 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.457599 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-config-out" (OuterVolumeSpecName: "config-out") pod "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" (UID: "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:17:43.457735 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.457671 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-kube-api-access-vdnth" (OuterVolumeSpecName: "kube-api-access-vdnth") pod "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" (UID: "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8"). InnerVolumeSpecName "kube-api-access-vdnth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:17:43.457950 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.457928 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" (UID: "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:43.458052 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.457951 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-config-volume" (OuterVolumeSpecName: "config-volume") pod "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" (UID: "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:43.458107 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.458041 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" (UID: "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:17:43.459264 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.459172 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" (UID: "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:43.459350 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.459288 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" (UID: "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:43.468603 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.468556 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-web-config" (OuterVolumeSpecName: "web-config") pod "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" (UID: "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:43.550439 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.550401 2561 generic.go:356] "Generic (PLEG): container finished" podID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerID="249cce3182a6ac2ba01663915ef94bdaaf4e3853e9618d5689ab19666b8cc2ca" exitCode=0 Jul 14 11:17:43.550894 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.550471 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:43.550894 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.550476 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8","Type":"ContainerDied","Data":"249cce3182a6ac2ba01663915ef94bdaaf4e3853e9618d5689ab19666b8cc2ca"} Jul 14 11:17:43.550894 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.550599 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8","Type":"ContainerDied","Data":"9c8e51e73c4e71aea6c9c1af8bcfe0c2c475169785e3a1ba1843860dc90f01c8"} Jul 14 11:17:43.550894 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.550647 2561 scope.go:117] "RemoveContainer" containerID="83cae9a4460763afa95224664184f3376d929ad9a7bfdb2f4ada6f2bbdc4f852" Jul 14 11:17:43.555358 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.555329 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-cluster-tls-config\") pod \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\" (UID: \"89fa1093-a5c5-42f3-8c1b-455e24dbd7c8\") " Jul 14 11:17:43.555508 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.555492 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:43.555571 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.555513 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-tls-assets\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:43.555571 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.555528 2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-metrics-client-ca\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:43.555571 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.555541 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-web-config\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:43.555571 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.555554 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-alertmanager-main-db\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:43.555571 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.555568 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:43.555796 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.555582 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:43.555796 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.555596 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-config-out\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:43.555796 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.555610 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdnth\" (UniqueName: \"kubernetes.io/projected/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-kube-api-access-vdnth\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:43.555796 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.555623 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-secret-alertmanager-main-tls\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:43.555796 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.555637 2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-config-volume\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:43.558379 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.558361 2561 scope.go:117] "RemoveContainer" containerID="28a3ba48641be1f550cfd713525c7e2993e15491e45e7305094ce8ef4ab7e621" Jul 14 11:17:43.560931 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.560905 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" (UID: "89fa1093-a5c5-42f3-8c1b-455e24dbd7c8"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:43.565105 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.565080 2561 scope.go:117] "RemoveContainer" containerID="9dc0c8026db3e847698aaf13b94b0d7bbd71e6a8ac17254a427e3b1f38e85de6" Jul 14 11:17:43.571730 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.571712 2561 scope.go:117] "RemoveContainer" containerID="249cce3182a6ac2ba01663915ef94bdaaf4e3853e9618d5689ab19666b8cc2ca" Jul 14 11:17:43.578259 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.578238 2561 scope.go:117] "RemoveContainer" containerID="8a5b6cea199152b53975ab116ac007533da300e8dafecd95a36ca5ce0bd6504d" Jul 14 11:17:43.585010 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.584992 2561 scope.go:117] "RemoveContainer" containerID="a9f631cc4318f1646ffcc656840a585a397eb9d2cfc59921664f629a9da3e5b9" Jul 14 11:17:43.591997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.591980 2561 scope.go:117] "RemoveContainer" containerID="6e274dd32888399893be90e12934b51bb1e21cf9a83452a6bfc9c020fe8a23a0" Jul 14 11:17:43.598791 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.598774 2561 scope.go:117] "RemoveContainer" containerID="83cae9a4460763afa95224664184f3376d929ad9a7bfdb2f4ada6f2bbdc4f852" Jul 14 11:17:43.599051 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:17:43.599030 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83cae9a4460763afa95224664184f3376d929ad9a7bfdb2f4ada6f2bbdc4f852\": container with ID starting with 83cae9a4460763afa95224664184f3376d929ad9a7bfdb2f4ada6f2bbdc4f852 not found: ID does not exist" containerID="83cae9a4460763afa95224664184f3376d929ad9a7bfdb2f4ada6f2bbdc4f852" Jul 14 11:17:43.599112 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.599065 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83cae9a4460763afa95224664184f3376d929ad9a7bfdb2f4ada6f2bbdc4f852"} err="failed to get container status \"83cae9a4460763afa95224664184f3376d929ad9a7bfdb2f4ada6f2bbdc4f852\": rpc error: code = NotFound desc = could not find container \"83cae9a4460763afa95224664184f3376d929ad9a7bfdb2f4ada6f2bbdc4f852\": container with ID starting with 83cae9a4460763afa95224664184f3376d929ad9a7bfdb2f4ada6f2bbdc4f852 not found: ID does not exist" Jul 14 11:17:43.599112 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.599099 2561 scope.go:117] "RemoveContainer" containerID="28a3ba48641be1f550cfd713525c7e2993e15491e45e7305094ce8ef4ab7e621" Jul 14 11:17:43.599361 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:17:43.599344 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28a3ba48641be1f550cfd713525c7e2993e15491e45e7305094ce8ef4ab7e621\": container with ID starting with 28a3ba48641be1f550cfd713525c7e2993e15491e45e7305094ce8ef4ab7e621 not found: ID does not exist" containerID="28a3ba48641be1f550cfd713525c7e2993e15491e45e7305094ce8ef4ab7e621" Jul 14 11:17:43.599406 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.599366 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a3ba48641be1f550cfd713525c7e2993e15491e45e7305094ce8ef4ab7e621"} err="failed to get container status \"28a3ba48641be1f550cfd713525c7e2993e15491e45e7305094ce8ef4ab7e621\": rpc error: code = NotFound desc = could not find container \"28a3ba48641be1f550cfd713525c7e2993e15491e45e7305094ce8ef4ab7e621\": container with ID starting with 28a3ba48641be1f550cfd713525c7e2993e15491e45e7305094ce8ef4ab7e621 not found: ID does not exist" Jul 14 11:17:43.599406 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.599381 2561 scope.go:117] "RemoveContainer" containerID="9dc0c8026db3e847698aaf13b94b0d7bbd71e6a8ac17254a427e3b1f38e85de6" Jul 14 11:17:43.599644 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:17:43.599628 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dc0c8026db3e847698aaf13b94b0d7bbd71e6a8ac17254a427e3b1f38e85de6\": container with ID starting with 9dc0c8026db3e847698aaf13b94b0d7bbd71e6a8ac17254a427e3b1f38e85de6 not found: ID does not exist" containerID="9dc0c8026db3e847698aaf13b94b0d7bbd71e6a8ac17254a427e3b1f38e85de6" Jul 14 11:17:43.599685 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.599650 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dc0c8026db3e847698aaf13b94b0d7bbd71e6a8ac17254a427e3b1f38e85de6"} err="failed to get container status \"9dc0c8026db3e847698aaf13b94b0d7bbd71e6a8ac17254a427e3b1f38e85de6\": rpc error: code = NotFound desc = could not find container \"9dc0c8026db3e847698aaf13b94b0d7bbd71e6a8ac17254a427e3b1f38e85de6\": container with ID starting with 9dc0c8026db3e847698aaf13b94b0d7bbd71e6a8ac17254a427e3b1f38e85de6 not found: ID does not exist" Jul 14 11:17:43.599685 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.599664 2561 scope.go:117] "RemoveContainer" containerID="249cce3182a6ac2ba01663915ef94bdaaf4e3853e9618d5689ab19666b8cc2ca" Jul 14 11:17:43.599858 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:17:43.599843 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"249cce3182a6ac2ba01663915ef94bdaaf4e3853e9618d5689ab19666b8cc2ca\": container with ID starting with 249cce3182a6ac2ba01663915ef94bdaaf4e3853e9618d5689ab19666b8cc2ca not found: ID does not exist" containerID="249cce3182a6ac2ba01663915ef94bdaaf4e3853e9618d5689ab19666b8cc2ca" Jul 14 11:17:43.599931 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.599867 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"249cce3182a6ac2ba01663915ef94bdaaf4e3853e9618d5689ab19666b8cc2ca"} err="failed to get container status \"249cce3182a6ac2ba01663915ef94bdaaf4e3853e9618d5689ab19666b8cc2ca\": rpc error: code = NotFound desc = could not find container \"249cce3182a6ac2ba01663915ef94bdaaf4e3853e9618d5689ab19666b8cc2ca\": container with ID starting with 249cce3182a6ac2ba01663915ef94bdaaf4e3853e9618d5689ab19666b8cc2ca not found: ID does not exist" Jul 14 11:17:43.599931 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.599882 2561 scope.go:117] "RemoveContainer" containerID="8a5b6cea199152b53975ab116ac007533da300e8dafecd95a36ca5ce0bd6504d" Jul 14 11:17:43.600099 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:17:43.600083 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a5b6cea199152b53975ab116ac007533da300e8dafecd95a36ca5ce0bd6504d\": container with ID starting with 8a5b6cea199152b53975ab116ac007533da300e8dafecd95a36ca5ce0bd6504d not found: ID does not exist" containerID="8a5b6cea199152b53975ab116ac007533da300e8dafecd95a36ca5ce0bd6504d" Jul 14 11:17:43.600137 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.600103 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a5b6cea199152b53975ab116ac007533da300e8dafecd95a36ca5ce0bd6504d"} err="failed to get container status \"8a5b6cea199152b53975ab116ac007533da300e8dafecd95a36ca5ce0bd6504d\": rpc error: code = NotFound desc = could not find container \"8a5b6cea199152b53975ab116ac007533da300e8dafecd95a36ca5ce0bd6504d\": container with ID starting with 8a5b6cea199152b53975ab116ac007533da300e8dafecd95a36ca5ce0bd6504d not found: ID does not exist" Jul 14 11:17:43.600137 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.600118 2561 scope.go:117] "RemoveContainer" containerID="a9f631cc4318f1646ffcc656840a585a397eb9d2cfc59921664f629a9da3e5b9" Jul 14 11:17:43.600371 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:17:43.600352 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9f631cc4318f1646ffcc656840a585a397eb9d2cfc59921664f629a9da3e5b9\": container with ID starting with a9f631cc4318f1646ffcc656840a585a397eb9d2cfc59921664f629a9da3e5b9 not found: ID does not exist" containerID="a9f631cc4318f1646ffcc656840a585a397eb9d2cfc59921664f629a9da3e5b9" Jul 14 11:17:43.600420 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.600380 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9f631cc4318f1646ffcc656840a585a397eb9d2cfc59921664f629a9da3e5b9"} err="failed to get container status \"a9f631cc4318f1646ffcc656840a585a397eb9d2cfc59921664f629a9da3e5b9\": rpc error: code = NotFound desc = could not find container \"a9f631cc4318f1646ffcc656840a585a397eb9d2cfc59921664f629a9da3e5b9\": container with ID starting with a9f631cc4318f1646ffcc656840a585a397eb9d2cfc59921664f629a9da3e5b9 not found: ID does not exist" Jul 14 11:17:43.600420 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.600399 2561 scope.go:117] "RemoveContainer" containerID="6e274dd32888399893be90e12934b51bb1e21cf9a83452a6bfc9c020fe8a23a0" Jul 14 11:17:43.600647 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:17:43.600631 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e274dd32888399893be90e12934b51bb1e21cf9a83452a6bfc9c020fe8a23a0\": container with ID starting with 6e274dd32888399893be90e12934b51bb1e21cf9a83452a6bfc9c020fe8a23a0 not found: ID does not exist" containerID="6e274dd32888399893be90e12934b51bb1e21cf9a83452a6bfc9c020fe8a23a0" Jul 14 11:17:43.600712 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.600650 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e274dd32888399893be90e12934b51bb1e21cf9a83452a6bfc9c020fe8a23a0"} err="failed to get container status \"6e274dd32888399893be90e12934b51bb1e21cf9a83452a6bfc9c020fe8a23a0\": rpc error: code = NotFound desc = could not find container \"6e274dd32888399893be90e12934b51bb1e21cf9a83452a6bfc9c020fe8a23a0\": container with ID starting with 6e274dd32888399893be90e12934b51bb1e21cf9a83452a6bfc9c020fe8a23a0 not found: ID does not exist" Jul 14 11:17:43.656107 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.656062 2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8-cluster-tls-config\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:43.875001 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.874871 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 11:17:43.879660 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.879634 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 11:17:43.907713 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.907682 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 11:17:43.907984 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.907972 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="init-config-reloader" Jul 14 11:17:43.908026 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.907985 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="init-config-reloader" Jul 14 11:17:43.908026 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.907996 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="prom-label-proxy" Jul 14 11:17:43.908026 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908002 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="prom-label-proxy" Jul 14 11:17:43.908026 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908011 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="alertmanager" Jul 14 11:17:43.908026 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908017 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="alertmanager" Jul 14 11:17:43.908026 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908023 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="kube-rbac-proxy-metric" Jul 14 11:17:43.908026 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908028 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="kube-rbac-proxy-metric" Jul 14 11:17:43.908245 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908040 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a488e467-3419-45fe-a8e1-8b6707e7752d" containerName="registry" Jul 14 11:17:43.908245 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908045 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a488e467-3419-45fe-a8e1-8b6707e7752d" containerName="registry" Jul 14 11:17:43.908245 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908051 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="kube-rbac-proxy" Jul 14 11:17:43.908245 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908056 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="kube-rbac-proxy" Jul 14 11:17:43.908245 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908063 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="config-reloader" Jul 14 11:17:43.908245 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908068 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="config-reloader" Jul 14 11:17:43.908245 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908074 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="kube-rbac-proxy-web" Jul 14 11:17:43.908245 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908080 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="kube-rbac-proxy-web" Jul 14 11:17:43.908245 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908121 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="kube-rbac-proxy" Jul 14 11:17:43.908245 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908130 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="prom-label-proxy" Jul 14 11:17:43.908245 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908137 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="alertmanager" Jul 14 11:17:43.908245 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908145 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a488e467-3419-45fe-a8e1-8b6707e7752d" containerName="registry" Jul 14 11:17:43.908245 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908150 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="kube-rbac-proxy-web" Jul 14 11:17:43.908245 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908157 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="config-reloader" Jul 14 11:17:43.908245 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.908162 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" containerName="kube-rbac-proxy-metric" Jul 14 11:17:43.913419 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.913399 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:43.916436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.916416 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 14 11:17:43.916549 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.916470 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 14 11:17:43.916549 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.916414 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 14 11:17:43.916549 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.916509 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 14 11:17:43.916731 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.916566 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8rnxw\"" Jul 14 11:17:43.916787 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.916774 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 14 11:17:43.916886 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.916864 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 14 11:17:43.916970 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.916956 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 14 11:17:43.917004 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.916970 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 14 11:17:43.922278 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.922259 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 14 11:17:43.927367 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.927345 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 11:17:43.957803 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.957770 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-web-config\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:43.957803 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.957804 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1bc5010a-aaec-4244-8fd5-cdcf48636283-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:43.957996 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.957822 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bc5010a-aaec-4244-8fd5-cdcf48636283-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:43.957996 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.957864 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgqdc\" (UniqueName: \"kubernetes.io/projected/1bc5010a-aaec-4244-8fd5-cdcf48636283-kube-api-access-cgqdc\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:43.957996 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.957884 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:43.957996 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.957903 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bc5010a-aaec-4244-8fd5-cdcf48636283-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:43.957996 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.957919 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:43.957996 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.957939 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:43.957996 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.957967 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bc5010a-aaec-4244-8fd5-cdcf48636283-config-out\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:43.958277 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.958014 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-config-volume\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:43.958277 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.958029 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:43.958277 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.958050 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bc5010a-aaec-4244-8fd5-cdcf48636283-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:43.958277 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:43.958066 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.059325 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.059294 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bc5010a-aaec-4244-8fd5-cdcf48636283-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.059325 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.059325 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.059506 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.059347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-web-config\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.059552 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.059533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1bc5010a-aaec-4244-8fd5-cdcf48636283-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.059651 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.059566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bc5010a-aaec-4244-8fd5-cdcf48636283-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.059651 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.059597 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgqdc\" (UniqueName: \"kubernetes.io/projected/1bc5010a-aaec-4244-8fd5-cdcf48636283-kube-api-access-cgqdc\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.059651 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.059627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.059804 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.059662 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bc5010a-aaec-4244-8fd5-cdcf48636283-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.059804 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.059689 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.059804 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.059721 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.059804 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.059761 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bc5010a-aaec-4244-8fd5-cdcf48636283-config-out\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.060005 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.059859 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-config-volume\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.060005 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.059888 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.060005 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.059956 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1bc5010a-aaec-4244-8fd5-cdcf48636283-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.060320 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.060290 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bc5010a-aaec-4244-8fd5-cdcf48636283-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.060831 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.060512 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bc5010a-aaec-4244-8fd5-cdcf48636283-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.062436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.062411 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.062520 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.062445 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-web-config\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.062595 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.062565 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bc5010a-aaec-4244-8fd5-cdcf48636283-config-out\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.062657 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.062606 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.062727 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.062708 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.062832 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.062812 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.063051 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.063031 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-config-volume\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.063279 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.063263 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1bc5010a-aaec-4244-8fd5-cdcf48636283-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.064269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.064250 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bc5010a-aaec-4244-8fd5-cdcf48636283-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.068295 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.068277 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgqdc\" (UniqueName: \"kubernetes.io/projected/1bc5010a-aaec-4244-8fd5-cdcf48636283-kube-api-access-cgqdc\") pod \"alertmanager-main-0\" (UID: \"1bc5010a-aaec-4244-8fd5-cdcf48636283\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.222812 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.222729 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 11:17:44.303125 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.303090 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89fa1093-a5c5-42f3-8c1b-455e24dbd7c8" path="/var/lib/kubelet/pods/89fa1093-a5c5-42f3-8c1b-455e24dbd7c8/volumes" Jul 14 11:17:44.367331 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.367304 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 11:17:44.368389 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:17:44.368361 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc5010a_aaec_4244_8fd5_cdcf48636283.slice/crio-9098bc7fa92503c220a1153a32ebb6ebeca368eff4dd548a24e7ef9462fdd708 WatchSource:0}: Error finding container 9098bc7fa92503c220a1153a32ebb6ebeca368eff4dd548a24e7ef9462fdd708: Status 404 returned error can't find the container with id 9098bc7fa92503c220a1153a32ebb6ebeca368eff4dd548a24e7ef9462fdd708 Jul 14 11:17:44.555828 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.555792 2561 generic.go:356] "Generic (PLEG): container finished" podID="1bc5010a-aaec-4244-8fd5-cdcf48636283" containerID="6d8b1b7cc7328006d5288269d9125da565c69f8dd573997ee3ce16260c6a0c8b" exitCode=0 Jul 14 11:17:44.556259 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.555880 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bc5010a-aaec-4244-8fd5-cdcf48636283","Type":"ContainerDied","Data":"6d8b1b7cc7328006d5288269d9125da565c69f8dd573997ee3ce16260c6a0c8b"} Jul 14 11:17:44.556259 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:44.555951 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bc5010a-aaec-4244-8fd5-cdcf48636283","Type":"ContainerStarted","Data":"9098bc7fa92503c220a1153a32ebb6ebeca368eff4dd548a24e7ef9462fdd708"} Jul 14 11:17:45.569982 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:45.569944 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bc5010a-aaec-4244-8fd5-cdcf48636283","Type":"ContainerStarted","Data":"2cec48ae0af73563c5775c4275991a5d32c537386904bc84dbe72c95a2834d04"} Jul 14 11:17:45.570479 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:45.570031 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bc5010a-aaec-4244-8fd5-cdcf48636283","Type":"ContainerStarted","Data":"27a737334b7a51299fcade9dc321e47f83ebcdf07840a8318c14ffbd74a38ade"} Jul 14 11:17:45.570479 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:45.570058 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bc5010a-aaec-4244-8fd5-cdcf48636283","Type":"ContainerStarted","Data":"cbf1981e1441cd069d21c71fe37b38c980c8831f8189714348a9cd60a1b197c2"} Jul 14 11:17:45.570479 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:45.570081 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bc5010a-aaec-4244-8fd5-cdcf48636283","Type":"ContainerStarted","Data":"5d60a4f2eaebaff65aa4635df30203b221a942eadcd2649705a75c759c14f267"} Jul 14 11:17:45.570479 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:45.570102 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bc5010a-aaec-4244-8fd5-cdcf48636283","Type":"ContainerStarted","Data":"1dd5aec446b8a8c6a5dfa85e2d7aa6cb6a7854249af4dfbb2f8792c694638b42"} Jul 14 11:17:45.570479 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:45.570124 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1bc5010a-aaec-4244-8fd5-cdcf48636283","Type":"ContainerStarted","Data":"c6b4de5c356646f5388cd3512ba6de792f0bb45106f00b7b542b5a749cd6f4f5"} Jul 14 11:17:45.605834 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:45.605782 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.590490526 podStartE2EDuration="2.605765397s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.274871ms" isStatefulPod=false podCreationTimestamp="2026-07-14 11:17:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:17:45.602720014 +0000 UTC m=+383.928084537" watchObservedRunningTime="2026-07-14 11:17:45.605765397 +0000 UTC m=+383.931129929" Jul 14 11:17:46.552875 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.552842 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:17:46.553176 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.553138 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="prometheus" containerID="cri-o://27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28" gracePeriod=600 Jul 14 11:17:46.553176 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.553155 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="kube-rbac-proxy" containerID="cri-o://87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32" gracePeriod=600 Jul 14 11:17:46.553400 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.553156 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="thanos-sidecar" containerID="cri-o://e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb" gracePeriod=600 Jul 14 11:17:46.553400 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.553252 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc" gracePeriod=600 Jul 14 11:17:46.553400 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.553176 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="config-reloader" containerID="cri-o://bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe" gracePeriod=600 Jul 14 11:17:46.553400 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.553332 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="kube-rbac-proxy-web" containerID="cri-o://17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3" gracePeriod=600 Jul 14 11:17:46.797569 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.797541 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:46.885133 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885052 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-kubelet-serving-ca-bundle\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885133 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885095 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-0\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885133 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885121 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-config-out\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885389 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885163 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885389 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885186 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-metrics-client-ca\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885389 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885263 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-tls\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885389 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885289 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-metrics-client-certs\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885389 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885314 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-2\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885389 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885350 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-thanos-prometheus-http-client-file\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885389 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885376 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-1\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885717 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885401 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-db\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885717 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885428 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-serving-certs-ca-bundle\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885717 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885477 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885717 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885507 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-tls-assets\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885717 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885531 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-grpc-tls\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885717 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885566 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-web-config\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885717 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885592 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbkgg\" (UniqueName: \"kubernetes.io/projected/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-kube-api-access-bbkgg\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885717 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885617 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-trusted-ca-bundle\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885717 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885621 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:17:46.885717 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885639 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-config\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.885717 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885667 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-kube-rbac-proxy\") pod \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\" (UID: \"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59\") " Jul 14 11:17:46.886270 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.885935 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.886652 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.886391 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:17:46.886768 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.886646 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:17:46.887184 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.887154 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:17:46.887692 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.887512 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:17:46.888064 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.887819 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:46.888064 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.887953 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:17:46.888248 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.888077 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:17:46.888485 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.888423 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 11:17:46.888616 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.888592 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:46.889098 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.889066 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:46.889230 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.889175 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:46.889349 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.889302 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:46.889498 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.889474 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-config-out" (OuterVolumeSpecName: "config-out") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 11:17:46.889909 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.889878 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:17:46.890014 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.889906 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-kube-api-access-bbkgg" (OuterVolumeSpecName: "kube-api-access-bbkgg") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "kube-api-access-bbkgg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:17:46.890014 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.889937 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:46.890189 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.890169 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:46.890672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.890655 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-config" (OuterVolumeSpecName: "config") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:46.899814 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.899792 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-web-config" (OuterVolumeSpecName: "web-config") pod "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" (UID: "1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:17:46.987118 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987065 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987118 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987112 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-tls-assets\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987118 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987125 2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-grpc-tls\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987138 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-web-config\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987150 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbkgg\" (UniqueName: \"kubernetes.io/projected/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-kube-api-access-bbkgg\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987164 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987175 2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-config\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987185 2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-kube-rbac-proxy\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987199 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987239 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-config-out\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987251 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987263 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-metrics-client-ca\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987275 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987286 2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-secret-metrics-client-certs\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987297 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987310 2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987321 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987333 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-prometheus-k8s-db\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:46.987432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:46.987346 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:17:47.582254 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.582223 2561 generic.go:356] "Generic (PLEG): container finished" podID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerID="5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc" exitCode=0 Jul 14 11:17:47.582254 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.582247 2561 generic.go:356] "Generic (PLEG): container finished" podID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerID="87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32" exitCode=0 Jul 14 11:17:47.582254 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.582253 2561 generic.go:356] "Generic (PLEG): container finished" podID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerID="17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3" exitCode=0 Jul 14 11:17:47.582254 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.582260 2561 generic.go:356] "Generic (PLEG): container finished" podID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerID="e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb" exitCode=0 Jul 14 11:17:47.582497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.582265 2561 generic.go:356] "Generic (PLEG): container finished" podID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerID="bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe" exitCode=0 Jul 14 11:17:47.582497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.582271 2561 generic.go:356] "Generic (PLEG): container finished" podID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerID="27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28" exitCode=0 Jul 14 11:17:47.582497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.582295 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.582497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.582294 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59","Type":"ContainerDied","Data":"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc"} Jul 14 11:17:47.582497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.582359 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59","Type":"ContainerDied","Data":"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32"} Jul 14 11:17:47.582497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.582387 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59","Type":"ContainerDied","Data":"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3"} Jul 14 11:17:47.582497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.582412 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59","Type":"ContainerDied","Data":"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb"} Jul 14 11:17:47.582497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.582428 2561 scope.go:117] "RemoveContainer" containerID="5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc" Jul 14 11:17:47.582497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.582437 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59","Type":"ContainerDied","Data":"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe"} Jul 14 11:17:47.582497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.582462 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59","Type":"ContainerDied","Data":"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28"} Jul 14 11:17:47.582497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.582486 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59","Type":"ContainerDied","Data":"13bb21af805d3c0357afe752e40a94e88792a84177094336bed031d47fb16fb3"} Jul 14 11:17:47.590425 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.590405 2561 scope.go:117] "RemoveContainer" containerID="87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32" Jul 14 11:17:47.597581 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.597565 2561 scope.go:117] "RemoveContainer" containerID="17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3" Jul 14 11:17:47.604309 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.604290 2561 scope.go:117] "RemoveContainer" containerID="e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb" Jul 14 11:17:47.611247 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.611222 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:17:47.611834 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.611817 2561 scope.go:117] "RemoveContainer" containerID="bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe" Jul 14 11:17:47.615093 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.615072 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:17:47.619294 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.619265 2561 scope.go:117] "RemoveContainer" containerID="27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28" Jul 14 11:17:47.626474 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.626457 2561 scope.go:117] "RemoveContainer" containerID="d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a" Jul 14 11:17:47.633140 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.633122 2561 scope.go:117] "RemoveContainer" containerID="5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc" Jul 14 11:17:47.633519 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:17:47.633489 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc\": container with ID starting with 5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc not found: ID does not exist" containerID="5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc" Jul 14 11:17:47.633678 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.633530 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc"} err="failed to get container status \"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc\": rpc error: code = NotFound desc = could not find container \"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc\": container with ID starting with 5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc not found: ID does not exist" Jul 14 11:17:47.633678 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.633560 2561 scope.go:117] "RemoveContainer" containerID="87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32" Jul 14 11:17:47.633857 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:17:47.633836 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32\": container with ID starting with 87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32 not found: ID does not exist" containerID="87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32" Jul 14 11:17:47.633955 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.633861 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32"} err="failed to get container status \"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32\": rpc error: code = NotFound desc = could not find container \"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32\": container with ID starting with 87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32 not found: ID does not exist" Jul 14 11:17:47.633955 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.633882 2561 scope.go:117] "RemoveContainer" containerID="17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3" Jul 14 11:17:47.634254 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:17:47.634229 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3\": container with ID starting with 17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3 not found: ID does not exist" containerID="17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3" Jul 14 11:17:47.634307 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.634264 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3"} err="failed to get container status \"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3\": rpc error: code = NotFound desc = could not find container \"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3\": container with ID starting with 17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3 not found: ID does not exist" Jul 14 11:17:47.634307 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.634285 2561 scope.go:117] "RemoveContainer" containerID="e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb" Jul 14 11:17:47.634561 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:17:47.634537 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb\": container with ID starting with e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb not found: ID does not exist" containerID="e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb" Jul 14 11:17:47.634604 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.634567 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb"} err="failed to get container status \"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb\": rpc error: code = NotFound desc = could not find container \"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb\": container with ID starting with e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb not found: ID does not exist" Jul 14 11:17:47.634604 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.634582 2561 scope.go:117] "RemoveContainer" containerID="bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe" Jul 14 11:17:47.634808 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:17:47.634788 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe\": container with ID starting with bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe not found: ID does not exist" containerID="bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe" Jul 14 11:17:47.634848 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.634813 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe"} err="failed to get container status \"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe\": rpc error: code = NotFound desc = could not find container \"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe\": container with ID starting with bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe not found: ID does not exist" Jul 14 11:17:47.634848 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.634826 2561 scope.go:117] "RemoveContainer" containerID="27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28" Jul 14 11:17:47.635080 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:17:47.635061 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28\": container with ID starting with 27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28 not found: ID does not exist" containerID="27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28" Jul 14 11:17:47.635144 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.635084 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28"} err="failed to get container status \"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28\": rpc error: code = NotFound desc = could not find container \"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28\": container with ID starting with 27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28 not found: ID does not exist" Jul 14 11:17:47.635144 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.635098 2561 scope.go:117] "RemoveContainer" containerID="d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a" Jul 14 11:17:47.635314 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:17:47.635300 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a\": container with ID starting with d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a not found: ID does not exist" containerID="d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a" Jul 14 11:17:47.635351 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.635317 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a"} err="failed to get container status \"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a\": rpc error: code = NotFound desc = could not find container \"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a\": container with ID starting with d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a not found: ID does not exist" Jul 14 11:17:47.635351 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.635328 2561 scope.go:117] "RemoveContainer" containerID="5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc" Jul 14 11:17:47.635517 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.635501 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc"} err="failed to get container status \"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc\": rpc error: code = NotFound desc = could not find container \"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc\": container with ID starting with 5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc not found: ID does not exist" Jul 14 11:17:47.635560 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.635518 2561 scope.go:117] "RemoveContainer" containerID="87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32" Jul 14 11:17:47.635702 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.635687 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32"} err="failed to get container status \"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32\": rpc error: code = NotFound desc = could not find container \"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32\": container with ID starting with 87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32 not found: ID does not exist" Jul 14 11:17:47.635740 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.635702 2561 scope.go:117] "RemoveContainer" containerID="17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3" Jul 14 11:17:47.635889 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.635873 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3"} err="failed to get container status \"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3\": rpc error: code = NotFound desc = could not find container \"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3\": container with ID starting with 17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3 not found: ID does not exist" Jul 14 11:17:47.635931 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.635889 2561 scope.go:117] "RemoveContainer" containerID="e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb" Jul 14 11:17:47.636054 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.636038 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb"} err="failed to get container status \"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb\": rpc error: code = NotFound desc = could not find container \"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb\": container with ID starting with e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb not found: ID does not exist" Jul 14 11:17:47.636094 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.636054 2561 scope.go:117] "RemoveContainer" containerID="bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe" Jul 14 11:17:47.636266 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.636247 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe"} err="failed to get container status \"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe\": rpc error: code = NotFound desc = could not find container \"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe\": container with ID starting with bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe not found: ID does not exist" Jul 14 11:17:47.636322 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.636267 2561 scope.go:117] "RemoveContainer" containerID="27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28" Jul 14 11:17:47.636489 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.636473 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28"} err="failed to get container status \"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28\": rpc error: code = NotFound desc = could not find container \"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28\": container with ID starting with 27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28 not found: ID does not exist" Jul 14 11:17:47.636489 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.636488 2561 scope.go:117] "RemoveContainer" containerID="d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a" Jul 14 11:17:47.636726 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.636700 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a"} err="failed to get container status \"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a\": rpc error: code = NotFound desc = could not find container \"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a\": container with ID starting with d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a not found: ID does not exist" Jul 14 11:17:47.636726 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.636719 2561 scope.go:117] "RemoveContainer" containerID="5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc" Jul 14 11:17:47.636951 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.636932 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc"} err="failed to get container status \"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc\": rpc error: code = NotFound desc = could not find container \"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc\": container with ID starting with 5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc not found: ID does not exist" Jul 14 11:17:47.636987 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.636952 2561 scope.go:117] "RemoveContainer" containerID="87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32" Jul 14 11:17:47.637155 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.637138 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32"} err="failed to get container status \"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32\": rpc error: code = NotFound desc = could not find container \"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32\": container with ID starting with 87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32 not found: ID does not exist" Jul 14 11:17:47.637230 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.637156 2561 scope.go:117] "RemoveContainer" containerID="17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3" Jul 14 11:17:47.637360 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.637345 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3"} err="failed to get container status \"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3\": rpc error: code = NotFound desc = could not find container \"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3\": container with ID starting with 17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3 not found: ID does not exist" Jul 14 11:17:47.637404 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.637360 2561 scope.go:117] "RemoveContainer" containerID="e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb" Jul 14 11:17:47.637564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.637549 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb"} err="failed to get container status \"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb\": rpc error: code = NotFound desc = could not find container \"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb\": container with ID starting with e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb not found: ID does not exist" Jul 14 11:17:47.637623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.637563 2561 scope.go:117] "RemoveContainer" containerID="bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe" Jul 14 11:17:47.637744 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.637724 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe"} err="failed to get container status \"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe\": rpc error: code = NotFound desc = could not find container \"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe\": container with ID starting with bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe not found: ID does not exist" Jul 14 11:17:47.637808 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.637745 2561 scope.go:117] "RemoveContainer" containerID="27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28" Jul 14 11:17:47.637975 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.637955 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28"} err="failed to get container status \"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28\": rpc error: code = NotFound desc = could not find container \"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28\": container with ID starting with 27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28 not found: ID does not exist" Jul 14 11:17:47.638017 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.637976 2561 scope.go:117] "RemoveContainer" containerID="d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a" Jul 14 11:17:47.638171 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.638153 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a"} err="failed to get container status \"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a\": rpc error: code = NotFound desc = could not find container \"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a\": container with ID starting with d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a not found: ID does not exist" Jul 14 11:17:47.638252 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.638172 2561 scope.go:117] "RemoveContainer" containerID="5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc" Jul 14 11:17:47.638424 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.638404 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc"} err="failed to get container status \"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc\": rpc error: code = NotFound desc = could not find container \"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc\": container with ID starting with 5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc not found: ID does not exist" Jul 14 11:17:47.638424 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.638421 2561 scope.go:117] "RemoveContainer" containerID="87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32" Jul 14 11:17:47.638623 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.638608 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32"} err="failed to get container status \"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32\": rpc error: code = NotFound desc = could not find container \"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32\": container with ID starting with 87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32 not found: ID does not exist" Jul 14 11:17:47.638681 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.638623 2561 scope.go:117] "RemoveContainer" containerID="17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3" Jul 14 11:17:47.638819 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.638800 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3"} err="failed to get container status \"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3\": rpc error: code = NotFound desc = could not find container \"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3\": container with ID starting with 17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3 not found: ID does not exist" Jul 14 11:17:47.638861 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.638820 2561 scope.go:117] "RemoveContainer" containerID="e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb" Jul 14 11:17:47.639045 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.639027 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb"} err="failed to get container status \"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb\": rpc error: code = NotFound desc = could not find container \"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb\": container with ID starting with e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb not found: ID does not exist" Jul 14 11:17:47.639102 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.639046 2561 scope.go:117] "RemoveContainer" containerID="bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe" Jul 14 11:17:47.639255 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.639238 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe"} err="failed to get container status \"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe\": rpc error: code = NotFound desc = could not find container \"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe\": container with ID starting with bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe not found: ID does not exist" Jul 14 11:17:47.639304 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.639255 2561 scope.go:117] "RemoveContainer" containerID="27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28" Jul 14 11:17:47.639459 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.639442 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28"} err="failed to get container status \"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28\": rpc error: code = NotFound desc = could not find container \"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28\": container with ID starting with 27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28 not found: ID does not exist" Jul 14 11:17:47.639523 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.639461 2561 scope.go:117] "RemoveContainer" containerID="d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a" Jul 14 11:17:47.639684 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.639668 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a"} err="failed to get container status \"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a\": rpc error: code = NotFound desc = could not find container \"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a\": container with ID starting with d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a not found: ID does not exist" Jul 14 11:17:47.639726 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.639685 2561 scope.go:117] "RemoveContainer" containerID="5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc" Jul 14 11:17:47.639865 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.639848 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc"} err="failed to get container status \"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc\": rpc error: code = NotFound desc = could not find container \"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc\": container with ID starting with 5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc not found: ID does not exist" Jul 14 11:17:47.639932 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.639866 2561 scope.go:117] "RemoveContainer" containerID="87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32" Jul 14 11:17:47.640066 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.640051 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32"} err="failed to get container status \"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32\": rpc error: code = NotFound desc = could not find container \"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32\": container with ID starting with 87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32 not found: ID does not exist" Jul 14 11:17:47.640130 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.640066 2561 scope.go:117] "RemoveContainer" containerID="17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3" Jul 14 11:17:47.640336 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.640318 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3"} err="failed to get container status \"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3\": rpc error: code = NotFound desc = could not find container \"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3\": container with ID starting with 17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3 not found: ID does not exist" Jul 14 11:17:47.640395 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.640337 2561 scope.go:117] "RemoveContainer" containerID="e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb" Jul 14 11:17:47.640569 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.640554 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb"} err="failed to get container status \"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb\": rpc error: code = NotFound desc = could not find container \"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb\": container with ID starting with e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb not found: ID does not exist" Jul 14 11:17:47.640607 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.640569 2561 scope.go:117] "RemoveContainer" containerID="bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe" Jul 14 11:17:47.640781 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.640765 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe"} err="failed to get container status \"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe\": rpc error: code = NotFound desc = could not find container \"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe\": container with ID starting with bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe not found: ID does not exist" Jul 14 11:17:47.640823 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.640781 2561 scope.go:117] "RemoveContainer" containerID="27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28" Jul 14 11:17:47.641045 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.641010 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28"} err="failed to get container status \"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28\": rpc error: code = NotFound desc = could not find container \"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28\": container with ID starting with 27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28 not found: ID does not exist" Jul 14 11:17:47.641045 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.641044 2561 scope.go:117] "RemoveContainer" containerID="d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a" Jul 14 11:17:47.641330 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.641310 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a"} err="failed to get container status \"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a\": rpc error: code = NotFound desc = could not find container \"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a\": container with ID starting with d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a not found: ID does not exist" Jul 14 11:17:47.641330 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.641330 2561 scope.go:117] "RemoveContainer" containerID="5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc" Jul 14 11:17:47.641549 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.641529 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc"} err="failed to get container status \"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc\": rpc error: code = NotFound desc = could not find container \"5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc\": container with ID starting with 5ef26ea83feee30d06474eb2a34832461112a1ae5644d0a7abdd6ce9b7d841bc not found: ID does not exist" Jul 14 11:17:47.641594 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.641550 2561 scope.go:117] "RemoveContainer" containerID="87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32" Jul 14 11:17:47.641765 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.641748 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32"} err="failed to get container status \"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32\": rpc error: code = NotFound desc = could not find container \"87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32\": container with ID starting with 87c9143d2f0c59b66d6dc132c005eb5cf09d83d5ccf80a111ec89123e3139b32 not found: ID does not exist" Jul 14 11:17:47.641809 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.641766 2561 scope.go:117] "RemoveContainer" containerID="17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3" Jul 14 11:17:47.641961 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.641942 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3"} err="failed to get container status \"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3\": rpc error: code = NotFound desc = could not find container \"17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3\": container with ID starting with 17547f9c87a28441beaf4de449bb6ae80ba832f6850499c9c7d7113ef7e27ff3 not found: ID does not exist" Jul 14 11:17:47.642121 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.641961 2561 scope.go:117] "RemoveContainer" containerID="e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb" Jul 14 11:17:47.642303 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.642282 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb"} err="failed to get container status \"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb\": rpc error: code = NotFound desc = could not find container \"e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb\": container with ID starting with e4d316fbe607e5d7180932ac5c48eaa74f1407120e772a6005d696432b7e75fb not found: ID does not exist" Jul 14 11:17:47.642373 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.642303 2561 scope.go:117] "RemoveContainer" containerID="bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe" Jul 14 11:17:47.642622 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.642595 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe"} err="failed to get container status \"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe\": rpc error: code = NotFound desc = could not find container \"bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe\": container with ID starting with bc53121774692fe66111b60804a01817a907bac173702e48846b1636ac93a0fe not found: ID does not exist" Jul 14 11:17:47.642725 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.642623 2561 scope.go:117] "RemoveContainer" containerID="27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28" Jul 14 11:17:47.643344 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.643315 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28"} err="failed to get container status \"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28\": rpc error: code = NotFound desc = could not find container \"27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28\": container with ID starting with 27019c15013b1ebd583a310d8dd93b91ebc4db8224fb7cd08f34145a73c74d28 not found: ID does not exist" Jul 14 11:17:47.643344 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.643344 2561 scope.go:117] "RemoveContainer" containerID="d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a" Jul 14 11:17:47.643741 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.643716 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a"} err="failed to get container status \"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a\": rpc error: code = NotFound desc = could not find container \"d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a\": container with ID starting with d213e89de85c12714a0f46bd06f208c9bb1c502674c12e338c2e0b8c8c54292a not found: ID does not exist" Jul 14 11:17:47.644689 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.644672 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:17:47.644953 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.644941 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="init-config-reloader" Jul 14 11:17:47.644992 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.644955 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="init-config-reloader" Jul 14 11:17:47.644992 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.644964 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="thanos-sidecar" Jul 14 11:17:47.644992 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.644971 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="thanos-sidecar" Jul 14 11:17:47.644992 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.644979 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="kube-rbac-proxy" Jul 14 11:17:47.644992 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.644984 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="kube-rbac-proxy" Jul 14 11:17:47.644992 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.644991 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="kube-rbac-proxy-thanos" Jul 14 11:17:47.645167 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.644996 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="kube-rbac-proxy-thanos" Jul 14 11:17:47.645167 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.645008 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="kube-rbac-proxy-web" Jul 14 11:17:47.645167 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.645014 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="kube-rbac-proxy-web" Jul 14 11:17:47.645167 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.645022 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="prometheus" Jul 14 11:17:47.645167 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.645028 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="prometheus" Jul 14 11:17:47.645167 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.645036 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="config-reloader" Jul 14 11:17:47.645167 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.645041 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="config-reloader" Jul 14 11:17:47.645167 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.645089 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="thanos-sidecar" Jul 14 11:17:47.645167 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.645096 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="kube-rbac-proxy-thanos" Jul 14 11:17:47.645167 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.645102 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="kube-rbac-proxy" Jul 14 11:17:47.645167 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.645108 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="config-reloader" Jul 14 11:17:47.645167 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.645115 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="kube-rbac-proxy-web" Jul 14 11:17:47.645167 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.645120 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" containerName="prometheus" Jul 14 11:17:47.650126 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.650110 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.654139 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.654118 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 14 11:17:47.654315 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.654135 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 14 11:17:47.654393 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.654378 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-69qgrrksj7aqo\"" Jul 14 11:17:47.654433 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.654382 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 14 11:17:47.654688 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.654674 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 14 11:17:47.654979 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.654842 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 14 11:17:47.654979 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.654855 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 14 11:17:47.654979 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.654864 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 14 11:17:47.654979 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.654885 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 14 11:17:47.654979 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.654906 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 14 11:17:47.654979 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.654887 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 14 11:17:47.654979 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.654972 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-89kws\"" Jul 14 11:17:47.655342 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.655246 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 14 11:17:47.655398 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.655345 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 14 11:17:47.668466 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.664004 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 14 11:17:47.668466 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.667004 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 14 11:17:47.671284 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.671265 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:17:47.691573 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.691545 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-web-config\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.691706 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.691580 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-config-out\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.691706 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.691599 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.691706 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.691617 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.691706 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.691688 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.691836 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.691717 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.691836 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.691740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.691836 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.691760 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.691836 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.691787 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-config\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.691836 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.691808 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.691836 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.691826 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.691999 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.691842 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.691999 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.691912 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.691999 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.691939 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.691999 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.691965 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.691999 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.691991 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.692138 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.692011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.692138 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.692034 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.692138 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.692062 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq97h\" (UniqueName: \"kubernetes.io/projected/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-kube-api-access-vq97h\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.692138 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.692090 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.792548 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.792509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-web-config\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.792548 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.792553 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-config-out\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.792806 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.792569 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.792806 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.792593 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.792806 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.792621 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.792806 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.792645 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.792806 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.792668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.792806 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.792689 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.792806 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.792712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-config\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.792806 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.792740 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.793282 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.793130 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.793345 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.793321 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.793409 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.793358 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.793508 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.793487 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.793608 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.793525 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.793608 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.793566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.793608 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.793598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.795195 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.793643 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.795195 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.793679 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.795195 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.793702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.795195 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.793739 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.795195 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.793773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq97h\" (UniqueName: \"kubernetes.io/projected/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-kube-api-access-vq97h\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.795195 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.793810 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.795195 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.794543 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.795195 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.794592 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.795790 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.795765 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.796309 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.796285 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.796698 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.796676 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-config\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.797062 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.797034 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.797176 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.797158 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-web-config\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.797580 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.797555 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.797994 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.797936 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-config-out\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.798078 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.797999 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.798144 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.798106 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.798321 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.798298 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.798393 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.798368 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.798632 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.798611 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.798819 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.798800 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.799252 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.799231 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.804284 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.804266 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq97h\" (UniqueName: \"kubernetes.io/projected/2c43bba7-f68d-4fcb-9d3b-320b8185fd35-kube-api-access-vq97h\") pod \"prometheus-k8s-0\" (UID: \"2c43bba7-f68d-4fcb-9d3b-320b8185fd35\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:47.960385 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:47.960296 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:17:48.098140 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:48.098115 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 11:17:48.100122 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:17:48.100099 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c43bba7_f68d_4fcb_9d3b_320b8185fd35.slice/crio-1d926bd0c393a669f5d09439d2640cd20ba72fe01cc884d11e9640176dc1015a WatchSource:0}: Error finding container 1d926bd0c393a669f5d09439d2640cd20ba72fe01cc884d11e9640176dc1015a: Status 404 returned error can't find the container with id 1d926bd0c393a669f5d09439d2640cd20ba72fe01cc884d11e9640176dc1015a Jul 14 11:17:48.302943 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:48.302914 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59" path="/var/lib/kubelet/pods/1d2d3b6c-2ae1-4b2c-b1d2-aa2422647a59/volumes" Jul 14 11:17:48.589152 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:48.589068 2561 generic.go:356] "Generic (PLEG): container finished" podID="2c43bba7-f68d-4fcb-9d3b-320b8185fd35" containerID="ddcfe067eb4d880bb79bae4dc7c6b6ecd4b7f1f67c28d746c91378a7919affc4" exitCode=0 Jul 14 11:17:48.589152 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:48.589130 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c43bba7-f68d-4fcb-9d3b-320b8185fd35","Type":"ContainerDied","Data":"ddcfe067eb4d880bb79bae4dc7c6b6ecd4b7f1f67c28d746c91378a7919affc4"} Jul 14 11:17:48.589363 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:48.589191 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c43bba7-f68d-4fcb-9d3b-320b8185fd35","Type":"ContainerStarted","Data":"1d926bd0c393a669f5d09439d2640cd20ba72fe01cc884d11e9640176dc1015a"} Jul 14 11:17:49.596793 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:49.596759 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c43bba7-f68d-4fcb-9d3b-320b8185fd35","Type":"ContainerStarted","Data":"56332ba3487457fdb76ce636406c4bb1d50bf4e44dc4ffa89b725adadaaed722"} Jul 14 11:17:49.597153 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:49.596823 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c43bba7-f68d-4fcb-9d3b-320b8185fd35","Type":"ContainerStarted","Data":"12f8100501a393ca45a471b271b4fb6f0266f8ec671c61245effc2fde8ab9365"} Jul 14 11:17:49.597153 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:49.596847 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c43bba7-f68d-4fcb-9d3b-320b8185fd35","Type":"ContainerStarted","Data":"0ffabff84c9b1ca76c8626f2c32a712c0fdc5d2d5201bed2a40eb5a0420f99df"} Jul 14 11:17:49.597153 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:49.596870 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c43bba7-f68d-4fcb-9d3b-320b8185fd35","Type":"ContainerStarted","Data":"29576440f12b73e24df9b69532f4da5da92191d294cfcdefe12c2b7462c30746"} Jul 14 11:17:49.597153 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:49.596896 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c43bba7-f68d-4fcb-9d3b-320b8185fd35","Type":"ContainerStarted","Data":"c45cac431bc0e4abddea21bce01b819a7c346934826677196f8e7fedbf8e6156"} Jul 14 11:17:49.597153 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:49.596920 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c43bba7-f68d-4fcb-9d3b-320b8185fd35","Type":"ContainerStarted","Data":"b3de289a3a8ba1b0ba179607a0dd013369a2dccc7f8bc3d2225dbababe397ed3"} Jul 14 11:17:49.625829 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:49.625775 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.606784415 podStartE2EDuration="2.625752376s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.967961ms" isStatefulPod=false podCreationTimestamp="2026-07-14 11:17:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:17:49.62473511 +0000 UTC m=+387.950099679" watchObservedRunningTime="2026-07-14 11:17:49.625752376 +0000 UTC m=+387.951116908" Jul 14 11:17:49.798630 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:49.798594 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:17:51.054917 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:51.054873 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:17:51.155478 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:51.155442 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:17:51.428814 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:51.428720 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:17:51.531137 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:51.531095 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:17:52.960799 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:17:52.960759 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:18:01.832777 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:18:01.832734 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:18:01.932432 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:18:01.932404 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:18:27.888107 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:18:27.888064 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:18:27.947172 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:18:27.947128 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:18:28.908044 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:18:28.908007 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:18:47.961578 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:18:47.961488 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:18:47.976994 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:18:47.976970 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:18:48.838856 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:18:48.838829 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 11:18:56.336141 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:18:56.336076 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:18:56.419479 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:18:56.419447 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:19:03.080400 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:19:03.080361 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:19:03.181123 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:19:03.181086 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:19:08.335949 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:19:08.335916 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:19:08.395714 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:19:08.395683 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:19:14.013530 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:19:14.013490 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:19:14.114644 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:19:14.114597 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:19:15.266595 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:19:15.266561 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:19:15.367336 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:19:15.367305 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:19:29.142312 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:19:29.142277 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:19:29.241809 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:19:29.241772 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:19:50.434497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:19:50.434455 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:19:50.552658 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:19:50.552619 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:19:54.101361 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:19:54.101326 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:20:05.792562 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:20:05.792524 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:20:22.080587 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:20:22.080551 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:20:22.207512 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:20:22.207479 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:20:28.032692 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:20:28.032639 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:20:40.673448 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:20:40.673404 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:04.637390 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:04.637352 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:05.562038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:05.562003 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:08.650485 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:08.650448 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:08.750341 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:08.750314 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:10.984317 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:10.984285 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:11.092807 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:11.092768 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:11.640917 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:11.640885 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:11.840512 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:11.840478 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:13.086272 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:13.086231 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:13.464778 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:13.464699 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:15.041112 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:15.041079 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:15.142558 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:15.142521 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:18.695861 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:18.695827 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:18.798419 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:18.798386 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:21.793810 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:21.793770 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:22.122281 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:22.122179 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-rj5j5_dc7acf92-5cb9-48e3-8901-75e719e72682/cluster-monitoring-operator/0.log" Jul 14 11:21:22.123001 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:22.122981 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-rj5j5_dc7acf92-5cb9-48e3-8901-75e719e72682/cluster-monitoring-operator/0.log" Jul 14 11:21:22.124129 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:22.124107 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvxhc_26b43cc7-353e-42f8-ac60-29fb5bd6c510/console-operator/1.log" Jul 14 11:21:22.124854 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:22.124839 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvxhc_26b43cc7-353e-42f8-ac60-29fb5bd6c510/console-operator/1.log" Jul 14 11:21:22.129912 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:22.129887 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f7fw_9309eb9c-300d-4840-a58f-2c93d2c41bfe/ovn-acl-logging/0.log" Jul 14 11:21:22.130895 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:22.130868 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f7fw_9309eb9c-300d-4840-a58f-2c93d2c41bfe/ovn-acl-logging/0.log" Jul 14 11:21:23.498840 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:23.498810 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:23.598507 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:23.598473 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:24.944168 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:24.944134 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtngb"] Jul 14 11:21:24.947411 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:24.947391 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtngb" Jul 14 11:21:24.950667 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:24.950645 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 11:21:24.951641 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:24.951618 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tgjqt\"" Jul 14 11:21:24.951742 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:24.951644 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 11:21:24.972461 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:24.972423 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtngb"] Jul 14 11:21:25.050099 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:25.050061 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51a9e39a-5a3e-40cc-a85d-4147b1da601e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jtngb\" (UID: \"51a9e39a-5a3e-40cc-a85d-4147b1da601e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtngb" Jul 14 11:21:25.050305 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:25.050127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lhzb\" (UniqueName: \"kubernetes.io/projected/51a9e39a-5a3e-40cc-a85d-4147b1da601e-kube-api-access-6lhzb\") pod \"openshift-lws-operator-fd8ccff4c-jtngb\" (UID: \"51a9e39a-5a3e-40cc-a85d-4147b1da601e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtngb" Jul 14 11:21:25.151445 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:25.151410 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lhzb\" (UniqueName: \"kubernetes.io/projected/51a9e39a-5a3e-40cc-a85d-4147b1da601e-kube-api-access-6lhzb\") pod \"openshift-lws-operator-fd8ccff4c-jtngb\" (UID: \"51a9e39a-5a3e-40cc-a85d-4147b1da601e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtngb" Jul 14 11:21:25.151618 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:25.151469 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51a9e39a-5a3e-40cc-a85d-4147b1da601e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jtngb\" (UID: \"51a9e39a-5a3e-40cc-a85d-4147b1da601e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtngb" Jul 14 11:21:25.151842 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:25.151825 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51a9e39a-5a3e-40cc-a85d-4147b1da601e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jtngb\" (UID: \"51a9e39a-5a3e-40cc-a85d-4147b1da601e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtngb" Jul 14 11:21:25.168148 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:25.168113 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lhzb\" (UniqueName: \"kubernetes.io/projected/51a9e39a-5a3e-40cc-a85d-4147b1da601e-kube-api-access-6lhzb\") pod \"openshift-lws-operator-fd8ccff4c-jtngb\" (UID: \"51a9e39a-5a3e-40cc-a85d-4147b1da601e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtngb" Jul 14 11:21:25.273094 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:25.273062 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtngb" Jul 14 11:21:25.419341 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:25.419294 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtngb"] Jul 14 11:21:25.422343 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:21:25.422314 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51a9e39a_5a3e_40cc_a85d_4147b1da601e.slice/crio-b2c70c4e0fddc29d457743da041d371d5891a4ad833569d6481c5a725618228a WatchSource:0}: Error finding container b2c70c4e0fddc29d457743da041d371d5891a4ad833569d6481c5a725618228a: Status 404 returned error can't find the container with id b2c70c4e0fddc29d457743da041d371d5891a4ad833569d6481c5a725618228a Jul 14 11:21:25.431816 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:25.431788 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtngb" event={"ID":"51a9e39a-5a3e-40cc-a85d-4147b1da601e","Type":"ContainerStarted","Data":"b2c70c4e0fddc29d457743da041d371d5891a4ad833569d6481c5a725618228a"} Jul 14 11:21:29.450986 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:29.450948 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtngb" event={"ID":"51a9e39a-5a3e-40cc-a85d-4147b1da601e","Type":"ContainerStarted","Data":"2b609ab8a2a3889bcd82ab71b34ed4bbadccbf0eccdd6a85accf19c5dc2014e1"} Jul 14 11:21:29.476811 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:29.476755 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jtngb" podStartSLOduration=1.957458725 podStartE2EDuration="5.4767362s" totalImagesPullingTime="3.519277475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:21:29.47536324 +0000 UTC m=+607.800727771" watchObservedRunningTime="2026-07-14 11:21:29.4767362 +0000 UTC m=+607.802100735" Jul 14 11:21:30.194620 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:30.194588 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:31.723753 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:31.723716 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4kch7"] Jul 14 11:21:31.727043 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:31.727023 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4kch7" Jul 14 11:21:31.729587 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:31.729557 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 14 11:21:31.729587 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:31.729557 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 14 11:21:31.729766 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:31.729584 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4k6pz\"" Jul 14 11:21:31.736149 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:31.736115 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4kch7"] Jul 14 11:21:31.809547 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:31.809510 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c47sd\" (UniqueName: \"kubernetes.io/projected/301b263a-6362-4b8c-94ac-07b3db95df76-kube-api-access-c47sd\") pod \"cert-manager-55b4d954d5-4kch7\" (UID: \"301b263a-6362-4b8c-94ac-07b3db95df76\") " pod="cert-manager/cert-manager-55b4d954d5-4kch7" Jul 14 11:21:31.809736 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:31.809568 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/301b263a-6362-4b8c-94ac-07b3db95df76-bound-sa-token\") pod \"cert-manager-55b4d954d5-4kch7\" (UID: \"301b263a-6362-4b8c-94ac-07b3db95df76\") " pod="cert-manager/cert-manager-55b4d954d5-4kch7" Jul 14 11:21:31.910429 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:31.910391 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c47sd\" (UniqueName: \"kubernetes.io/projected/301b263a-6362-4b8c-94ac-07b3db95df76-kube-api-access-c47sd\") pod \"cert-manager-55b4d954d5-4kch7\" (UID: \"301b263a-6362-4b8c-94ac-07b3db95df76\") " pod="cert-manager/cert-manager-55b4d954d5-4kch7" Jul 14 11:21:31.910607 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:31.910465 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/301b263a-6362-4b8c-94ac-07b3db95df76-bound-sa-token\") pod \"cert-manager-55b4d954d5-4kch7\" (UID: \"301b263a-6362-4b8c-94ac-07b3db95df76\") " pod="cert-manager/cert-manager-55b4d954d5-4kch7" Jul 14 11:21:31.917026 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:31.917001 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:31.918727 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:31.918706 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/301b263a-6362-4b8c-94ac-07b3db95df76-bound-sa-token\") pod \"cert-manager-55b4d954d5-4kch7\" (UID: \"301b263a-6362-4b8c-94ac-07b3db95df76\") " pod="cert-manager/cert-manager-55b4d954d5-4kch7" Jul 14 11:21:31.918959 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:31.918943 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c47sd\" (UniqueName: \"kubernetes.io/projected/301b263a-6362-4b8c-94ac-07b3db95df76-kube-api-access-c47sd\") pod \"cert-manager-55b4d954d5-4kch7\" (UID: \"301b263a-6362-4b8c-94ac-07b3db95df76\") " pod="cert-manager/cert-manager-55b4d954d5-4kch7" Jul 14 11:21:32.036383 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:32.036352 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4kch7" Jul 14 11:21:32.089072 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:32.088989 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:32.175174 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:32.175139 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4kch7"] Jul 14 11:21:32.178747 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:21:32.178717 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod301b263a_6362_4b8c_94ac_07b3db95df76.slice/crio-d41b328139ecc55fa416d7166be13da7cb501fc91e72b3336b79b98675193287 WatchSource:0}: Error finding container d41b328139ecc55fa416d7166be13da7cb501fc91e72b3336b79b98675193287: Status 404 returned error can't find the container with id d41b328139ecc55fa416d7166be13da7cb501fc91e72b3336b79b98675193287 Jul 14 11:21:32.180938 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:32.180920 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 11:21:32.463875 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:32.463782 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4kch7" event={"ID":"301b263a-6362-4b8c-94ac-07b3db95df76","Type":"ContainerStarted","Data":"d41b328139ecc55fa416d7166be13da7cb501fc91e72b3336b79b98675193287"} Jul 14 11:21:36.484059 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:36.483971 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4kch7" event={"ID":"301b263a-6362-4b8c-94ac-07b3db95df76","Type":"ContainerStarted","Data":"5a0e0881412ce0abd8003ca63c9f745114b73787251eb94e4364e6b21b89c7ef"} Jul 14 11:21:36.510462 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:36.510399 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-4kch7" podStartSLOduration=1.656356157 podStartE2EDuration="5.510379447s" totalImagesPullingTime="3.85402329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:21:36.510036848 +0000 UTC m=+614.835401381" watchObservedRunningTime="2026-07-14 11:21:36.510379447 +0000 UTC m=+614.835743980" Jul 14 11:21:40.438459 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.438423 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:40.480735 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.480702 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r"] Jul 14 11:21:40.484196 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.484173 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" Jul 14 11:21:40.487762 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.487741 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 14 11:21:40.489127 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.489095 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 14 11:21:40.489127 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.489110 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 14 11:21:40.489324 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.489152 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-w2f6l\"" Jul 14 11:21:40.497771 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.497745 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r"] Jul 14 11:21:40.548430 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.548397 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:40.591530 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.591497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b-metrics-cert\") pod \"lws-controller-manager-749d85bc9c-8vx8r\" (UID: \"a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" Jul 14 11:21:40.591662 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.591541 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b-manager-config\") pod \"lws-controller-manager-749d85bc9c-8vx8r\" (UID: \"a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" Jul 14 11:21:40.591662 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.591633 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b-cert\") pod \"lws-controller-manager-749d85bc9c-8vx8r\" (UID: \"a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" Jul 14 11:21:40.591744 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.591677 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stl4x\" (UniqueName: \"kubernetes.io/projected/a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b-kube-api-access-stl4x\") pod \"lws-controller-manager-749d85bc9c-8vx8r\" (UID: \"a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" Jul 14 11:21:40.692967 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.692888 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b-cert\") pod \"lws-controller-manager-749d85bc9c-8vx8r\" (UID: \"a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" Jul 14 11:21:40.692967 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.692931 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stl4x\" (UniqueName: \"kubernetes.io/projected/a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b-kube-api-access-stl4x\") pod \"lws-controller-manager-749d85bc9c-8vx8r\" (UID: \"a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" Jul 14 11:21:40.693217 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.692995 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b-metrics-cert\") pod \"lws-controller-manager-749d85bc9c-8vx8r\" (UID: \"a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" Jul 14 11:21:40.693217 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.693023 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b-manager-config\") pod \"lws-controller-manager-749d85bc9c-8vx8r\" (UID: \"a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" Jul 14 11:21:40.693742 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.693708 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b-manager-config\") pod \"lws-controller-manager-749d85bc9c-8vx8r\" (UID: \"a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" Jul 14 11:21:40.695486 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.695466 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b-metrics-cert\") pod \"lws-controller-manager-749d85bc9c-8vx8r\" (UID: \"a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" Jul 14 11:21:40.695580 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.695532 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b-cert\") pod \"lws-controller-manager-749d85bc9c-8vx8r\" (UID: \"a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" Jul 14 11:21:40.712117 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.712088 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stl4x\" (UniqueName: \"kubernetes.io/projected/a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b-kube-api-access-stl4x\") pod \"lws-controller-manager-749d85bc9c-8vx8r\" (UID: \"a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b\") " pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" Jul 14 11:21:40.794168 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.794123 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" Jul 14 11:21:40.931102 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:40.931034 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r"] Jul 14 11:21:40.934434 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:21:40.934390 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda271dc9e_d9a3_478c_b7d2_4b1599ba8a8b.slice/crio-9a79c81e7f97b5107ef9dcb18e9af7a606091a1c30cd969c161facad8aa72066 WatchSource:0}: Error finding container 9a79c81e7f97b5107ef9dcb18e9af7a606091a1c30cd969c161facad8aa72066: Status 404 returned error can't find the container with id 9a79c81e7f97b5107ef9dcb18e9af7a606091a1c30cd969c161facad8aa72066 Jul 14 11:21:41.505884 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:41.505847 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" event={"ID":"a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b","Type":"ContainerStarted","Data":"9a79c81e7f97b5107ef9dcb18e9af7a606091a1c30cd969c161facad8aa72066"} Jul 14 11:21:42.512784 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:42.512144 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" event={"ID":"a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b","Type":"ContainerStarted","Data":"4e412a01102b3f09b2fa3db0c38919317bd89eee6c9ccc1ccc39be2b85a77a17"} Jul 14 11:21:42.512784 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:42.512557 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" Jul 14 11:21:42.531081 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:42.531030 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" podStartSLOduration=1.068810781 podStartE2EDuration="2.531015083s" totalImagesPullingTime="1.462204302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:21:42.530482642 +0000 UTC m=+620.855847186" watchObservedRunningTime="2026-07-14 11:21:42.531015083 +0000 UTC m=+620.856379615" Jul 14 11:21:44.265092 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:44.265000 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:44.364167 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:44.364132 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:44.876797 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:44.876749 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:45.156318 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.156218 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:45.280167 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.280131 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:45.326710 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.326676 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x"] Jul 14 11:21:45.330145 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.330123 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.333817 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.333792 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 11:21:45.334051 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.334036 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-j5tr7\"" Jul 14 11:21:45.334230 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.334180 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 11:21:45.334399 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.334386 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 11:21:45.336596 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.336578 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 11:21:45.367184 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.367145 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x"] Jul 14 11:21:45.436820 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.436727 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpbfp\" (UniqueName: \"kubernetes.io/projected/16cb23d7-3092-4b36-a93b-9b0e4a882a55-kube-api-access-fpbfp\") pod \"opendatahub-operator-controller-manager-5bf58df976-xhj8x\" (UID: \"16cb23d7-3092-4b36-a93b-9b0e4a882a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.437008 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.436926 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16cb23d7-3092-4b36-a93b-9b0e4a882a55-tmp\") pod \"opendatahub-operator-controller-manager-5bf58df976-xhj8x\" (UID: \"16cb23d7-3092-4b36-a93b-9b0e4a882a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.437008 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.436961 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16cb23d7-3092-4b36-a93b-9b0e4a882a55-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-xhj8x\" (UID: \"16cb23d7-3092-4b36-a93b-9b0e4a882a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.437111 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.437054 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/16cb23d7-3092-4b36-a93b-9b0e4a882a55-manifests\") pod \"opendatahub-operator-controller-manager-5bf58df976-xhj8x\" (UID: \"16cb23d7-3092-4b36-a93b-9b0e4a882a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.437111 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.437107 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/16cb23d7-3092-4b36-a93b-9b0e4a882a55-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-xhj8x\" (UID: \"16cb23d7-3092-4b36-a93b-9b0e4a882a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.538416 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.538378 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16cb23d7-3092-4b36-a93b-9b0e4a882a55-tmp\") pod \"opendatahub-operator-controller-manager-5bf58df976-xhj8x\" (UID: \"16cb23d7-3092-4b36-a93b-9b0e4a882a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.538416 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.538414 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16cb23d7-3092-4b36-a93b-9b0e4a882a55-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-xhj8x\" (UID: \"16cb23d7-3092-4b36-a93b-9b0e4a882a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.538668 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.538455 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/16cb23d7-3092-4b36-a93b-9b0e4a882a55-manifests\") pod \"opendatahub-operator-controller-manager-5bf58df976-xhj8x\" (UID: \"16cb23d7-3092-4b36-a93b-9b0e4a882a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.538668 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.538491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/16cb23d7-3092-4b36-a93b-9b0e4a882a55-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-xhj8x\" (UID: \"16cb23d7-3092-4b36-a93b-9b0e4a882a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.538668 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.538543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpbfp\" (UniqueName: \"kubernetes.io/projected/16cb23d7-3092-4b36-a93b-9b0e4a882a55-kube-api-access-fpbfp\") pod \"opendatahub-operator-controller-manager-5bf58df976-xhj8x\" (UID: \"16cb23d7-3092-4b36-a93b-9b0e4a882a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.538928 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.538906 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/16cb23d7-3092-4b36-a93b-9b0e4a882a55-manifests\") pod \"opendatahub-operator-controller-manager-5bf58df976-xhj8x\" (UID: \"16cb23d7-3092-4b36-a93b-9b0e4a882a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.540866 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.540830 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16cb23d7-3092-4b36-a93b-9b0e4a882a55-tmp\") pod \"opendatahub-operator-controller-manager-5bf58df976-xhj8x\" (UID: \"16cb23d7-3092-4b36-a93b-9b0e4a882a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.540998 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.540981 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/16cb23d7-3092-4b36-a93b-9b0e4a882a55-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-xhj8x\" (UID: \"16cb23d7-3092-4b36-a93b-9b0e4a882a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.541040 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.541019 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/16cb23d7-3092-4b36-a93b-9b0e4a882a55-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bf58df976-xhj8x\" (UID: \"16cb23d7-3092-4b36-a93b-9b0e4a882a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.548934 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.548909 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpbfp\" (UniqueName: \"kubernetes.io/projected/16cb23d7-3092-4b36-a93b-9b0e4a882a55-kube-api-access-fpbfp\") pod \"opendatahub-operator-controller-manager-5bf58df976-xhj8x\" (UID: \"16cb23d7-3092-4b36-a93b-9b0e4a882a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.599078 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.599039 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:45.640918 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.640878 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:45.708039 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.707969 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:45.799792 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.799753 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x"] Jul 14 11:21:45.803388 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:21:45.803356 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16cb23d7_3092_4b36_a93b_9b0e4a882a55.slice/crio-09bddab974673ea57338177ce7d664d54dac7a6acb5dbc59fae535b1dc4f8084 WatchSource:0}: Error finding container 09bddab974673ea57338177ce7d664d54dac7a6acb5dbc59fae535b1dc4f8084: Status 404 returned error can't find the container with id 09bddab974673ea57338177ce7d664d54dac7a6acb5dbc59fae535b1dc4f8084 Jul 14 11:21:45.811482 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.811454 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:45.933940 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:45.933907 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:46.030455 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:46.030420 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:46.132807 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:46.132773 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:46.226699 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:46.226666 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:21:46.535104 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:46.535070 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" event={"ID":"16cb23d7-3092-4b36-a93b-9b0e4a882a55","Type":"ContainerStarted","Data":"09bddab974673ea57338177ce7d664d54dac7a6acb5dbc59fae535b1dc4f8084"} Jul 14 11:21:49.553423 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:49.553383 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" event={"ID":"16cb23d7-3092-4b36-a93b-9b0e4a882a55","Type":"ContainerStarted","Data":"16ed274989f63499069158eb3ded88f8f7948e6772f08008211e268ef584ba01"} Jul 14 11:21:50.559513 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:50.559480 2561 generic.go:356] "Generic (PLEG): container finished" podID="16cb23d7-3092-4b36-a93b-9b0e4a882a55" containerID="16ed274989f63499069158eb3ded88f8f7948e6772f08008211e268ef584ba01" exitCode=0 Jul 14 11:21:50.559870 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:50.559573 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" event={"ID":"16cb23d7-3092-4b36-a93b-9b0e4a882a55","Type":"ContainerDied","Data":"16ed274989f63499069158eb3ded88f8f7948e6772f08008211e268ef584ba01"} Jul 14 11:21:51.566225 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:51.566178 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" event={"ID":"16cb23d7-3092-4b36-a93b-9b0e4a882a55","Type":"ContainerStarted","Data":"829e3443f58d7c2813f2468ef36c6331d53fee0530464f8154f169097e012855"} Jul 14 11:21:51.566633 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:51.566348 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:21:51.598627 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:51.598575 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" podStartSLOduration=1.946926145 podStartE2EDuration="6.598557189s" totalImagesPullingTime="3.62520529s" totalInitContainerRuntime="1.026425754s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:21:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:21:51.593506366 +0000 UTC m=+629.918870909" watchObservedRunningTime="2026-07-14 11:21:51.598557189 +0000 UTC m=+629.923921721" Jul 14 11:21:53.518809 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:21:53.518777 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-749d85bc9c-8vx8r" Jul 14 11:22:02.573273 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:02.573242 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bf58df976-xhj8x" Jul 14 11:22:05.091626 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:05.091565 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:05.251926 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:05.251889 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:08.675885 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.675842 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:08.712491 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.712453 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf"] Jul 14 11:22:08.731986 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.731952 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf"] Jul 14 11:22:08.732173 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.732086 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf" Jul 14 11:22:08.736015 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.735973 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 11:22:08.736184 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.736023 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 11:22:08.736184 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.735973 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 11:22:08.736184 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.736081 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-j4jds\"" Jul 14 11:22:08.737059 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.737041 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 11:22:08.835748 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.835710 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x6gf\" (UniqueName: \"kubernetes.io/projected/cc2d6e12-5a82-414e-939f-a4d0c5a341be-kube-api-access-8x6gf\") pod \"kube-auth-proxy-6b948bb5ff-f4ccf\" (UID: \"cc2d6e12-5a82-414e-939f-a4d0c5a341be\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf" Jul 14 11:22:08.835929 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.835782 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2d6e12-5a82-414e-939f-a4d0c5a341be-tmp\") pod \"kube-auth-proxy-6b948bb5ff-f4ccf\" (UID: \"cc2d6e12-5a82-414e-939f-a4d0c5a341be\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf" Jul 14 11:22:08.835929 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.835856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc2d6e12-5a82-414e-939f-a4d0c5a341be-tls-certs\") pod \"kube-auth-proxy-6b948bb5ff-f4ccf\" (UID: \"cc2d6e12-5a82-414e-939f-a4d0c5a341be\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf" Jul 14 11:22:08.927568 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.927482 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:08.936656 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.936628 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x6gf\" (UniqueName: \"kubernetes.io/projected/cc2d6e12-5a82-414e-939f-a4d0c5a341be-kube-api-access-8x6gf\") pod \"kube-auth-proxy-6b948bb5ff-f4ccf\" (UID: \"cc2d6e12-5a82-414e-939f-a4d0c5a341be\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf" Jul 14 11:22:08.936798 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.936675 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2d6e12-5a82-414e-939f-a4d0c5a341be-tmp\") pod \"kube-auth-proxy-6b948bb5ff-f4ccf\" (UID: \"cc2d6e12-5a82-414e-939f-a4d0c5a341be\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf" Jul 14 11:22:08.936798 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.936719 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc2d6e12-5a82-414e-939f-a4d0c5a341be-tls-certs\") pod \"kube-auth-proxy-6b948bb5ff-f4ccf\" (UID: \"cc2d6e12-5a82-414e-939f-a4d0c5a341be\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf" Jul 14 11:22:08.939175 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.939150 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc2d6e12-5a82-414e-939f-a4d0c5a341be-tmp\") pod \"kube-auth-proxy-6b948bb5ff-f4ccf\" (UID: \"cc2d6e12-5a82-414e-939f-a4d0c5a341be\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf" Jul 14 11:22:08.939404 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.939387 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc2d6e12-5a82-414e-939f-a4d0c5a341be-tls-certs\") pod \"kube-auth-proxy-6b948bb5ff-f4ccf\" (UID: \"cc2d6e12-5a82-414e-939f-a4d0c5a341be\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf" Jul 14 11:22:08.948743 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:08.948721 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x6gf\" (UniqueName: \"kubernetes.io/projected/cc2d6e12-5a82-414e-939f-a4d0c5a341be-kube-api-access-8x6gf\") pod \"kube-auth-proxy-6b948bb5ff-f4ccf\" (UID: \"cc2d6e12-5a82-414e-939f-a4d0c5a341be\") " pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf" Jul 14 11:22:09.044824 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:09.044790 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf" Jul 14 11:22:09.109597 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:09.109564 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:09.183948 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:09.183875 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf"] Jul 14 11:22:09.187108 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:22:09.187077 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2d6e12_5a82_414e_939f_a4d0c5a341be.slice/crio-cf9c9b769328e4f3407f7186f5d5552b956d0228eddef6fb81da2197de3637a0 WatchSource:0}: Error finding container cf9c9b769328e4f3407f7186f5d5552b956d0228eddef6fb81da2197de3637a0: Status 404 returned error can't find the container with id cf9c9b769328e4f3407f7186f5d5552b956d0228eddef6fb81da2197de3637a0 Jul 14 11:22:09.620944 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:09.620897 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:09.648604 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:09.648565 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf" event={"ID":"cc2d6e12-5a82-414e-939f-a4d0c5a341be","Type":"ContainerStarted","Data":"cf9c9b769328e4f3407f7186f5d5552b956d0228eddef6fb81da2197de3637a0"} Jul 14 11:22:09.831303 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:09.831241 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:10.419703 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:10.419670 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:10.758476 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:10.758443 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:10.850729 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:10.850698 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:12.288601 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:12.288570 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:12.663517 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:12.663406 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf" event={"ID":"cc2d6e12-5a82-414e-939f-a4d0c5a341be","Type":"ContainerStarted","Data":"45204c23ba6ddb5cf4ec0a4b7555690b41472c0e735cdc8a2c681fb446f2b2e3"} Jul 14 11:22:12.684314 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:12.684265 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b948bb5ff-f4ccf" podStartSLOduration=1.4753569770000001 podStartE2EDuration="4.684248107s" totalImagesPullingTime="3.20889113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:22:12.682646533 +0000 UTC m=+651.008011079" watchObservedRunningTime="2026-07-14 11:22:12.684248107 +0000 UTC m=+651.009612639" Jul 14 11:22:16.390989 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:16.390952 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:16.482668 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:16.482633 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:16.805795 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:16.805754 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:17.116723 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:17.116628 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:17.291426 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:17.291389 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:19.661381 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:19.661344 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:19.866973 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:19.866934 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:19.980528 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:19.980447 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:20.081356 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:20.081324 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:21.096198 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:21.096168 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:22:21.180672 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:22:21.180634 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:06.528269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:06.528234 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:06.602874 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:06.602840 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:06.740572 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:06.740539 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:07.467738 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:07.467704 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:07.689615 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:07.689584 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:08.579281 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:08.579245 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:08.654824 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:08.654791 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:19.993376 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:19.993341 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:20.106781 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:20.106746 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:20.222339 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:20.222308 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:30.863871 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:30.863821 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:34.504409 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:34.504374 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:37.561827 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:37.561793 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:38.938377 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:38.938344 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:39.084474 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:39.084436 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:39.552122 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:39.552071 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:42.323583 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:42.323539 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:42.451902 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:42.451850 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:43.273137 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:43.273095 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:45.177038 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:45.177004 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:46.759088 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:46.759056 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:46.862025 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:46.861992 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:49.259440 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:49.259407 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:49.443062 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:49.443030 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:50.601503 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:50.601466 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:50.707195 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:50.707161 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:55.124074 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:55.124038 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:55.225957 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:55.225922 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:59.643219 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:59.643183 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:23:59.821457 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:23:59.821424 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:24:01.814062 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:01.814023 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t4m9s"] Jul 14 11:24:01.817359 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:01.817342 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t4m9s" Jul 14 11:24:01.821493 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:01.821470 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 11:24:01.821624 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:01.821608 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m8qkz\"" Jul 14 11:24:01.831261 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:01.831241 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 11:24:01.859124 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:01.859051 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t4m9s"] Jul 14 11:24:01.942253 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:01.942201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77f19e37-d3ce-4746-91bc-2d5ccf980c40-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-t4m9s\" (UID: \"77f19e37-d3ce-4746-91bc-2d5ccf980c40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t4m9s" Jul 14 11:24:01.942433 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:01.942261 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5vfm\" (UniqueName: \"kubernetes.io/projected/77f19e37-d3ce-4746-91bc-2d5ccf980c40-kube-api-access-j5vfm\") pod \"kuadrant-operator-controller-manager-86878c769f-t4m9s\" (UID: \"77f19e37-d3ce-4746-91bc-2d5ccf980c40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t4m9s" Jul 14 11:24:02.043229 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:02.043180 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77f19e37-d3ce-4746-91bc-2d5ccf980c40-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-t4m9s\" (UID: \"77f19e37-d3ce-4746-91bc-2d5ccf980c40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t4m9s" Jul 14 11:24:02.043390 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:02.043246 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5vfm\" (UniqueName: \"kubernetes.io/projected/77f19e37-d3ce-4746-91bc-2d5ccf980c40-kube-api-access-j5vfm\") pod \"kuadrant-operator-controller-manager-86878c769f-t4m9s\" (UID: \"77f19e37-d3ce-4746-91bc-2d5ccf980c40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t4m9s" Jul 14 11:24:02.043554 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:02.043535 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77f19e37-d3ce-4746-91bc-2d5ccf980c40-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-t4m9s\" (UID: \"77f19e37-d3ce-4746-91bc-2d5ccf980c40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t4m9s" Jul 14 11:24:02.068137 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:02.068067 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5vfm\" (UniqueName: \"kubernetes.io/projected/77f19e37-d3ce-4746-91bc-2d5ccf980c40-kube-api-access-j5vfm\") pod \"kuadrant-operator-controller-manager-86878c769f-t4m9s\" (UID: \"77f19e37-d3ce-4746-91bc-2d5ccf980c40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t4m9s" Jul 14 11:24:02.127321 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:02.127288 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t4m9s" Jul 14 11:24:02.285421 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:02.285390 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t4m9s"] Jul 14 11:24:02.288056 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:24:02.288027 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f19e37_d3ce_4746_91bc_2d5ccf980c40.slice/crio-6c2db278e73f745957c7dd9f486701b16432afac404f2460504409c5655d9b1a WatchSource:0}: Error finding container 6c2db278e73f745957c7dd9f486701b16432afac404f2460504409c5655d9b1a: Status 404 returned error can't find the container with id 6c2db278e73f745957c7dd9f486701b16432afac404f2460504409c5655d9b1a Jul 14 11:24:02.537371 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:02.537336 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:24:02.654060 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:02.654027 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:24:03.159011 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:03.158979 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t4m9s" event={"ID":"77f19e37-d3ce-4746-91bc-2d5ccf980c40","Type":"ContainerStarted","Data":"6c2db278e73f745957c7dd9f486701b16432afac404f2460504409c5655d9b1a"} Jul 14 11:24:08.058390 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:08.058341 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:24:08.187039 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:08.187003 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t4m9s" event={"ID":"77f19e37-d3ce-4746-91bc-2d5ccf980c40","Type":"ContainerStarted","Data":"5d4d5fe7466e315ce25a45ad1e1ee5344151b919af2262f8ec33135f40f21e9f"} Jul 14 11:24:08.187271 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:08.187126 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t4m9s" Jul 14 11:24:08.248785 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:08.248718 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t4m9s" podStartSLOduration=2.357347577 podStartE2EDuration="7.248701419s" totalImagesPullingTime="4.891353842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:24:08.247905659 +0000 UTC m=+766.573270192" watchObservedRunningTime="2026-07-14 11:24:08.248701419 +0000 UTC m=+766.574066008" Jul 14 11:24:08.347998 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:08.347887 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:24:12.080481 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:12.080442 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:24:19.194141 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:19.194111 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-t4m9s" Jul 14 11:24:35.706101 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:35.706069 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:24:35.918501 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:35.918460 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:24:38.766968 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:38.766934 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:24:38.884168 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:38.884134 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:24:38.994125 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:38.994094 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:24:39.562865 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:39.562831 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-q8ptn"] Jul 14 11:24:39.568269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:39.568244 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-q8ptn" Jul 14 11:24:39.570988 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:39.570971 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lcswc\"" Jul 14 11:24:39.576639 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:39.576616 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-q8ptn"] Jul 14 11:24:39.599009 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:39.598974 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:24:39.657192 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:39.657149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdmcl\" (UniqueName: \"kubernetes.io/projected/026b7b4f-39d7-4f79-af81-e25decf24af3-kube-api-access-sdmcl\") pod \"authorino-58cd955675-q8ptn\" (UID: \"026b7b4f-39d7-4f79-af81-e25decf24af3\") " pod="kuadrant-system/authorino-58cd955675-q8ptn" Jul 14 11:24:39.693953 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:39.693918 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:24:39.758378 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:39.758340 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdmcl\" (UniqueName: \"kubernetes.io/projected/026b7b4f-39d7-4f79-af81-e25decf24af3-kube-api-access-sdmcl\") pod \"authorino-58cd955675-q8ptn\" (UID: \"026b7b4f-39d7-4f79-af81-e25decf24af3\") " pod="kuadrant-system/authorino-58cd955675-q8ptn" Jul 14 11:24:39.762685 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:39.762659 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-dtqpb"] Jul 14 11:24:39.765589 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:39.765574 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dtqpb" Jul 14 11:24:39.768233 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:39.768185 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdmcl\" (UniqueName: \"kubernetes.io/projected/026b7b4f-39d7-4f79-af81-e25decf24af3-kube-api-access-sdmcl\") pod \"authorino-58cd955675-q8ptn\" (UID: \"026b7b4f-39d7-4f79-af81-e25decf24af3\") " pod="kuadrant-system/authorino-58cd955675-q8ptn" Jul 14 11:24:39.777435 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:39.777413 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dtqpb"] Jul 14 11:24:39.859828 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:39.859742 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njkwm\" (UniqueName: \"kubernetes.io/projected/b77b0579-2d46-40be-87bb-c5a8a907991f-kube-api-access-njkwm\") pod \"authorino-75d556bd77-dtqpb\" (UID: \"b77b0579-2d46-40be-87bb-c5a8a907991f\") " pod="kuadrant-system/authorino-75d556bd77-dtqpb" Jul 14 11:24:39.877597 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:39.877576 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-q8ptn" Jul 14 11:24:39.960851 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:39.960775 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njkwm\" (UniqueName: \"kubernetes.io/projected/b77b0579-2d46-40be-87bb-c5a8a907991f-kube-api-access-njkwm\") pod \"authorino-75d556bd77-dtqpb\" (UID: \"b77b0579-2d46-40be-87bb-c5a8a907991f\") " pod="kuadrant-system/authorino-75d556bd77-dtqpb" Jul 14 11:24:39.973755 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:39.973725 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njkwm\" (UniqueName: \"kubernetes.io/projected/b77b0579-2d46-40be-87bb-c5a8a907991f-kube-api-access-njkwm\") pod \"authorino-75d556bd77-dtqpb\" (UID: \"b77b0579-2d46-40be-87bb-c5a8a907991f\") " pod="kuadrant-system/authorino-75d556bd77-dtqpb" Jul 14 11:24:40.024891 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:40.024847 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-q8ptn"] Jul 14 11:24:40.028938 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:24:40.028913 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod026b7b4f_39d7_4f79_af81_e25decf24af3.slice/crio-6e02269e8534cc03bff20e7b6016221c5e32f58efa5c4dad8eac6487ec40bcd2 WatchSource:0}: Error finding container 6e02269e8534cc03bff20e7b6016221c5e32f58efa5c4dad8eac6487ec40bcd2: Status 404 returned error can't find the container with id 6e02269e8534cc03bff20e7b6016221c5e32f58efa5c4dad8eac6487ec40bcd2 Jul 14 11:24:40.082578 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:40.082547 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dtqpb" Jul 14 11:24:40.224303 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:40.224269 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dtqpb"] Jul 14 11:24:40.230406 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:24:40.230379 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb77b0579_2d46_40be_87bb_c5a8a907991f.slice/crio-dccf7d695fa2bd09ffe138c00e7f7b3ce259b28d57eb4d7e149934295987b14e WatchSource:0}: Error finding container dccf7d695fa2bd09ffe138c00e7f7b3ce259b28d57eb4d7e149934295987b14e: Status 404 returned error can't find the container with id dccf7d695fa2bd09ffe138c00e7f7b3ce259b28d57eb4d7e149934295987b14e Jul 14 11:24:40.340323 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:40.340279 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dtqpb" event={"ID":"b77b0579-2d46-40be-87bb-c5a8a907991f","Type":"ContainerStarted","Data":"dccf7d695fa2bd09ffe138c00e7f7b3ce259b28d57eb4d7e149934295987b14e"} Jul 14 11:24:40.341493 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:40.341467 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-q8ptn" event={"ID":"026b7b4f-39d7-4f79-af81-e25decf24af3","Type":"ContainerStarted","Data":"6e02269e8534cc03bff20e7b6016221c5e32f58efa5c4dad8eac6487ec40bcd2"} Jul 14 11:24:44.365959 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:44.365875 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-q8ptn" event={"ID":"026b7b4f-39d7-4f79-af81-e25decf24af3","Type":"ContainerStarted","Data":"96f5b74770480ac6169326d5163c24f9f5cd4e9c1efbc147812ed0f44d3bd5d3"} Jul 14 11:24:44.367313 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:44.367281 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dtqpb" event={"ID":"b77b0579-2d46-40be-87bb-c5a8a907991f","Type":"ContainerStarted","Data":"ce25a83fb2571a639d5a3fc5234454fd693a75bfaf485c04a744bce35abce8fc"} Jul 14 11:24:44.382997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:44.382943 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-q8ptn" podStartSLOduration=1.953082131 podStartE2EDuration="5.382926258s" totalImagesPullingTime="3.429844127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:24:44.382445155 +0000 UTC m=+802.707809685" watchObservedRunningTime="2026-07-14 11:24:44.382926258 +0000 UTC m=+802.708290791" Jul 14 11:24:44.427861 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:44.427804 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-dtqpb" podStartSLOduration=2.187741417 podStartE2EDuration="5.427787556s" totalImagesPullingTime="3.240046139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:24:44.398290553 +0000 UTC m=+802.723655086" watchObservedRunningTime="2026-07-14 11:24:44.427787556 +0000 UTC m=+802.753152108" Jul 14 11:24:44.428474 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:44.428452 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-q8ptn"] Jul 14 11:24:46.375143 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:46.375091 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-q8ptn" podUID="026b7b4f-39d7-4f79-af81-e25decf24af3" containerName="authorino" containerID="cri-o://96f5b74770480ac6169326d5163c24f9f5cd4e9c1efbc147812ed0f44d3bd5d3" gracePeriod=30 Jul 14 11:24:46.629041 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:46.628981 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-q8ptn" Jul 14 11:24:46.725608 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:46.725574 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdmcl\" (UniqueName: \"kubernetes.io/projected/026b7b4f-39d7-4f79-af81-e25decf24af3-kube-api-access-sdmcl\") pod \"026b7b4f-39d7-4f79-af81-e25decf24af3\" (UID: \"026b7b4f-39d7-4f79-af81-e25decf24af3\") " Jul 14 11:24:46.727725 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:46.727693 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/026b7b4f-39d7-4f79-af81-e25decf24af3-kube-api-access-sdmcl" (OuterVolumeSpecName: "kube-api-access-sdmcl") pod "026b7b4f-39d7-4f79-af81-e25decf24af3" (UID: "026b7b4f-39d7-4f79-af81-e25decf24af3"). InnerVolumeSpecName "kube-api-access-sdmcl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:24:46.826833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:46.826783 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdmcl\" (UniqueName: \"kubernetes.io/projected/026b7b4f-39d7-4f79-af81-e25decf24af3-kube-api-access-sdmcl\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:24:47.383028 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:47.382995 2561 generic.go:356] "Generic (PLEG): container finished" podID="026b7b4f-39d7-4f79-af81-e25decf24af3" containerID="96f5b74770480ac6169326d5163c24f9f5cd4e9c1efbc147812ed0f44d3bd5d3" exitCode=0 Jul 14 11:24:47.383497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:47.383048 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-q8ptn" Jul 14 11:24:47.383497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:47.383067 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-q8ptn" event={"ID":"026b7b4f-39d7-4f79-af81-e25decf24af3","Type":"ContainerDied","Data":"96f5b74770480ac6169326d5163c24f9f5cd4e9c1efbc147812ed0f44d3bd5d3"} Jul 14 11:24:47.383497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:47.383109 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-q8ptn" event={"ID":"026b7b4f-39d7-4f79-af81-e25decf24af3","Type":"ContainerDied","Data":"6e02269e8534cc03bff20e7b6016221c5e32f58efa5c4dad8eac6487ec40bcd2"} Jul 14 11:24:47.383497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:47.383133 2561 scope.go:117] "RemoveContainer" containerID="96f5b74770480ac6169326d5163c24f9f5cd4e9c1efbc147812ed0f44d3bd5d3" Jul 14 11:24:47.394502 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:47.394475 2561 scope.go:117] "RemoveContainer" containerID="96f5b74770480ac6169326d5163c24f9f5cd4e9c1efbc147812ed0f44d3bd5d3" Jul 14 11:24:47.394855 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:24:47.394836 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96f5b74770480ac6169326d5163c24f9f5cd4e9c1efbc147812ed0f44d3bd5d3\": container with ID starting with 96f5b74770480ac6169326d5163c24f9f5cd4e9c1efbc147812ed0f44d3bd5d3 not found: ID does not exist" containerID="96f5b74770480ac6169326d5163c24f9f5cd4e9c1efbc147812ed0f44d3bd5d3" Jul 14 11:24:47.394919 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:47.394864 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96f5b74770480ac6169326d5163c24f9f5cd4e9c1efbc147812ed0f44d3bd5d3"} err="failed to get container status \"96f5b74770480ac6169326d5163c24f9f5cd4e9c1efbc147812ed0f44d3bd5d3\": rpc error: code = NotFound desc = could not find container \"96f5b74770480ac6169326d5163c24f9f5cd4e9c1efbc147812ed0f44d3bd5d3\": container with ID starting with 96f5b74770480ac6169326d5163c24f9f5cd4e9c1efbc147812ed0f44d3bd5d3 not found: ID does not exist" Jul 14 11:24:47.409147 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:47.409122 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-q8ptn"] Jul 14 11:24:47.410616 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:47.410593 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-q8ptn"] Jul 14 11:24:48.303420 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:48.303386 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="026b7b4f-39d7-4f79-af81-e25decf24af3" path="/var/lib/kubelet/pods/026b7b4f-39d7-4f79-af81-e25decf24af3/volumes" Jul 14 11:24:59.740612 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:59.740578 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:24:59.840860 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:24:59.840823 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:25:00.244955 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:00.244925 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:25:12.629584 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:12.629543 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:25:12.855383 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:12.855349 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2gbjj"] Jul 14 11:25:12.855713 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:12.855699 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="026b7b4f-39d7-4f79-af81-e25decf24af3" containerName="authorino" Jul 14 11:25:12.855775 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:12.855715 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="026b7b4f-39d7-4f79-af81-e25decf24af3" containerName="authorino" Jul 14 11:25:12.855833 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:12.855792 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="026b7b4f-39d7-4f79-af81-e25decf24af3" containerName="authorino" Jul 14 11:25:12.859279 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:12.859257 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2gbjj" Jul 14 11:25:12.864900 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:12.864873 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2gbjj"] Jul 14 11:25:12.960121 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:12.960027 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6kv2\" (UniqueName: \"kubernetes.io/projected/9e2bab23-064d-468f-bce9-8c9e5ee3e158-kube-api-access-l6kv2\") pod \"authorino-5d4b67c446-2gbjj\" (UID: \"9e2bab23-064d-468f-bce9-8c9e5ee3e158\") " pod="kuadrant-system/authorino-5d4b67c446-2gbjj" Jul 14 11:25:13.061116 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.061059 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6kv2\" (UniqueName: \"kubernetes.io/projected/9e2bab23-064d-468f-bce9-8c9e5ee3e158-kube-api-access-l6kv2\") pod \"authorino-5d4b67c446-2gbjj\" (UID: \"9e2bab23-064d-468f-bce9-8c9e5ee3e158\") " pod="kuadrant-system/authorino-5d4b67c446-2gbjj" Jul 14 11:25:13.069960 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.069930 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6kv2\" (UniqueName: \"kubernetes.io/projected/9e2bab23-064d-468f-bce9-8c9e5ee3e158-kube-api-access-l6kv2\") pod \"authorino-5d4b67c446-2gbjj\" (UID: \"9e2bab23-064d-468f-bce9-8c9e5ee3e158\") " pod="kuadrant-system/authorino-5d4b67c446-2gbjj" Jul 14 11:25:13.099933 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.099902 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2gbjj"] Jul 14 11:25:13.100177 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.100158 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2gbjj" Jul 14 11:25:13.132580 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.132539 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b65bb474-kd2rt"] Jul 14 11:25:13.136913 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.136885 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b65bb474-kd2rt" Jul 14 11:25:13.144021 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.143962 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b65bb474-kd2rt"] Jul 14 11:25:13.249117 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.249091 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2gbjj"] Jul 14 11:25:13.251613 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:25:13.251587 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e2bab23_064d_468f_bce9_8c9e5ee3e158.slice/crio-478476adb20264bd4965d356292df1c6674fb8f7acd680dc1579bf9412ea839f WatchSource:0}: Error finding container 478476adb20264bd4965d356292df1c6674fb8f7acd680dc1579bf9412ea839f: Status 404 returned error can't find the container with id 478476adb20264bd4965d356292df1c6674fb8f7acd680dc1579bf9412ea839f Jul 14 11:25:13.263508 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.263485 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v4j4\" (UniqueName: \"kubernetes.io/projected/45de1839-515f-4a86-afa0-12daf5caf1b2-kube-api-access-7v4j4\") pod \"authorino-b65bb474-kd2rt\" (UID: \"45de1839-515f-4a86-afa0-12daf5caf1b2\") " pod="kuadrant-system/authorino-b65bb474-kd2rt" Jul 14 11:25:13.281843 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.281813 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:25:13.364471 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.364441 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v4j4\" (UniqueName: \"kubernetes.io/projected/45de1839-515f-4a86-afa0-12daf5caf1b2-kube-api-access-7v4j4\") pod \"authorino-b65bb474-kd2rt\" (UID: \"45de1839-515f-4a86-afa0-12daf5caf1b2\") " pod="kuadrant-system/authorino-b65bb474-kd2rt" Jul 14 11:25:13.373841 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.373811 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v4j4\" (UniqueName: \"kubernetes.io/projected/45de1839-515f-4a86-afa0-12daf5caf1b2-kube-api-access-7v4j4\") pod \"authorino-b65bb474-kd2rt\" (UID: \"45de1839-515f-4a86-afa0-12daf5caf1b2\") " pod="kuadrant-system/authorino-b65bb474-kd2rt" Jul 14 11:25:13.449608 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.449568 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b65bb474-kd2rt" Jul 14 11:25:13.507761 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.507726 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2gbjj" event={"ID":"9e2bab23-064d-468f-bce9-8c9e5ee3e158","Type":"ContainerStarted","Data":"478476adb20264bd4965d356292df1c6674fb8f7acd680dc1579bf9412ea839f"} Jul 14 11:25:13.573930 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.573899 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b65bb474-kd2rt"] Jul 14 11:25:13.586611 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.586577 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b65bb474-kd2rt"] Jul 14 11:25:13.589370 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:25:13.589343 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45de1839_515f_4a86_afa0_12daf5caf1b2.slice/crio-a9ff0fee74c12508eb29cc7d6e8b3e7f5286330dc1326d0f75abd834dc07f228 WatchSource:0}: Error finding container a9ff0fee74c12508eb29cc7d6e8b3e7f5286330dc1326d0f75abd834dc07f228: Status 404 returned error can't find the container with id a9ff0fee74c12508eb29cc7d6e8b3e7f5286330dc1326d0f75abd834dc07f228 Jul 14 11:25:13.611617 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.611588 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86b9779cd-wcgjc"] Jul 14 11:25:13.616279 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.616258 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b9779cd-wcgjc" Jul 14 11:25:13.619593 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.619561 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 14 11:25:13.627600 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.627579 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86b9779cd-wcgjc"] Jul 14 11:25:13.768230 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.768113 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x4rz\" (UniqueName: \"kubernetes.io/projected/91e95fbb-8f65-400b-b34b-61c65b1aad8e-kube-api-access-9x4rz\") pod \"authorino-86b9779cd-wcgjc\" (UID: \"91e95fbb-8f65-400b-b34b-61c65b1aad8e\") " pod="kuadrant-system/authorino-86b9779cd-wcgjc" Jul 14 11:25:13.768230 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.768176 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/91e95fbb-8f65-400b-b34b-61c65b1aad8e-tls-cert\") pod \"authorino-86b9779cd-wcgjc\" (UID: \"91e95fbb-8f65-400b-b34b-61c65b1aad8e\") " pod="kuadrant-system/authorino-86b9779cd-wcgjc" Jul 14 11:25:13.868975 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.868939 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x4rz\" (UniqueName: \"kubernetes.io/projected/91e95fbb-8f65-400b-b34b-61c65b1aad8e-kube-api-access-9x4rz\") pod \"authorino-86b9779cd-wcgjc\" (UID: \"91e95fbb-8f65-400b-b34b-61c65b1aad8e\") " pod="kuadrant-system/authorino-86b9779cd-wcgjc" Jul 14 11:25:13.869169 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.868992 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/91e95fbb-8f65-400b-b34b-61c65b1aad8e-tls-cert\") pod \"authorino-86b9779cd-wcgjc\" (UID: \"91e95fbb-8f65-400b-b34b-61c65b1aad8e\") " pod="kuadrant-system/authorino-86b9779cd-wcgjc" Jul 14 11:25:13.871501 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.871480 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/91e95fbb-8f65-400b-b34b-61c65b1aad8e-tls-cert\") pod \"authorino-86b9779cd-wcgjc\" (UID: \"91e95fbb-8f65-400b-b34b-61c65b1aad8e\") " pod="kuadrant-system/authorino-86b9779cd-wcgjc" Jul 14 11:25:13.880769 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.880741 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x4rz\" (UniqueName: \"kubernetes.io/projected/91e95fbb-8f65-400b-b34b-61c65b1aad8e-kube-api-access-9x4rz\") pod \"authorino-86b9779cd-wcgjc\" (UID: \"91e95fbb-8f65-400b-b34b-61c65b1aad8e\") " pod="kuadrant-system/authorino-86b9779cd-wcgjc" Jul 14 11:25:13.925730 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:13.925689 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b9779cd-wcgjc" Jul 14 11:25:14.066159 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.065989 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86b9779cd-wcgjc"] Jul 14 11:25:14.068340 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:25:14.068311 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91e95fbb_8f65_400b_b34b_61c65b1aad8e.slice/crio-b870031006037781e5e088d5ff7674b74f300c79cda182a167ec104114ef17d0 WatchSource:0}: Error finding container b870031006037781e5e088d5ff7674b74f300c79cda182a167ec104114ef17d0: Status 404 returned error can't find the container with id b870031006037781e5e088d5ff7674b74f300c79cda182a167ec104114ef17d0 Jul 14 11:25:14.518610 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.518571 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-2gbjj" podUID="9e2bab23-064d-468f-bce9-8c9e5ee3e158" containerName="authorino" containerID="cri-o://03ee28396831c67318bc13e0d7fa48f36391144b87bedf3487c63f483c8192d0" gracePeriod=30 Jul 14 11:25:14.519026 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.518880 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2gbjj" event={"ID":"9e2bab23-064d-468f-bce9-8c9e5ee3e158","Type":"ContainerStarted","Data":"03ee28396831c67318bc13e0d7fa48f36391144b87bedf3487c63f483c8192d0"} Jul 14 11:25:14.520773 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.520742 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b9779cd-wcgjc" event={"ID":"91e95fbb-8f65-400b-b34b-61c65b1aad8e","Type":"ContainerStarted","Data":"9ea7ec7d95c8c995da5d8a167256ee1e1fe39c5511edababa676cfa6e14568df"} Jul 14 11:25:14.520875 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.520787 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b9779cd-wcgjc" event={"ID":"91e95fbb-8f65-400b-b34b-61c65b1aad8e","Type":"ContainerStarted","Data":"b870031006037781e5e088d5ff7674b74f300c79cda182a167ec104114ef17d0"} Jul 14 11:25:14.522795 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.522766 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b65bb474-kd2rt" event={"ID":"45de1839-515f-4a86-afa0-12daf5caf1b2","Type":"ContainerStarted","Data":"78e9da7e4e2d58a144749e7229c3184db55d3c480468b6452b2fef52568d774c"} Jul 14 11:25:14.522905 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.522807 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b65bb474-kd2rt" event={"ID":"45de1839-515f-4a86-afa0-12daf5caf1b2","Type":"ContainerStarted","Data":"a9ff0fee74c12508eb29cc7d6e8b3e7f5286330dc1326d0f75abd834dc07f228"} Jul 14 11:25:14.523046 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.522968 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b65bb474-kd2rt" podUID="45de1839-515f-4a86-afa0-12daf5caf1b2" containerName="authorino" containerID="cri-o://78e9da7e4e2d58a144749e7229c3184db55d3c480468b6452b2fef52568d774c" gracePeriod=30 Jul 14 11:25:14.538105 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.538053 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-2gbjj" podStartSLOduration=2.11263809 podStartE2EDuration="2.538034441s" totalImagesPullingTime="425.396351ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:25:14.535747359 +0000 UTC m=+832.861111891" watchObservedRunningTime="2026-07-14 11:25:14.538034441 +0000 UTC m=+832.863399342" Jul 14 11:25:14.554538 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.554488 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-86b9779cd-wcgjc" podStartSLOduration=1.242586858 podStartE2EDuration="1.554471641s" totalImagesPullingTime="311.884783ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:25:14.553161962 +0000 UTC m=+832.878526494" watchObservedRunningTime="2026-07-14 11:25:14.554471641 +0000 UTC m=+832.879836186" Jul 14 11:25:14.567088 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.567027 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b65bb474-kd2rt" podStartSLOduration=1.199841435 podStartE2EDuration="1.566997083s" totalImagesPullingTime="367.155648ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:25:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:25:14.566942031 +0000 UTC m=+832.892306565" watchObservedRunningTime="2026-07-14 11:25:14.566997083 +0000 UTC m=+832.892361621" Jul 14 11:25:14.587518 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.587482 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dtqpb"] Jul 14 11:25:14.587724 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.587699 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-dtqpb" podUID="b77b0579-2d46-40be-87bb-c5a8a907991f" containerName="authorino" containerID="cri-o://ce25a83fb2571a639d5a3fc5234454fd693a75bfaf485c04a744bce35abce8fc" gracePeriod=30 Jul 14 11:25:14.825299 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.825272 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2gbjj" Jul 14 11:25:14.867235 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.867177 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dtqpb" Jul 14 11:25:14.900050 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.900023 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b65bb474-kd2rt" Jul 14 11:25:14.978545 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.978462 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6kv2\" (UniqueName: \"kubernetes.io/projected/9e2bab23-064d-468f-bce9-8c9e5ee3e158-kube-api-access-l6kv2\") pod \"9e2bab23-064d-468f-bce9-8c9e5ee3e158\" (UID: \"9e2bab23-064d-468f-bce9-8c9e5ee3e158\") " Jul 14 11:25:14.978545 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.978525 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njkwm\" (UniqueName: \"kubernetes.io/projected/b77b0579-2d46-40be-87bb-c5a8a907991f-kube-api-access-njkwm\") pod \"b77b0579-2d46-40be-87bb-c5a8a907991f\" (UID: \"b77b0579-2d46-40be-87bb-c5a8a907991f\") " Jul 14 11:25:14.980551 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.980521 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e2bab23-064d-468f-bce9-8c9e5ee3e158-kube-api-access-l6kv2" (OuterVolumeSpecName: "kube-api-access-l6kv2") pod "9e2bab23-064d-468f-bce9-8c9e5ee3e158" (UID: "9e2bab23-064d-468f-bce9-8c9e5ee3e158"). InnerVolumeSpecName "kube-api-access-l6kv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:25:14.980551 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:14.980539 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b77b0579-2d46-40be-87bb-c5a8a907991f-kube-api-access-njkwm" (OuterVolumeSpecName: "kube-api-access-njkwm") pod "b77b0579-2d46-40be-87bb-c5a8a907991f" (UID: "b77b0579-2d46-40be-87bb-c5a8a907991f"). InnerVolumeSpecName "kube-api-access-njkwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:25:15.079344 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.079311 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v4j4\" (UniqueName: \"kubernetes.io/projected/45de1839-515f-4a86-afa0-12daf5caf1b2-kube-api-access-7v4j4\") pod \"45de1839-515f-4a86-afa0-12daf5caf1b2\" (UID: \"45de1839-515f-4a86-afa0-12daf5caf1b2\") " Jul 14 11:25:15.079600 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.079572 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njkwm\" (UniqueName: \"kubernetes.io/projected/b77b0579-2d46-40be-87bb-c5a8a907991f-kube-api-access-njkwm\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:25:15.079600 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.079594 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6kv2\" (UniqueName: \"kubernetes.io/projected/9e2bab23-064d-468f-bce9-8c9e5ee3e158-kube-api-access-l6kv2\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:25:15.081492 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.081465 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45de1839-515f-4a86-afa0-12daf5caf1b2-kube-api-access-7v4j4" (OuterVolumeSpecName: "kube-api-access-7v4j4") pod "45de1839-515f-4a86-afa0-12daf5caf1b2" (UID: "45de1839-515f-4a86-afa0-12daf5caf1b2"). InnerVolumeSpecName "kube-api-access-7v4j4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:25:15.180943 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.180904 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v4j4\" (UniqueName: \"kubernetes.io/projected/45de1839-515f-4a86-afa0-12daf5caf1b2-kube-api-access-7v4j4\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:25:15.528245 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.528185 2561 generic.go:356] "Generic (PLEG): container finished" podID="b77b0579-2d46-40be-87bb-c5a8a907991f" containerID="ce25a83fb2571a639d5a3fc5234454fd693a75bfaf485c04a744bce35abce8fc" exitCode=0 Jul 14 11:25:15.528440 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.528254 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dtqpb" Jul 14 11:25:15.528440 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.528273 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dtqpb" event={"ID":"b77b0579-2d46-40be-87bb-c5a8a907991f","Type":"ContainerDied","Data":"ce25a83fb2571a639d5a3fc5234454fd693a75bfaf485c04a744bce35abce8fc"} Jul 14 11:25:15.528440 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.528313 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dtqpb" event={"ID":"b77b0579-2d46-40be-87bb-c5a8a907991f","Type":"ContainerDied","Data":"dccf7d695fa2bd09ffe138c00e7f7b3ce259b28d57eb4d7e149934295987b14e"} Jul 14 11:25:15.528440 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.528331 2561 scope.go:117] "RemoveContainer" containerID="ce25a83fb2571a639d5a3fc5234454fd693a75bfaf485c04a744bce35abce8fc" Jul 14 11:25:15.529822 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.529504 2561 generic.go:356] "Generic (PLEG): container finished" podID="9e2bab23-064d-468f-bce9-8c9e5ee3e158" containerID="03ee28396831c67318bc13e0d7fa48f36391144b87bedf3487c63f483c8192d0" exitCode=0 Jul 14 11:25:15.529822 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.529544 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2gbjj" Jul 14 11:25:15.529822 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.529573 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2gbjj" event={"ID":"9e2bab23-064d-468f-bce9-8c9e5ee3e158","Type":"ContainerDied","Data":"03ee28396831c67318bc13e0d7fa48f36391144b87bedf3487c63f483c8192d0"} Jul 14 11:25:15.529822 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.529602 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2gbjj" event={"ID":"9e2bab23-064d-468f-bce9-8c9e5ee3e158","Type":"ContainerDied","Data":"478476adb20264bd4965d356292df1c6674fb8f7acd680dc1579bf9412ea839f"} Jul 14 11:25:15.530942 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.530917 2561 generic.go:356] "Generic (PLEG): container finished" podID="45de1839-515f-4a86-afa0-12daf5caf1b2" containerID="78e9da7e4e2d58a144749e7229c3184db55d3c480468b6452b2fef52568d774c" exitCode=0 Jul 14 11:25:15.531052 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.530950 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b65bb474-kd2rt" event={"ID":"45de1839-515f-4a86-afa0-12daf5caf1b2","Type":"ContainerDied","Data":"78e9da7e4e2d58a144749e7229c3184db55d3c480468b6452b2fef52568d774c"} Jul 14 11:25:15.531052 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.530985 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b65bb474-kd2rt" event={"ID":"45de1839-515f-4a86-afa0-12daf5caf1b2","Type":"ContainerDied","Data":"a9ff0fee74c12508eb29cc7d6e8b3e7f5286330dc1326d0f75abd834dc07f228"} Jul 14 11:25:15.531052 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.530959 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b65bb474-kd2rt" Jul 14 11:25:15.537762 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.537743 2561 scope.go:117] "RemoveContainer" containerID="ce25a83fb2571a639d5a3fc5234454fd693a75bfaf485c04a744bce35abce8fc" Jul 14 11:25:15.537989 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:25:15.537971 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce25a83fb2571a639d5a3fc5234454fd693a75bfaf485c04a744bce35abce8fc\": container with ID starting with ce25a83fb2571a639d5a3fc5234454fd693a75bfaf485c04a744bce35abce8fc not found: ID does not exist" containerID="ce25a83fb2571a639d5a3fc5234454fd693a75bfaf485c04a744bce35abce8fc" Jul 14 11:25:15.538060 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.537996 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce25a83fb2571a639d5a3fc5234454fd693a75bfaf485c04a744bce35abce8fc"} err="failed to get container status \"ce25a83fb2571a639d5a3fc5234454fd693a75bfaf485c04a744bce35abce8fc\": rpc error: code = NotFound desc = could not find container \"ce25a83fb2571a639d5a3fc5234454fd693a75bfaf485c04a744bce35abce8fc\": container with ID starting with ce25a83fb2571a639d5a3fc5234454fd693a75bfaf485c04a744bce35abce8fc not found: ID does not exist" Jul 14 11:25:15.538060 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.538010 2561 scope.go:117] "RemoveContainer" containerID="03ee28396831c67318bc13e0d7fa48f36391144b87bedf3487c63f483c8192d0" Jul 14 11:25:15.546455 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.546435 2561 scope.go:117] "RemoveContainer" containerID="03ee28396831c67318bc13e0d7fa48f36391144b87bedf3487c63f483c8192d0" Jul 14 11:25:15.546691 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:25:15.546673 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03ee28396831c67318bc13e0d7fa48f36391144b87bedf3487c63f483c8192d0\": container with ID starting with 03ee28396831c67318bc13e0d7fa48f36391144b87bedf3487c63f483c8192d0 not found: ID does not exist" containerID="03ee28396831c67318bc13e0d7fa48f36391144b87bedf3487c63f483c8192d0" Jul 14 11:25:15.546749 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.546698 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ee28396831c67318bc13e0d7fa48f36391144b87bedf3487c63f483c8192d0"} err="failed to get container status \"03ee28396831c67318bc13e0d7fa48f36391144b87bedf3487c63f483c8192d0\": rpc error: code = NotFound desc = could not find container \"03ee28396831c67318bc13e0d7fa48f36391144b87bedf3487c63f483c8192d0\": container with ID starting with 03ee28396831c67318bc13e0d7fa48f36391144b87bedf3487c63f483c8192d0 not found: ID does not exist" Jul 14 11:25:15.546749 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.546713 2561 scope.go:117] "RemoveContainer" containerID="78e9da7e4e2d58a144749e7229c3184db55d3c480468b6452b2fef52568d774c" Jul 14 11:25:15.554130 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.554111 2561 scope.go:117] "RemoveContainer" containerID="78e9da7e4e2d58a144749e7229c3184db55d3c480468b6452b2fef52568d774c" Jul 14 11:25:15.554403 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:25:15.554384 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78e9da7e4e2d58a144749e7229c3184db55d3c480468b6452b2fef52568d774c\": container with ID starting with 78e9da7e4e2d58a144749e7229c3184db55d3c480468b6452b2fef52568d774c not found: ID does not exist" containerID="78e9da7e4e2d58a144749e7229c3184db55d3c480468b6452b2fef52568d774c" Jul 14 11:25:15.554487 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.554408 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78e9da7e4e2d58a144749e7229c3184db55d3c480468b6452b2fef52568d774c"} err="failed to get container status \"78e9da7e4e2d58a144749e7229c3184db55d3c480468b6452b2fef52568d774c\": rpc error: code = NotFound desc = could not find container \"78e9da7e4e2d58a144749e7229c3184db55d3c480468b6452b2fef52568d774c\": container with ID starting with 78e9da7e4e2d58a144749e7229c3184db55d3c480468b6452b2fef52568d774c not found: ID does not exist" Jul 14 11:25:15.555559 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.555537 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dtqpb"] Jul 14 11:25:15.560100 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.560075 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dtqpb"] Jul 14 11:25:15.571571 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.571529 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2gbjj"] Jul 14 11:25:15.574226 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.574183 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2gbjj"] Jul 14 11:25:15.591264 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.591215 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b65bb474-kd2rt"] Jul 14 11:25:15.595264 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:15.595231 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b65bb474-kd2rt"] Jul 14 11:25:16.303947 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:16.303917 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45de1839-515f-4a86-afa0-12daf5caf1b2" path="/var/lib/kubelet/pods/45de1839-515f-4a86-afa0-12daf5caf1b2/volumes" Jul 14 11:25:16.304362 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:16.304256 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e2bab23-064d-468f-bce9-8c9e5ee3e158" path="/var/lib/kubelet/pods/9e2bab23-064d-468f-bce9-8c9e5ee3e158/volumes" Jul 14 11:25:16.304547 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:16.304534 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b77b0579-2d46-40be-87bb-c5a8a907991f" path="/var/lib/kubelet/pods/b77b0579-2d46-40be-87bb-c5a8a907991f/volumes" Jul 14 11:25:19.337472 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:19.337442 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:25:19.438436 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:19.438383 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:25:19.535518 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:19.535463 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:25:19.622358 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:19.622265 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:25:22.532263 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:22.532197 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:25:22.627531 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:22.627492 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:25:55.036138 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:55.036105 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:25:55.136414 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:55.136376 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:25:55.530328 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:55.530295 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:25:55.669490 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:55.669449 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:25:56.044539 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:56.044508 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:25:56.117725 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:25:56.117690 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:26:06.160396 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:06.160361 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:26:06.258794 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:06.258762 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:26:15.887905 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:15.887870 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:26:15.982755 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:15.982717 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:26:22.150449 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:22.150419 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-rj5j5_dc7acf92-5cb9-48e3-8901-75e719e72682/cluster-monitoring-operator/0.log" Jul 14 11:26:22.152313 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:22.152295 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-rj5j5_dc7acf92-5cb9-48e3-8901-75e719e72682/cluster-monitoring-operator/0.log" Jul 14 11:26:22.152564 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:22.152549 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvxhc_26b43cc7-353e-42f8-ac60-29fb5bd6c510/console-operator/1.log" Jul 14 11:26:22.154256 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:22.154237 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvxhc_26b43cc7-353e-42f8-ac60-29fb5bd6c510/console-operator/1.log" Jul 14 11:26:22.158560 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:22.158544 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f7fw_9309eb9c-300d-4840-a58f-2c93d2c41bfe/ovn-acl-logging/0.log" Jul 14 11:26:22.160054 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:22.160036 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f7fw_9309eb9c-300d-4840-a58f-2c93d2c41bfe/ovn-acl-logging/0.log" Jul 14 11:26:23.765113 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.765079 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb"] Jul 14 11:26:23.767508 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.765526 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45de1839-515f-4a86-afa0-12daf5caf1b2" containerName="authorino" Jul 14 11:26:23.767508 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.765543 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="45de1839-515f-4a86-afa0-12daf5caf1b2" containerName="authorino" Jul 14 11:26:23.767508 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.765565 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e2bab23-064d-468f-bce9-8c9e5ee3e158" containerName="authorino" Jul 14 11:26:23.767508 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.765571 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e2bab23-064d-468f-bce9-8c9e5ee3e158" containerName="authorino" Jul 14 11:26:23.767508 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.765586 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b77b0579-2d46-40be-87bb-c5a8a907991f" containerName="authorino" Jul 14 11:26:23.767508 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.765592 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b77b0579-2d46-40be-87bb-c5a8a907991f" containerName="authorino" Jul 14 11:26:23.767508 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.765649 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="45de1839-515f-4a86-afa0-12daf5caf1b2" containerName="authorino" Jul 14 11:26:23.767508 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.765657 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b77b0579-2d46-40be-87bb-c5a8a907991f" containerName="authorino" Jul 14 11:26:23.767508 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.765663 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e2bab23-064d-468f-bce9-8c9e5ee3e158" containerName="authorino" Jul 14 11:26:23.768424 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.768406 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.772100 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.772080 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 14 11:26:23.773006 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.772991 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 11:26:23.773099 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.773019 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 11:26:23.773329 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.773313 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nlg7b\"" Jul 14 11:26:23.798824 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.793667 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb"] Jul 14 11:26:23.799902 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.799733 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:26:23.895232 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.895170 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dcs6\" (UniqueName: \"kubernetes.io/projected/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-kube-api-access-9dcs6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.895416 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.895280 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.895416 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.895350 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.895416 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.895371 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.895416 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.895394 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.895416 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.895414 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.996269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.996235 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dcs6\" (UniqueName: \"kubernetes.io/projected/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-kube-api-access-9dcs6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.996460 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.996287 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.996460 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.996316 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.996460 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.996335 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.996460 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.996355 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.996460 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.996372 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.996826 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.996805 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.996888 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.996861 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.996925 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.996873 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.998787 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.998764 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:23.999067 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:23.999046 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:24.005522 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:24.005496 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dcs6\" (UniqueName: \"kubernetes.io/projected/d82be5f2-0f51-4ed7-9b9f-17305f2ac77e-kube-api-access-9dcs6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb\" (UID: \"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:24.079145 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:24.079049 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:24.223535 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:24.223505 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb"] Jul 14 11:26:24.225452 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:26:24.225423 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82be5f2_0f51_4ed7_9b9f_17305f2ac77e.slice/crio-1f472478e488cb4f8443413e66310242e432fe6fc23538cda146db7a48773b84 WatchSource:0}: Error finding container 1f472478e488cb4f8443413e66310242e432fe6fc23538cda146db7a48773b84: Status 404 returned error can't find the container with id 1f472478e488cb4f8443413e66310242e432fe6fc23538cda146db7a48773b84 Jul 14 11:26:24.858069 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:24.858028 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" event={"ID":"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e","Type":"ContainerStarted","Data":"1f472478e488cb4f8443413e66310242e432fe6fc23538cda146db7a48773b84"} Jul 14 11:26:25.863431 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:25.863396 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" event={"ID":"d82be5f2-0f51-4ed7-9b9f-17305f2ac77e","Type":"ContainerStarted","Data":"a2d39127667d67e52a0c2c0d4276b004d042cf971dc0f1abb86f7c332e2e0ed2"} Jul 14 11:26:25.897884 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:25.897831 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" podStartSLOduration=1.701690863 podStartE2EDuration="2.897815668s" totalImagesPullingTime="1.196124805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:26:25.897055639 +0000 UTC m=+904.222420189" watchObservedRunningTime="2026-07-14 11:26:25.897815668 +0000 UTC m=+904.223180199" Jul 14 11:26:33.141866 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:33.141832 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:26:34.079873 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:34.079817 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:34.080218 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:34.080188 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:34.092736 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:34.092700 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:34.917945 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:34.917918 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb" Jul 14 11:26:38.136348 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:38.136318 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:26:49.071615 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:26:49.071579 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:27:04.810491 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:04.810457 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:27:08.938328 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:08.938292 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d"] Jul 14 11:27:08.945298 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:08.945272 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:08.948576 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:08.948555 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 14 11:27:08.956415 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:08.956387 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d"] Jul 14 11:27:08.984940 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:08.984911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36b85b60-6544-4707-9888-dbffdf2543cc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:08.985088 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:08.984959 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36b85b60-6544-4707-9888-dbffdf2543cc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:08.985088 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:08.985043 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36b85b60-6544-4707-9888-dbffdf2543cc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:08.985088 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:08.985069 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36b85b60-6544-4707-9888-dbffdf2543cc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:08.985088 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:08.985085 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36b85b60-6544-4707-9888-dbffdf2543cc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:08.985273 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:08.985109 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmpzx\" (UniqueName: \"kubernetes.io/projected/36b85b60-6544-4707-9888-dbffdf2543cc-kube-api-access-wmpzx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:08.997606 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:08.997575 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:27:09.086373 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:09.086336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36b85b60-6544-4707-9888-dbffdf2543cc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:09.086565 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:09.086386 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36b85b60-6544-4707-9888-dbffdf2543cc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:09.086565 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:09.086429 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36b85b60-6544-4707-9888-dbffdf2543cc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:09.086565 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:09.086455 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36b85b60-6544-4707-9888-dbffdf2543cc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:09.086565 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:09.086471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36b85b60-6544-4707-9888-dbffdf2543cc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:09.086565 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:09.086494 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmpzx\" (UniqueName: \"kubernetes.io/projected/36b85b60-6544-4707-9888-dbffdf2543cc-kube-api-access-wmpzx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:09.086938 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:09.086899 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36b85b60-6544-4707-9888-dbffdf2543cc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:09.086938 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:09.086937 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36b85b60-6544-4707-9888-dbffdf2543cc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:09.086938 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:09.086911 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36b85b60-6544-4707-9888-dbffdf2543cc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:09.088807 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:09.088778 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36b85b60-6544-4707-9888-dbffdf2543cc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:09.089084 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:09.089062 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36b85b60-6544-4707-9888-dbffdf2543cc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:09.094501 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:09.094479 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmpzx\" (UniqueName: \"kubernetes.io/projected/36b85b60-6544-4707-9888-dbffdf2543cc-kube-api-access-wmpzx\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6kv7d\" (UID: \"36b85b60-6544-4707-9888-dbffdf2543cc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:09.255801 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:09.255763 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:09.393066 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:09.393041 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d"] Jul 14 11:27:09.394296 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:27:09.394270 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b85b60_6544_4707_9888_dbffdf2543cc.slice/crio-3230e919075bdeffad5ad1c577a18d8fcd1f2bc9f890c503e27714187c05e22f WatchSource:0}: Error finding container 3230e919075bdeffad5ad1c577a18d8fcd1f2bc9f890c503e27714187c05e22f: Status 404 returned error can't find the container with id 3230e919075bdeffad5ad1c577a18d8fcd1f2bc9f890c503e27714187c05e22f Jul 14 11:27:09.395664 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:09.395647 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 11:27:10.070057 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:10.068582 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" event={"ID":"36b85b60-6544-4707-9888-dbffdf2543cc","Type":"ContainerStarted","Data":"662065729f6ca2332f754e019400371e628811afe8d96dfe6a70e3f464ef39b3"} Jul 14 11:27:10.070057 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:10.068651 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" event={"ID":"36b85b60-6544-4707-9888-dbffdf2543cc","Type":"ContainerStarted","Data":"3230e919075bdeffad5ad1c577a18d8fcd1f2bc9f890c503e27714187c05e22f"} Jul 14 11:27:10.089793 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:10.089545 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" podStartSLOduration=1.847756674 podStartE2EDuration="2.08952265s" totalImagesPullingTime="241.765976ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:27:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:27:10.089317784 +0000 UTC m=+948.414682317" watchObservedRunningTime="2026-07-14 11:27:10.08952265 +0000 UTC m=+948.414887182" Jul 14 11:27:19.256391 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:19.256350 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:19.256834 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:19.256431 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:19.269002 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:19.268975 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:20.128386 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:20.128357 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6kv7d" Jul 14 11:27:20.892286 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:20.892254 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww"] Jul 14 11:27:20.895658 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:20.895640 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:20.899269 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:20.899247 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 14 11:27:20.907285 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:20.907260 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww"] Jul 14 11:27:20.949651 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:20.949607 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:27:20.995830 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:20.995787 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:20.995830 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:20.995832 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:20.996078 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:20.995933 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:20.996078 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:20.995957 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:20.996078 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:20.995993 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:20.996182 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:20.996077 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9qwq\" (UniqueName: \"kubernetes.io/projected/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-kube-api-access-j9qwq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:21.097376 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:21.097342 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:21.097567 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:21.097391 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9qwq\" (UniqueName: \"kubernetes.io/projected/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-kube-api-access-j9qwq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:21.097567 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:21.097422 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:21.097567 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:21.097441 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:21.097567 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:21.097505 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:21.097567 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:21.097527 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:21.097804 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:21.097777 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:21.097859 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:21.097838 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:21.097944 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:21.097921 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:21.099753 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:21.099730 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:21.099998 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:21.099981 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:21.106683 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:21.106659 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9qwq\" (UniqueName: \"kubernetes.io/projected/23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d-kube-api-access-j9qwq\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww\" (UID: \"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:21.206378 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:21.206294 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:21.343428 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:21.343400 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww"] Jul 14 11:27:21.345136 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:27:21.345110 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23bb61d9_0f9b_4c25_ab5d_2b6366a6e64d.slice/crio-0820a350a944ccfc65e98c1d39f81fd18da22523d52def34bfaad8f368a3a8f6 WatchSource:0}: Error finding container 0820a350a944ccfc65e98c1d39f81fd18da22523d52def34bfaad8f368a3a8f6: Status 404 returned error can't find the container with id 0820a350a944ccfc65e98c1d39f81fd18da22523d52def34bfaad8f368a3a8f6 Jul 14 11:27:22.127412 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:22.127378 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" event={"ID":"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d","Type":"ContainerStarted","Data":"5cb5e68f4931b4512d1e09ec0d9de264cc714a61412ee1ac94574df1d4ec812c"} Jul 14 11:27:22.127788 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:22.127422 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" event={"ID":"23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d","Type":"ContainerStarted","Data":"0820a350a944ccfc65e98c1d39f81fd18da22523d52def34bfaad8f368a3a8f6"} Jul 14 11:27:22.147669 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:22.147621 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" podStartSLOduration=1.9264790889999999 podStartE2EDuration="2.147606792s" totalImagesPullingTime="221.127703ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:27:22.146179658 +0000 UTC m=+960.471544190" watchObservedRunningTime="2026-07-14 11:27:22.147606792 +0000 UTC m=+960.472971378" Jul 14 11:27:31.207309 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:31.207272 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:31.207755 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:31.207417 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:31.219702 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:31.219679 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:27:32.201440 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:27:32.196443 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww" Jul 14 11:28:05.107415 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:05.107309 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:28:05.171932 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:05.171900 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:28:10.570830 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:10.570772 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:28:10.632417 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:10.632382 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:28:22.913384 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:22.913344 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bc576c98c-48qp6"] Jul 14 11:28:22.916875 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:22.916850 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bc576c98c-48qp6" Jul 14 11:28:22.927378 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:22.926630 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bc576c98c-48qp6"] Jul 14 11:28:23.065231 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:23.065163 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smks2\" (UniqueName: \"kubernetes.io/projected/4b9120fe-2e93-4160-bcee-3c7302f0fa9e-kube-api-access-smks2\") pod \"authorino-6bc576c98c-48qp6\" (UID: \"4b9120fe-2e93-4160-bcee-3c7302f0fa9e\") " pod="kuadrant-system/authorino-6bc576c98c-48qp6" Jul 14 11:28:23.065428 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:23.065240 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9120fe-2e93-4160-bcee-3c7302f0fa9e-tls-cert\") pod \"authorino-6bc576c98c-48qp6\" (UID: \"4b9120fe-2e93-4160-bcee-3c7302f0fa9e\") " pod="kuadrant-system/authorino-6bc576c98c-48qp6" Jul 14 11:28:23.166012 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:23.165925 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smks2\" (UniqueName: \"kubernetes.io/projected/4b9120fe-2e93-4160-bcee-3c7302f0fa9e-kube-api-access-smks2\") pod \"authorino-6bc576c98c-48qp6\" (UID: \"4b9120fe-2e93-4160-bcee-3c7302f0fa9e\") " pod="kuadrant-system/authorino-6bc576c98c-48qp6" Jul 14 11:28:23.166012 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:23.165963 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9120fe-2e93-4160-bcee-3c7302f0fa9e-tls-cert\") pod \"authorino-6bc576c98c-48qp6\" (UID: \"4b9120fe-2e93-4160-bcee-3c7302f0fa9e\") " pod="kuadrant-system/authorino-6bc576c98c-48qp6" Jul 14 11:28:23.168367 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:23.168335 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9120fe-2e93-4160-bcee-3c7302f0fa9e-tls-cert\") pod \"authorino-6bc576c98c-48qp6\" (UID: \"4b9120fe-2e93-4160-bcee-3c7302f0fa9e\") " pod="kuadrant-system/authorino-6bc576c98c-48qp6" Jul 14 11:28:23.182001 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:23.181967 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smks2\" (UniqueName: \"kubernetes.io/projected/4b9120fe-2e93-4160-bcee-3c7302f0fa9e-kube-api-access-smks2\") pod \"authorino-6bc576c98c-48qp6\" (UID: \"4b9120fe-2e93-4160-bcee-3c7302f0fa9e\") " pod="kuadrant-system/authorino-6bc576c98c-48qp6" Jul 14 11:28:23.228630 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:23.228599 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bc576c98c-48qp6" Jul 14 11:28:23.261340 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:23.261294 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:28:23.364926 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:23.364879 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:28:23.381804 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:23.381782 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bc576c98c-48qp6"] Jul 14 11:28:23.384193 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:28:23.384155 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b9120fe_2e93_4160_bcee_3c7302f0fa9e.slice/crio-cf309804aa71b5224b9b324d23689dac066a4b0d8e27b2fef45d9240ac51bc0a WatchSource:0}: Error finding container cf309804aa71b5224b9b324d23689dac066a4b0d8e27b2fef45d9240ac51bc0a: Status 404 returned error can't find the container with id cf309804aa71b5224b9b324d23689dac066a4b0d8e27b2fef45d9240ac51bc0a Jul 14 11:28:23.414921 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:23.414887 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bc576c98c-48qp6" event={"ID":"4b9120fe-2e93-4160-bcee-3c7302f0fa9e","Type":"ContainerStarted","Data":"cf309804aa71b5224b9b324d23689dac066a4b0d8e27b2fef45d9240ac51bc0a"} Jul 14 11:28:24.423469 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:24.423420 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bc576c98c-48qp6" event={"ID":"4b9120fe-2e93-4160-bcee-3c7302f0fa9e","Type":"ContainerStarted","Data":"9186e067879e09d8468da866147b53991e2e617c9e208107e062def5f30f8516"} Jul 14 11:28:24.456364 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:24.456327 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:28:24.489282 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:24.489166 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6bc576c98c-48qp6" podStartSLOduration=2.100787773 podStartE2EDuration="2.489148945s" totalImagesPullingTime="388.361172ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 11:28:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:28:24.486572698 +0000 UTC m=+1022.811937224" watchObservedRunningTime="2026-07-14 11:28:24.489148945 +0000 UTC m=+1022.814513497" Jul 14 11:28:24.539378 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:24.539342 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86b9779cd-wcgjc"] Jul 14 11:28:24.539798 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:24.539767 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-86b9779cd-wcgjc" podUID="91e95fbb-8f65-400b-b34b-61c65b1aad8e" containerName="authorino" containerID="cri-o://9ea7ec7d95c8c995da5d8a167256ee1e1fe39c5511edababa676cfa6e14568df" gracePeriod=30 Jul 14 11:28:24.607160 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:24.607128 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:28:24.811966 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:24.811943 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b9779cd-wcgjc" Jul 14 11:28:24.983936 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:24.983840 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/91e95fbb-8f65-400b-b34b-61c65b1aad8e-tls-cert\") pod \"91e95fbb-8f65-400b-b34b-61c65b1aad8e\" (UID: \"91e95fbb-8f65-400b-b34b-61c65b1aad8e\") " Jul 14 11:28:24.983936 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:24.983928 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x4rz\" (UniqueName: \"kubernetes.io/projected/91e95fbb-8f65-400b-b34b-61c65b1aad8e-kube-api-access-9x4rz\") pod \"91e95fbb-8f65-400b-b34b-61c65b1aad8e\" (UID: \"91e95fbb-8f65-400b-b34b-61c65b1aad8e\") " Jul 14 11:28:24.985999 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:24.985965 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91e95fbb-8f65-400b-b34b-61c65b1aad8e-kube-api-access-9x4rz" (OuterVolumeSpecName: "kube-api-access-9x4rz") pod "91e95fbb-8f65-400b-b34b-61c65b1aad8e" (UID: "91e95fbb-8f65-400b-b34b-61c65b1aad8e"). InnerVolumeSpecName "kube-api-access-9x4rz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 11:28:24.994270 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:24.994229 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91e95fbb-8f65-400b-b34b-61c65b1aad8e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "91e95fbb-8f65-400b-b34b-61c65b1aad8e" (UID: "91e95fbb-8f65-400b-b34b-61c65b1aad8e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 11:28:25.085109 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:25.085074 2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/91e95fbb-8f65-400b-b34b-61c65b1aad8e-tls-cert\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:28:25.085109 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:25.085107 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x4rz\" (UniqueName: \"kubernetes.io/projected/91e95fbb-8f65-400b-b34b-61c65b1aad8e-kube-api-access-9x4rz\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\"" Jul 14 11:28:25.432790 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:25.432751 2561 generic.go:356] "Generic (PLEG): container finished" podID="91e95fbb-8f65-400b-b34b-61c65b1aad8e" containerID="9ea7ec7d95c8c995da5d8a167256ee1e1fe39c5511edababa676cfa6e14568df" exitCode=0 Jul 14 11:28:25.432790 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:25.432792 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b9779cd-wcgjc" Jul 14 11:28:25.433380 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:25.432823 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b9779cd-wcgjc" event={"ID":"91e95fbb-8f65-400b-b34b-61c65b1aad8e","Type":"ContainerDied","Data":"9ea7ec7d95c8c995da5d8a167256ee1e1fe39c5511edababa676cfa6e14568df"} Jul 14 11:28:25.433380 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:25.432859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b9779cd-wcgjc" event={"ID":"91e95fbb-8f65-400b-b34b-61c65b1aad8e","Type":"ContainerDied","Data":"b870031006037781e5e088d5ff7674b74f300c79cda182a167ec104114ef17d0"} Jul 14 11:28:25.433380 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:25.432876 2561 scope.go:117] "RemoveContainer" containerID="9ea7ec7d95c8c995da5d8a167256ee1e1fe39c5511edababa676cfa6e14568df" Jul 14 11:28:25.441897 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:25.441878 2561 scope.go:117] "RemoveContainer" containerID="9ea7ec7d95c8c995da5d8a167256ee1e1fe39c5511edababa676cfa6e14568df" Jul 14 11:28:25.442140 ip-10-0-142-177 kubenswrapper[2561]: E0714 11:28:25.442121 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ea7ec7d95c8c995da5d8a167256ee1e1fe39c5511edababa676cfa6e14568df\": container with ID starting with 9ea7ec7d95c8c995da5d8a167256ee1e1fe39c5511edababa676cfa6e14568df not found: ID does not exist" containerID="9ea7ec7d95c8c995da5d8a167256ee1e1fe39c5511edababa676cfa6e14568df" Jul 14 11:28:25.442237 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:25.442149 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ea7ec7d95c8c995da5d8a167256ee1e1fe39c5511edababa676cfa6e14568df"} err="failed to get container status \"9ea7ec7d95c8c995da5d8a167256ee1e1fe39c5511edababa676cfa6e14568df\": rpc error: code = NotFound desc = could not find container \"9ea7ec7d95c8c995da5d8a167256ee1e1fe39c5511edababa676cfa6e14568df\": container with ID starting with 9ea7ec7d95c8c995da5d8a167256ee1e1fe39c5511edababa676cfa6e14568df not found: ID does not exist" Jul 14 11:28:25.468649 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:25.468613 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86b9779cd-wcgjc"] Jul 14 11:28:25.475353 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:25.475326 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-86b9779cd-wcgjc"] Jul 14 11:28:26.311559 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:26.311521 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91e95fbb-8f65-400b-b34b-61c65b1aad8e" path="/var/lib/kubelet/pods/91e95fbb-8f65-400b-b34b-61c65b1aad8e/volumes" Jul 14 11:28:27.532054 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:27.532019 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:28:27.611682 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:28:27.611645 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:30:13.219712 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:30:13.219679 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:31:22.187262 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:31:22.187235 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-rj5j5_dc7acf92-5cb9-48e3-8901-75e719e72682/cluster-monitoring-operator/0.log" Jul 14 11:31:22.189156 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:31:22.189134 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-rj5j5_dc7acf92-5cb9-48e3-8901-75e719e72682/cluster-monitoring-operator/0.log" Jul 14 11:31:22.189307 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:31:22.189256 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvxhc_26b43cc7-353e-42f8-ac60-29fb5bd6c510/console-operator/1.log" Jul 14 11:31:22.190955 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:31:22.190940 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvxhc_26b43cc7-353e-42f8-ac60-29fb5bd6c510/console-operator/1.log" Jul 14 11:31:22.195514 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:31:22.195492 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f7fw_9309eb9c-300d-4840-a58f-2c93d2c41bfe/ovn-acl-logging/0.log" Jul 14 11:31:22.197542 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:31:22.197521 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5f7fw_9309eb9c-300d-4840-a58f-2c93d2c41bfe/ovn-acl-logging/0.log" Jul 14 11:31:56.051136 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:31:56.051103 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:32:25.253160 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:32:25.253114 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:32:27.010262 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:32:27.010227 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:33:07.124758 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:33:07.124719 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:33:38.243346 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:33:38.243314 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6bc576c98c-48qp6_4b9120fe-2e93-4160-bcee-3c7302f0fa9e/authorino/0.log" Jul 14 11:33:44.299996 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:33:44.299919 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bf58df976-xhj8x_16cb23d7-3092-4b36-a93b-9b0e4a882a55/copy-manifests/0.log" Jul 14 11:33:44.306496 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:33:44.306470 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bf58df976-xhj8x_16cb23d7-3092-4b36-a93b-9b0e4a882a55/manager/0.log" Jul 14 11:33:46.206524 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:33:46.206492 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6bc576c98c-48qp6_4b9120fe-2e93-4160-bcee-3c7302f0fa9e/authorino/0.log" Jul 14 11:33:46.826671 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:33:46.826639 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-t4m9s_77f19e37-d3ce-4746-91bc-2d5ccf980c40/manager/0.log" Jul 14 11:33:47.692877 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:33:47.692851 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b948bb5ff-f4ccf_cc2d6e12-5a82-414e-939f-a4d0c5a341be/kube-auth-proxy/0.log" Jul 14 11:33:48.614106 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:33:48.614077 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-kljzb_d82be5f2-0f51-4ed7-9b9f-17305f2ac77e/main/0.log" Jul 14 11:33:49.095948 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:33:49.095919 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-6kv7d_36b85b60-6544-4707-9888-dbffdf2543cc/main/0.log" Jul 14 11:33:49.216495 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:33:49.216461 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-vtmww_23bb61d9-0f9b-4c25-ab5d-2b6366a6e64d/main/0.log" Jul 14 11:33:53.514416 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:33:53.514379 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:33:53.590804 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:33:53.590764 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" limit=1024 Jul 14 11:33:56.408118 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:33:56.408088 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7pfjj_de833d9f-3bca-4b05-9a86-ba9e8190d1db/global-pull-secret-syncer/0.log" Jul 14 11:33:56.584171 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:33:56.584140 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fkmdx_30f4de5a-b5b3-4014-b76a-8bd4cde96a63/konnectivity-agent/0.log" Jul 14 11:33:56.788464 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:33:56.788431 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-177.ec2.internal_8d609c1ee768fe3daa3f23cbaf1c3121/haproxy/0.log" Jul 14 11:34:02.256089 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:02.256054 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6bc576c98c-48qp6_4b9120fe-2e93-4160-bcee-3c7302f0fa9e/authorino/0.log" Jul 14 11:34:02.481037 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:02.481005 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-t4m9s_77f19e37-d3ce-4746-91bc-2d5ccf980c40/manager/0.log" Jul 14 11:34:04.360052 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:04.360031 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bc5010a-aaec-4244-8fd5-cdcf48636283/alertmanager/0.log" Jul 14 11:34:04.388988 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:04.388960 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bc5010a-aaec-4244-8fd5-cdcf48636283/config-reloader/0.log" Jul 14 11:34:04.415841 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:04.415818 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bc5010a-aaec-4244-8fd5-cdcf48636283/kube-rbac-proxy-web/0.log" Jul 14 11:34:04.443689 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:04.443664 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bc5010a-aaec-4244-8fd5-cdcf48636283/kube-rbac-proxy/0.log" Jul 14 11:34:04.473270 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:04.473235 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bc5010a-aaec-4244-8fd5-cdcf48636283/kube-rbac-proxy-metric/0.log" Jul 14 11:34:04.503545 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:04.503520 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bc5010a-aaec-4244-8fd5-cdcf48636283/prom-label-proxy/0.log" Jul 14 11:34:04.546252 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:04.546194 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1bc5010a-aaec-4244-8fd5-cdcf48636283/init-config-reloader/0.log" Jul 14 11:34:04.617723 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:04.617642 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-rj5j5_dc7acf92-5cb9-48e3-8901-75e719e72682/cluster-monitoring-operator/1.log" Jul 14 11:34:04.701108 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:04.701075 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-rj5j5_dc7acf92-5cb9-48e3-8901-75e719e72682/cluster-monitoring-operator/0.log" Jul 14 11:34:04.727078 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:04.727047 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-srt42_a8fa4ac0-b61a-469b-86b1-0b463075cbe3/kube-state-metrics/0.log" Jul 14 11:34:04.750958 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:04.750908 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-srt42_a8fa4ac0-b61a-469b-86b1-0b463075cbe3/kube-rbac-proxy-main/0.log" Jul 14 11:34:04.781372 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:04.781342 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-srt42_a8fa4ac0-b61a-469b-86b1-0b463075cbe3/kube-rbac-proxy-self/0.log" Jul 14 11:34:04.811338 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:04.811311 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-594bb87885-fsgds_6fad3790-890d-4f01-8afe-db4024a5d463/metrics-server/0.log" Jul 14 11:34:04.990824 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:04.990791 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-prfv7_168511fb-aecd-4b62-9304-8c989d617fe0/node-exporter/0.log" Jul 14 11:34:05.017638 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:05.017611 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-prfv7_168511fb-aecd-4b62-9304-8c989d617fe0/kube-rbac-proxy/0.log" Jul 14 11:34:05.044485 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:05.044460 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-prfv7_168511fb-aecd-4b62-9304-8c989d617fe0/init-textfile/0.log" Jul 14 11:34:05.283740 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:05.283714 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c43bba7-f68d-4fcb-9d3b-320b8185fd35/prometheus/0.log" Jul 14 11:34:05.308997 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:05.308972 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c43bba7-f68d-4fcb-9d3b-320b8185fd35/config-reloader/0.log" Jul 14 11:34:05.342549 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:05.342524 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c43bba7-f68d-4fcb-9d3b-320b8185fd35/thanos-sidecar/0.log" Jul 14 11:34:05.380763 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:05.380738 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c43bba7-f68d-4fcb-9d3b-320b8185fd35/kube-rbac-proxy-web/0.log" Jul 14 11:34:05.408077 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:05.408055 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c43bba7-f68d-4fcb-9d3b-320b8185fd35/kube-rbac-proxy/0.log" Jul 14 11:34:05.443547 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:05.443518 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c43bba7-f68d-4fcb-9d3b-320b8185fd35/kube-rbac-proxy-thanos/0.log" Jul 14 11:34:05.471653 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:05.471623 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c43bba7-f68d-4fcb-9d3b-320b8185fd35/init-config-reloader/0.log" Jul 14 11:34:06.464486 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.464453 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr"] Jul 14 11:34:06.464873 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.464809 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e95fbb-8f65-400b-b34b-61c65b1aad8e" containerName="authorino" Jul 14 11:34:06.464873 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.464820 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e95fbb-8f65-400b-b34b-61c65b1aad8e" containerName="authorino" Jul 14 11:34:06.464949 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.464886 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="91e95fbb-8f65-400b-b34b-61c65b1aad8e" containerName="authorino" Jul 14 11:34:06.467899 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.467872 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.470771 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.470749 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-82fbt\"/\"default-dockercfg-qbkjj\"" Jul 14 11:34:06.470920 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.470748 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-82fbt\"/\"kube-root-ca.crt\"" Jul 14 11:34:06.470920 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.470749 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-82fbt\"/\"openshift-service-ca.crt\"" Jul 14 11:34:06.475000 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.474866 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr"] Jul 14 11:34:06.606712 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.606671 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62070253-2a89-4ef6-bd87-89aef62721c2-lib-modules\") pod \"perf-node-gather-daemonset-4rxlr\" (UID: \"62070253-2a89-4ef6-bd87-89aef62721c2\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.606712 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.606717 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62070253-2a89-4ef6-bd87-89aef62721c2-sys\") pod \"perf-node-gather-daemonset-4rxlr\" (UID: \"62070253-2a89-4ef6-bd87-89aef62721c2\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.606932 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.606738 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6m2t\" (UniqueName: \"kubernetes.io/projected/62070253-2a89-4ef6-bd87-89aef62721c2-kube-api-access-m6m2t\") pod \"perf-node-gather-daemonset-4rxlr\" (UID: \"62070253-2a89-4ef6-bd87-89aef62721c2\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.606932 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.606876 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62070253-2a89-4ef6-bd87-89aef62721c2-proc\") pod \"perf-node-gather-daemonset-4rxlr\" (UID: \"62070253-2a89-4ef6-bd87-89aef62721c2\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.606932 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.606902 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62070253-2a89-4ef6-bd87-89aef62721c2-podres\") pod \"perf-node-gather-daemonset-4rxlr\" (UID: \"62070253-2a89-4ef6-bd87-89aef62721c2\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.708456 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.708419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62070253-2a89-4ef6-bd87-89aef62721c2-lib-modules\") pod \"perf-node-gather-daemonset-4rxlr\" (UID: \"62070253-2a89-4ef6-bd87-89aef62721c2\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.708456 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.708458 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62070253-2a89-4ef6-bd87-89aef62721c2-sys\") pod \"perf-node-gather-daemonset-4rxlr\" (UID: \"62070253-2a89-4ef6-bd87-89aef62721c2\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.708693 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.708479 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6m2t\" (UniqueName: \"kubernetes.io/projected/62070253-2a89-4ef6-bd87-89aef62721c2-kube-api-access-m6m2t\") pod \"perf-node-gather-daemonset-4rxlr\" (UID: \"62070253-2a89-4ef6-bd87-89aef62721c2\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.708693 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.708533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62070253-2a89-4ef6-bd87-89aef62721c2-proc\") pod \"perf-node-gather-daemonset-4rxlr\" (UID: \"62070253-2a89-4ef6-bd87-89aef62721c2\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.708693 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.708550 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62070253-2a89-4ef6-bd87-89aef62721c2-podres\") pod \"perf-node-gather-daemonset-4rxlr\" (UID: \"62070253-2a89-4ef6-bd87-89aef62721c2\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.708693 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.708565 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62070253-2a89-4ef6-bd87-89aef62721c2-sys\") pod \"perf-node-gather-daemonset-4rxlr\" (UID: \"62070253-2a89-4ef6-bd87-89aef62721c2\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.708693 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.708612 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62070253-2a89-4ef6-bd87-89aef62721c2-lib-modules\") pod \"perf-node-gather-daemonset-4rxlr\" (UID: \"62070253-2a89-4ef6-bd87-89aef62721c2\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.708693 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.708654 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62070253-2a89-4ef6-bd87-89aef62721c2-proc\") pod \"perf-node-gather-daemonset-4rxlr\" (UID: \"62070253-2a89-4ef6-bd87-89aef62721c2\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.708693 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.708669 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62070253-2a89-4ef6-bd87-89aef62721c2-podres\") pod \"perf-node-gather-daemonset-4rxlr\" (UID: \"62070253-2a89-4ef6-bd87-89aef62721c2\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.717780 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.717714 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6m2t\" (UniqueName: \"kubernetes.io/projected/62070253-2a89-4ef6-bd87-89aef62721c2-kube-api-access-m6m2t\") pod \"perf-node-gather-daemonset-4rxlr\" (UID: \"62070253-2a89-4ef6-bd87-89aef62721c2\") " pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.779022 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.778982 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:06.926136 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:06.926109 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr"] Jul 14 11:34:06.928304 ip-10-0-142-177 kubenswrapper[2561]: W0714 11:34:06.928277 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod62070253_2a89_4ef6_bd87_89aef62721c2.slice/crio-d7188dd36d382933e5e5433704a3943ca1d7e6d88090c996d8783ce129c478f8 WatchSource:0}: Error finding container d7188dd36d382933e5e5433704a3943ca1d7e6d88090c996d8783ce129c478f8: Status 404 returned error can't find the container with id d7188dd36d382933e5e5433704a3943ca1d7e6d88090c996d8783ce129c478f8 Jul 14 11:34:07.068704 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:07.068679 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" event={"ID":"62070253-2a89-4ef6-bd87-89aef62721c2","Type":"ContainerStarted","Data":"d7188dd36d382933e5e5433704a3943ca1d7e6d88090c996d8783ce129c478f8"} Jul 14 11:34:07.216497 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:07.216469 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-5bmx6_c128d9fa-7cfe-4caf-aee7-367152ecf337/networking-console-plugin/0.log" Jul 14 11:34:07.767041 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:07.767013 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvxhc_26b43cc7-353e-42f8-ac60-29fb5bd6c510/console-operator/1.log" Jul 14 11:34:07.771316 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:07.771281 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvxhc_26b43cc7-353e-42f8-ac60-29fb5bd6c510/console-operator/2.log" Jul 14 11:34:08.075815 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:08.075710 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" event={"ID":"62070253-2a89-4ef6-bd87-89aef62721c2","Type":"ContainerStarted","Data":"40bb214dde8c20a9843d11f77163e88788a76fbd61d3b5c788e425f0b9392409"} Jul 14 11:34:08.075995 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:08.075861 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:08.126031 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:08.125975 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" podStartSLOduration=2.125960601 podStartE2EDuration="2.125960601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 11:34:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 11:34:08.124798436 +0000 UTC m=+1366.450162963" watchObservedRunningTime="2026-07-14 11:34:08.125960601 +0000 UTC m=+1366.451325132" Jul 14 11:34:10.320275 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:10.320246 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gd299_abf7ad10-3167-4df7-b172-5dfe1082217e/dns/0.log" Jul 14 11:34:10.348091 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:10.348064 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gd299_abf7ad10-3167-4df7-b172-5dfe1082217e/kube-rbac-proxy/0.log" Jul 14 11:34:10.475643 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:10.475619 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r58z6_c4451af9-77df-48c7-b30e-af0fa19dc5b8/dns-node-resolver/0.log" Jul 14 11:34:11.394477 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:11.394448 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lhdnx_141a8f07-befb-41e6-b4b2-779001f4c51d/node-ca/0.log" Jul 14 11:34:12.606034 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:12.606003 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b948bb5ff-f4ccf_cc2d6e12-5a82-414e-939f-a4d0c5a341be/kube-auth-proxy/0.log" Jul 14 11:34:13.509422 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:13.509393 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pvhm4_16977b8e-7c4e-4d57-b39b-8d4e5f8cf730/serve-healthcheck-canary/0.log" Jul 14 11:34:14.029127 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:14.029099 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2svxb_2f1a4782-8431-43b5-a631-283f314c86bf/kube-rbac-proxy/0.log" Jul 14 11:34:14.052489 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:14.052459 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2svxb_2f1a4782-8431-43b5-a631-283f314c86bf/exporter/0.log" Jul 14 11:34:14.076595 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:14.076569 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2svxb_2f1a4782-8431-43b5-a631-283f314c86bf/extractor/0.log" Jul 14 11:34:14.091479 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:14.091450 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-82fbt/perf-node-gather-daemonset-4rxlr" Jul 14 11:34:17.708912 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:17.708883 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bf58df976-xhj8x_16cb23d7-3092-4b36-a93b-9b0e4a882a55/manager/0.log" Jul 14 11:34:17.732830 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:17.732806 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bf58df976-xhj8x_16cb23d7-3092-4b36-a93b-9b0e4a882a55/copy-manifests/0.log" Jul 14 11:34:17.804763 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:17.804737 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b948bb5ff-f4ccf_cc2d6e12-5a82-414e-939f-a4d0c5a341be/kube-auth-proxy/0.log" Jul 14 11:34:19.055545 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:19.055515 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-749d85bc9c-8vx8r_a271dc9e-d9a3-478c-b7d2-4b1599ba8a8b/manager/0.log" Jul 14 11:34:19.116190 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:19.116160 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-jtngb_51a9e39a-5a3e-40cc-a85d-4147b1da601e/openshift-lws-operator/0.log" Jul 14 11:34:19.118957 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:19.118934 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b948bb5ff-f4ccf_cc2d6e12-5a82-414e-939f-a4d0c5a341be/kube-auth-proxy/0.log" Jul 14 11:34:24.091112 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:24.091082 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-9zllc_88d2c81b-cf6f-49d3-b787-ff15880cecac/migrator/0.log" Jul 14 11:34:24.111982 ip-10-0-142-177 kubenswrapper[2561]: I0714 11:34:24.111950 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-9zllc_88d2c81b-cf6f-49d3-b787-ff15880cecac/graceful-termination/0.log"