Jul 28 12:34:55.777407 ip-10-0-137-166 systemd[1]: Starting Kubernetes Kubelet... Jul 28 12:34:56.139811 ip-10-0-137-166 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 12:34:56.139811 ip-10-0-137-166 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 12:34:56.139811 ip-10-0-137-166 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 12:34:56.139811 ip-10-0-137-166 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 12:34:56.139811 ip-10-0-137-166 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 12:34:56.140532 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.140436 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 12:34:56.144471 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144456 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:34:56.144471 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144471 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144475 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144478 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144482 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144485 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144487 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144490 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144493 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144496 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144499 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144502 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144505 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144508 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144510 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144513 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144515 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144518 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144520 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144523 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144525 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:34:56.144539 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144528 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144532 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144536 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144539 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144542 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144545 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144547 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144550 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144553 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144556 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144558 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144561 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144564 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144567 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144569 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144572 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144574 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144576 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144579 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144582 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:34:56.145014 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144585 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144588 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144590 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144593 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144595 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144598 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144600 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144602 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144605 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144609 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144613 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144616 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144619 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144623 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144626 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144629 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144632 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144634 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144637 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:34:56.145503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144640 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144643 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144646 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144648 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144651 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144654 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144656 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144659 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144661 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144665 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144668 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144672 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144675 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144678 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144680 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144683 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144685 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144688 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144690 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:34:56.145968 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144692 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144695 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144698 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144700 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144703 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144705 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144709 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144711 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144714 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144717 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144720 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144722 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144725 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144728 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144730 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144732 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144735 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144737 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144740 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.144743 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:34:56.146474 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145466 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145473 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145476 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145479 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145482 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145485 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145487 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145490 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145493 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145496 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145498 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145501 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145504 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145507 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145510 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145512 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145515 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145518 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145521 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145523 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:34:56.146962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145526 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145529 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145532 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145535 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145537 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145540 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145542 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145544 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145547 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145549 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145552 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145554 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145557 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145559 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145562 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145564 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145566 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145569 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145571 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145574 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:34:56.147466 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145577 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145580 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145582 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145584 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145587 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145590 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145592 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145595 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145598 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145600 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145603 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145606 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145609 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145611 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145614 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145618 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145622 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145626 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145628 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:34:56.147964 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145631 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145634 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145637 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145639 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145641 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145644 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145646 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145649 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145651 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145655 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145657 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145660 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145663 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145665 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145668 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145671 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145673 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145676 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145678 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145682 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:34:56.148452 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145686 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145689 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145692 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145695 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145697 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145701 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145703 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145707 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145711 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145714 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145717 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145720 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145722 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145725 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145728 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145731 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145733 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145736 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145739 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:34:56.148948 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.145741 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146113 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146118 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146121 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146125 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146128 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146131 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146134 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146155 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146158 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146161 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146164 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146166 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146169 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146171 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146174 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146176 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146179 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146182 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:34:56.149427 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146185 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146187 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146190 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146192 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146194 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146197 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146199 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146202 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146204 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146206 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146209 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146212 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146214 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146216 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146219 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146222 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146224 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146226 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146229 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146232 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:34:56.149885 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146237 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146240 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146242 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146245 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146248 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146250 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146253 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146256 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146259 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146261 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146264 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146266 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146268 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146271 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146273 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146276 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146278 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146281 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146283 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146285 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146288 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:34:56.150387 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146290 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146293 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146296 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146299 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146301 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146304 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146306 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146309 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146311 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146314 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146316 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146321 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146323 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146326 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146329 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146331 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146334 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146336 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146339 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:34:56.150943 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146341 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146345 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146348 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146351 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146354 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146357 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146359 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146362 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146364 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146369 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146372 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146375 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146378 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146381 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146384 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146388 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146392 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146394 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146397 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:34:56.151407 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146400 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.146403 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146465 2557 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146471 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146477 2557 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146483 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146487 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146491 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146496 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146500 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146503 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146506 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146510 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146513 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146517 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146520 2557 flags.go:64] FLAG: --cgroup-root="" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146522 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146526 2557 flags.go:64] FLAG: --client-ca-file="" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146529 2557 flags.go:64] FLAG: --cloud-provider="external" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146532 2557 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146536 2557 flags.go:64] FLAG: --cluster-domain="" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146539 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146542 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146545 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 12:34:56.151882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146548 2557 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146551 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146554 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146557 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146560 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146563 2557 flags.go:64] FLAG: --contention-profiling="false" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146567 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146569 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146573 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146575 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146579 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146582 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146585 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146588 2557 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146591 2557 flags.go:64] FLAG: --enable-server="true" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146597 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146601 2557 flags.go:64] FLAG: --event-burst="100" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146604 2557 flags.go:64] FLAG: --event-qps="50" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146607 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146610 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146613 2557 flags.go:64] FLAG: --eviction-hard="" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146626 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146629 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146633 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146635 2557 flags.go:64] FLAG: --eviction-soft="" Jul 28 12:34:56.152502 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146638 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146641 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146644 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146647 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146650 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146652 2557 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146655 2557 flags.go:64] FLAG: --feature-gates="" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146659 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146662 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146665 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146668 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146671 2557 flags.go:64] FLAG: --healthz-port="10248" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146674 2557 flags.go:64] FLAG: --help="false" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146677 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146680 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146682 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146685 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146689 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146692 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146695 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146698 2557 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146701 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146705 2557 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 12:34:56.153095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146708 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146712 2557 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146714 2557 flags.go:64] FLAG: --kube-reserved="" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146717 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146720 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146723 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146726 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146729 2557 flags.go:64] FLAG: --lock-file="" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146732 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146735 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146737 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146743 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146745 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146748 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146751 2557 flags.go:64] FLAG: --logging-format="text" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146754 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146757 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146760 2557 flags.go:64] FLAG: --manifest-url="" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146763 2557 flags.go:64] FLAG: --manifest-url-header="" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146767 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146769 2557 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146773 2557 flags.go:64] FLAG: --max-pods="110" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146776 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146779 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146782 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 12:34:56.153796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146785 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146788 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146791 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146793 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146800 2557 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146803 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146808 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146811 2557 flags.go:64] FLAG: --pod-cidr="" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146814 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146819 2557 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146822 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146825 2557 flags.go:64] FLAG: --pods-per-core="0" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146828 2557 flags.go:64] FLAG: --port="10250" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146831 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146834 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-014c90dff49e68a84" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146837 2557 flags.go:64] FLAG: --qos-reserved="" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146840 2557 flags.go:64] FLAG: --read-only-port="10255" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146843 2557 flags.go:64] FLAG: --register-node="true" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146846 2557 flags.go:64] FLAG: --register-with-taints="" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146849 2557 flags.go:64] FLAG: --registry-burst="10" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146852 2557 flags.go:64] FLAG: --registry-qps="5" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146854 2557 flags.go:64] FLAG: --reserved-cpus="" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146857 2557 flags.go:64] FLAG: --reserved-memory="" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146861 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146864 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 12:34:56.154425 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146867 2557 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146869 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146872 2557 flags.go:64] FLAG: --runonce="false" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146875 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146878 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146881 2557 flags.go:64] FLAG: --seccomp-default="false" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146883 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146886 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146889 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146892 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146896 2557 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146899 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146902 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146906 2557 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146909 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146912 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146916 2557 flags.go:64] FLAG: --system-cgroups="" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146919 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146924 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146927 2557 flags.go:64] FLAG: --tls-cert-file="" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146930 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146934 2557 flags.go:64] FLAG: --tls-min-version="" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146937 2557 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146940 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146943 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 12:34:56.155120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146945 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146948 2557 flags.go:64] FLAG: --v="2" Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146957 2557 flags.go:64] FLAG: --version="false" Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146961 2557 flags.go:64] FLAG: --vmodule="" Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146965 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.146968 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147076 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147079 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147083 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147086 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147089 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147092 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147096 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147099 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147102 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147105 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147109 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147113 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147116 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147119 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:34:56.155747 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147123 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147125 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147128 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147131 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147133 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147152 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147156 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147159 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147162 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147164 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147167 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147170 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147172 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147175 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147177 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147180 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147183 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147185 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147188 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147191 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:34:56.156279 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147193 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147196 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147198 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147201 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147203 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147206 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147208 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147211 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147214 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147217 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147220 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147223 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147226 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147229 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147231 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147234 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147236 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147239 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147242 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147245 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:34:56.156773 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147247 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147250 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147252 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147255 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147258 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147260 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147263 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147265 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147268 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147271 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147273 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147275 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147278 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147280 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147283 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147286 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147288 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147290 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147293 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:34:56.157280 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147296 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147299 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147302 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147305 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147308 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147313 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147316 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147318 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147321 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147323 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147326 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147329 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147331 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147334 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147336 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147339 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147341 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147344 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147346 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147349 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:34:56.157761 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147351 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:34:56.158262 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147354 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:34:56.158262 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147356 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:34:56.158262 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147359 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:34:56.158262 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147361 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:34:56.158262 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.147363 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:34:56.158262 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.147370 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 12:34:56.158262 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.154928 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 12:34:56.158262 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.154943 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 12:34:56.158262 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.154959 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 12:34:56.158262 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.154965 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 12:34:56.158262 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155020 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:34:56.158262 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155025 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:34:56.158262 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155028 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:34:56.158262 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155031 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:34:56.158262 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155034 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155037 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155040 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155044 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155049 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155053 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155057 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155061 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155067 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155072 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155076 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155079 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155082 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155085 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155088 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155091 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155093 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155096 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155099 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:34:56.158639 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155101 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155104 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155106 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155109 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155112 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155115 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155119 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155122 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155125 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155127 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155130 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155133 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155152 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155157 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155160 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155163 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155166 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155169 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155172 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155175 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:34:56.159099 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155177 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155180 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155184 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155186 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155189 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155192 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155194 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155197 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155200 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155204 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155207 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155211 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155214 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155217 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155219 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155222 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155224 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155227 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155230 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:34:56.159603 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155233 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155235 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155239 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155243 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155246 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155249 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155251 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155254 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155257 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155260 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155263 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155266 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155268 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155271 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155273 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155276 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155279 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155282 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155284 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155287 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:34:56.160074 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155289 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:34:56.160641 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155292 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:34:56.160641 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155295 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:34:56.160641 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155297 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:34:56.160641 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155300 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:34:56.160641 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155302 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:34:56.160641 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155305 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:34:56.160641 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155308 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:34:56.160641 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155310 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:34:56.160641 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155313 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:34:56.160641 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155315 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:34:56.160641 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155318 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:34:56.160641 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155321 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:34:56.160641 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155323 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:34:56.160641 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155326 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:34:56.160641 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155328 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:34:56.160641 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155331 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:34:56.161365 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.155336 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 12:34:56.161365 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155445 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:34:56.161365 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155450 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:34:56.161365 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155454 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:34:56.161365 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155459 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:34:56.161365 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155462 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:34:56.161365 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155465 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:34:56.161365 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155468 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:34:56.161365 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155471 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:34:56.161365 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155473 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:34:56.161365 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155476 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:34:56.161365 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155478 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:34:56.161365 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155481 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:34:56.161365 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155484 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155487 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155489 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155492 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155494 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155497 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155499 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155502 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155504 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155507 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155509 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155512 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155514 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155517 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155519 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155522 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155524 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155527 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155529 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155531 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:34:56.161763 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155534 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155536 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155539 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155542 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155544 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155547 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155549 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155552 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155554 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155556 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155559 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155562 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155566 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155570 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155573 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155576 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155579 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155581 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155584 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:34:56.162569 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155587 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155589 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155592 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155595 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155597 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155600 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155602 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155605 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155607 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155610 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155613 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155615 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155618 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155620 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155623 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155626 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155628 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155631 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155633 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:34:56.163175 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155635 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155638 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155641 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155643 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155646 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155648 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155650 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155653 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155656 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155658 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155661 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155663 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155665 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155668 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155670 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155673 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155675 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155678 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155681 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155683 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:34:56.163646 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155686 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:34:56.164236 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155688 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:34:56.164236 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155691 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:34:56.164236 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155693 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:34:56.164236 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155696 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:34:56.164236 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155699 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:34:56.164236 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155701 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:34:56.164236 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155704 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:34:56.164236 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:56.155706 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:34:56.164236 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.155727 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 12:34:56.164236 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.155824 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 12:34:56.164236 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.157608 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 12:34:56.164236 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.158710 2557 server.go:1019] "Starting client certificate rotation" Jul 28 12:34:56.164236 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.158807 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 12:34:56.164236 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.158838 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 12:34:56.164845 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.160935 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 12:34:56.165252 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.165166 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 12:34:56.174147 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.174118 2557 log.go:25] "Validated CRI v1 runtime API" Jul 28 12:34:56.176647 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.176632 2557 log.go:25] "Validated CRI v1 image API" Jul 28 12:34:56.177371 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.177358 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 12:34:56.179423 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.179401 2557 fs.go:135] Filesystem UUIDs: map[0c53eaeb-7d42-47e7-9f55-f23227121b3c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ab28bda2-ce5b-4e5f-8542-69ed06be9cfa:/dev/nvme0n1p4] Jul 28 12:34:56.179486 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.179420 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 12:34:56.184318 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.184211 2557 manager.go:216] Machine: {Timestamp:2026-07-28 12:34:56.18305426 +0000 UTC m=+0.307290050 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100000 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29500a94ab4fd2f32a8eee2202575d SystemUUID:ec29500a-94ab-4fd2-f32a-8eee2202575d BootID:ed197649-b1f3-4021-a804-76edc06b4a53 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9e:05:0e:e6:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9e:05:0e:e6:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:15:2a:43:86:a8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 12:34:56.184318 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.184313 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 12:34:56.184437 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.184379 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 12:34:56.185467 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.185452 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 12:34:56.186560 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.186541 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 12:34:56.186708 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.186564 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-166.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 12:34:56.187124 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.187113 2557 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 12:34:56.187186 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.187126 2557 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 12:34:56.187186 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.187134 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 12:34:56.187720 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.187710 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 12:34:56.188322 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.188313 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 12:34:56.190816 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.190805 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 28 12:34:56.190946 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.190936 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 12:34:56.190985 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.190965 2557 kubelet.go:486] "Attempting to sync node with API server" Jul 28 12:34:56.190985 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.190978 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 12:34:56.191050 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.190991 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 12:34:56.191050 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.191001 2557 kubelet.go:398] "Adding apiserver pod source" Jul 28 12:34:56.191050 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.191009 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 12:34:56.191380 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.191341 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 12:34:56.191380 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.191368 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 12:34:56.193310 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.193296 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 12:34:56.194746 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.194732 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 12:34:56.194790 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.194762 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 12:34:56.196310 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.196297 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 12:34:56.196369 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.196319 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 12:34:56.196369 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.196329 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 12:34:56.196369 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.196338 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 12:34:56.196369 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.196350 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 12:34:56.196369 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.196357 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 12:34:56.196369 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.196368 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 12:34:56.196637 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.196377 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 12:34:56.196637 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.196389 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 12:34:56.196637 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.196397 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 12:34:56.196637 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.196420 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 12:34:56.196637 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.196428 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 12:34:56.197095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.197086 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 12:34:56.197095 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.197095 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 12:34:56.200153 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.200128 2557 server.go:1268] "Started kubelet" Jul 28 12:34:56.200246 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.200207 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 12:34:56.200299 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.200238 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 12:34:56.203867 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.203686 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 12:34:56.204346 ip-10-0-137-166 systemd[1]: Started Kubernetes Kubelet. Jul 28 12:34:56.205281 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.205261 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 12:34:56.206194 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.206164 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 12:34:56.206291 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.206188 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 12:34:56.206348 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.206308 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-166.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 12:34:56.207771 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.207681 2557 server.go:310] "Adding debug handlers to kubelet server" Jul 28 12:34:56.209826 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.209800 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 12:34:56.210958 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.210936 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bwbkw" Jul 28 12:34:56.211865 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.211842 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 12:34:56.211865 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.211847 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 12:34:56.212040 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.212025 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Jul 28 12:34:56.212271 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.212251 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 12:34:56.212347 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.212273 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 12:34:56.212347 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.212302 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 12:34:56.212432 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.212421 2557 reconstruct.go:97] "Volume reconstruction finished" Jul 28 12:34:56.212432 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.212429 2557 reconciler.go:29] "Reconciler: start to sync state" Jul 28 12:34:56.212596 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.210982 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-166.ec2.internal.18c6743a56149d54 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-166.ec2.internal,UID:ip-10-0-137-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-166.ec2.internal,},FirstTimestamp:2026-07-28 12:34:56.200097108 +0000 UTC m=+0.324332903,LastTimestamp:2026-07-28 12:34:56.200097108 +0000 UTC m=+0.324332903,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-166.ec2.internal,}" Jul 28 12:34:56.212912 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.212724 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 12:34:56.212912 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.212740 2557 factory.go:55] Registering systemd factory Jul 28 12:34:56.212912 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.212746 2557 factory.go:223] Registration of the systemd container factory successfully Jul 28 12:34:56.213077 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.212968 2557 factory.go:153] Registering CRI-O factory Jul 28 12:34:56.213077 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.212980 2557 factory.go:223] Registration of the crio container factory successfully Jul 28 12:34:56.213077 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.213003 2557 factory.go:103] Registering Raw factory Jul 28 12:34:56.213077 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.213017 2557 manager.go:1196] Started watching for new ooms in manager Jul 28 12:34:56.213388 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.213375 2557 manager.go:349] Starting recovery of all containers Jul 28 12:34:56.218937 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.218916 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bwbkw" Jul 28 12:34:56.219179 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.219158 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 12:34:56.219322 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.219294 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 12:34:56.224598 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.224577 2557 manager.go:354] Recovery completed Jul 28 12:34:56.226315 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.226235 2557 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 28 12:34:56.229548 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.229536 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:34:56.231364 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.231351 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:34:56.231427 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.231375 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:34:56.231427 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.231386 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:34:56.231905 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.231881 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 12:34:56.231905 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.231894 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 12:34:56.231905 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.231908 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 28 12:34:56.232037 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.231922 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:34:56.232684 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.232670 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:34:56.232740 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.232694 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:34:56.232740 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.232703 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:34:56.233881 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.233823 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-166.ec2.internal.18c6743a57f1b289 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-166.ec2.internal,UID:ip-10-0-137-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-166.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-166.ec2.internal,},FirstTimestamp:2026-07-28 12:34:56.231363209 +0000 UTC m=+0.355598999,LastTimestamp:2026-07-28 12:34:56.231363209 +0000 UTC m=+0.355598999,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-166.ec2.internal,}" Jul 28 12:34:56.234233 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.234220 2557 policy_none.go:49] "None policy: Start" Jul 28 12:34:56.234267 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.234238 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 12:34:56.234267 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.234248 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 12:34:56.236674 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.236659 2557 policy_none.go:47] "Start" Jul 28 12:34:56.270790 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.270652 2557 manager.go:337] "Starting Device Plugin manager" Jul 28 12:34:56.270882 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.270814 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 12:34:56.270882 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.270827 2557 server.go:87] "Starting device plugin registration server" Jul 28 12:34:56.271025 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.271014 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 12:34:56.271094 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.271026 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 12:34:56.271155 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.271119 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 12:34:56.271256 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.271204 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 12:34:56.271256 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.271211 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 12:34:56.271670 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.271651 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 12:34:56.271735 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.271697 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-166.ec2.internal\" not found" Jul 28 12:34:56.371873 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.371845 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:34:56.373928 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.372217 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 12:34:56.373928 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.372756 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:34:56.373928 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.372795 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:34:56.373928 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.372811 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:34:56.373928 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.372847 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.373928 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.373638 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 12:34:56.373928 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.373671 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 12:34:56.373928 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.373688 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 12:34:56.373928 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.373720 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 12:34:56.378108 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.378092 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 12:34:56.389068 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.389054 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.389128 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.389074 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-166.ec2.internal\": node \"ip-10-0-137-166.ec2.internal\" not found" Jul 28 12:34:56.447365 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.447313 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Jul 28 12:34:56.474496 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.474475 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal"] Jul 28 12:34:56.474564 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.474529 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:34:56.475809 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.475793 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:34:56.475881 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.475826 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:34:56.475881 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.475845 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:34:56.478094 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.478079 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:34:56.478212 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.478197 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.478266 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.478227 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:34:56.478721 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.478705 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:34:56.478807 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.478731 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:34:56.478807 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.478741 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:34:56.478807 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.478750 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:34:56.478807 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.478773 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:34:56.478807 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.478782 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:34:56.480963 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.480944 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.481041 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.480971 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:34:56.481571 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.481555 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:34:56.481636 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.481588 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:34:56.481636 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.481602 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:34:56.497649 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.497630 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-166.ec2.internal\" not found" node="ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.501064 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.501051 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-166.ec2.internal\" not found" node="ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.515113 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.515090 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88579fe3f1536e01095c0f663c2ca914-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal\" (UID: \"88579fe3f1536e01095c0f663c2ca914\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.515213 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.515115 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88579fe3f1536e01095c0f663c2ca914-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal\" (UID: \"88579fe3f1536e01095c0f663c2ca914\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.515213 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.515132 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a383476bc9f7e9ae2f5ba60fa098087-config\") pod \"kube-apiserver-proxy-ip-10-0-137-166.ec2.internal\" (UID: \"3a383476bc9f7e9ae2f5ba60fa098087\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.547598 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.547576 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Jul 28 12:34:56.616060 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.616040 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a383476bc9f7e9ae2f5ba60fa098087-config\") pod \"kube-apiserver-proxy-ip-10-0-137-166.ec2.internal\" (UID: \"3a383476bc9f7e9ae2f5ba60fa098087\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.616132 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.616064 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88579fe3f1536e01095c0f663c2ca914-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal\" (UID: \"88579fe3f1536e01095c0f663c2ca914\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.616132 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.616082 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88579fe3f1536e01095c0f663c2ca914-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal\" (UID: \"88579fe3f1536e01095c0f663c2ca914\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.616132 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.616122 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88579fe3f1536e01095c0f663c2ca914-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal\" (UID: \"88579fe3f1536e01095c0f663c2ca914\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.616245 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.616134 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a383476bc9f7e9ae2f5ba60fa098087-config\") pod \"kube-apiserver-proxy-ip-10-0-137-166.ec2.internal\" (UID: \"3a383476bc9f7e9ae2f5ba60fa098087\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.616245 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.616158 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88579fe3f1536e01095c0f663c2ca914-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal\" (UID: \"88579fe3f1536e01095c0f663c2ca914\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.648317 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.648285 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Jul 28 12:34:56.751064 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.750995 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Jul 28 12:34:56.802181 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.802135 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.804335 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:56.804310 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Jul 28 12:34:56.851619 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.851588 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Jul 28 12:34:56.953565 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:56.953526 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Jul 28 12:34:57.054565 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:57.054503 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Jul 28 12:34:57.157609 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:57.157575 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Jul 28 12:34:57.158760 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:57.158742 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 12:34:57.158911 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:57.158893 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 12:34:57.223329 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:57.223291 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 12:29:56 +0000 UTC" deadline="2028-02-22 04:03:59.58002576 +0000 UTC" Jul 28 12:34:57.223329 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:57.223321 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13767h29m2.356707179s" Jul 28 12:34:57.258009 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:57.257984 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Jul 28 12:34:57.330701 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:57.330649 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 12:34:57.408637 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:57.408612 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 12:34:57.412437 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:57.412416 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" Jul 28 12:34:57.422949 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:57.422930 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 12:34:57.423789 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:57.423775 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Jul 28 12:34:57.434487 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:57.434470 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 12:34:57.455678 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:57.455652 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a383476bc9f7e9ae2f5ba60fa098087.slice/crio-d8c8e36a1d233a40baf0dec2ffedbb7189e72701ed9b123950e1854ffcf5dc23 WatchSource:0}: Error finding container d8c8e36a1d233a40baf0dec2ffedbb7189e72701ed9b123950e1854ffcf5dc23: Status 404 returned error can't find the container with id d8c8e36a1d233a40baf0dec2ffedbb7189e72701ed9b123950e1854ffcf5dc23 Jul 28 12:34:57.461244 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:57.461226 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 12:34:57.477176 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:57.477140 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 12:34:58.191942 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.191908 2557 apiserver.go:52] "Watching apiserver" Jul 28 12:34:58.197405 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.197374 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 12:34:58.198955 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.198926 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph","openshift-cluster-node-tuning-operator/tuned-c68j2","openshift-dns/node-resolver-v5n5n","openshift-multus/multus-zsgg5","openshift-multus/network-metrics-daemon-z2bvn","openshift-network-diagnostics/network-check-target-htckr","kube-system/konnectivity-agent-dw2z4","openshift-image-registry/node-ca-xj4pd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal","openshift-multus/multus-additional-cni-plugins-hctxj","openshift-network-operator/iptables-alerter-29llq","openshift-ovn-kubernetes/ovnkube-node-m4hrl","kube-system/global-pull-secret-syncer-8mckt","kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal"] Jul 28 12:34:58.201590 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.201563 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dw2z4" Jul 28 12:34:58.203954 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.203933 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:34:58.204055 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.203951 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 12:34:58.204055 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.204040 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:34:58.204298 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.204273 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 12:34:58.204693 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.204676 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wnb7z\"" Jul 28 12:34:58.206251 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.206208 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v5n5n" Jul 28 12:34:58.208896 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.208876 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wrd5v\"" Jul 28 12:34:58.209008 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.208880 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 12:34:58.209080 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.209004 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 12:34:58.209586 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.209291 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.211270 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.211243 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 12:34:58.211748 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.211733 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:34:58.212068 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.211856 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:34:58.212239 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.212219 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 12:34:58.212323 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.212305 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 12:34:58.212384 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.212364 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dlpdw\"" Jul 28 12:34:58.212440 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.212367 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 12:34:58.212533 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.212510 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 12:34:58.214854 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.214824 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:34:58.214953 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.214904 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:34:58.217289 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.217233 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xj4pd" Jul 28 12:34:58.219296 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.219270 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4hxdg\"" Jul 28 12:34:58.219381 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.219316 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 12:34:58.219441 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.219428 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 12:34:58.219701 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.219681 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 12:34:58.220516 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.219714 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.221723 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.221672 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 12:34:58.222555 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.221723 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 12:34:58.222555 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.221841 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p5kmg\"" Jul 28 12:34:58.222555 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.221956 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 12:34:58.222555 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.222208 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.223383 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223339 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-cnibin\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.223489 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223380 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72stn\" (UniqueName: \"kubernetes.io/projected/402ce15c-b3be-428c-99b3-20384ca207fb-kube-api-access-72stn\") pod \"network-metrics-daemon-z2bvn\" (UID: \"402ce15c-b3be-428c-99b3-20384ca207fb\") " pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:34:58.223489 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223410 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f6a422f-12a3-4a38-a815-885197adc8a3-tmp-dir\") pod \"node-resolver-v5n5n\" (UID: \"6f6a422f-12a3-4a38-a815-885197adc8a3\") " pod="openshift-dns/node-resolver-v5n5n" Jul 28 12:34:58.223489 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223439 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prppt\" (UniqueName: \"kubernetes.io/projected/6f6a422f-12a3-4a38-a815-885197adc8a3-kube-api-access-prppt\") pod \"node-resolver-v5n5n\" (UID: \"6f6a422f-12a3-4a38-a815-885197adc8a3\") " pod="openshift-dns/node-resolver-v5n5n" Jul 28 12:34:58.223489 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223464 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-multus-cni-dir\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.223723 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223493 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01cceaff-a5df-4586-b5d6-dc036823143a-cni-binary-copy\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.223723 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223527 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-multus-conf-dir\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.223723 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223552 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1-agent-certs\") pod \"konnectivity-agent-dw2z4\" (UID: \"fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1\") " pod="kube-system/konnectivity-agent-dw2z4" Jul 28 12:34:58.223723 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223579 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret\") pod \"global-pull-secret-syncer-8mckt\" (UID: \"dfcf362b-2f70-4960-9560-109a7b677692\") " pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:34:58.223723 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223609 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs\") pod \"network-metrics-daemon-z2bvn\" (UID: \"402ce15c-b3be-428c-99b3-20384ca207fb\") " pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:34:58.223723 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223632 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhwlg\" (UniqueName: \"kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg\") pod \"network-check-target-htckr\" (UID: \"53fbd277-d44a-440c-a94f-803405595342\") " pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:34:58.223723 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223705 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-system-cni-dir\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.224105 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223740 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-run-netns\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.224105 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223769 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-hostroot\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.224105 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223794 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-run-multus-certs\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.224105 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223827 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-multus-socket-dir-parent\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.224105 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223923 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-var-lib-cni-multus\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.224105 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223949 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-etc-kubernetes\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.224105 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.223993 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dfcf362b-2f70-4960-9560-109a7b677692-kubelet-config\") pod \"global-pull-secret-syncer-8mckt\" (UID: \"dfcf362b-2f70-4960-9560-109a7b677692\") " pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:34:58.224105 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.224031 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dfcf362b-2f70-4960-9560-109a7b677692-dbus\") pod \"global-pull-secret-syncer-8mckt\" (UID: \"dfcf362b-2f70-4960-9560-109a7b677692\") " pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:34:58.224105 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.224063 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f6a422f-12a3-4a38-a815-885197adc8a3-hosts-file\") pod \"node-resolver-v5n5n\" (UID: \"6f6a422f-12a3-4a38-a815-885197adc8a3\") " pod="openshift-dns/node-resolver-v5n5n" Jul 28 12:34:58.224105 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.224090 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-os-release\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.224607 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.224115 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-var-lib-cni-bin\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.224607 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.224144 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01cceaff-a5df-4586-b5d6-dc036823143a-multus-daemon-config\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.224607 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.224220 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bb5b\" (UniqueName: \"kubernetes.io/projected/01cceaff-a5df-4586-b5d6-dc036823143a-kube-api-access-6bb5b\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.224607 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.224262 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1-konnectivity-ca\") pod \"konnectivity-agent-dw2z4\" (UID: \"fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1\") " pod="kube-system/konnectivity-agent-dw2z4" Jul 28 12:34:58.224607 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.224283 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-run-k8s-cni-cncf-io\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.224607 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.224300 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-var-lib-kubelet\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.224607 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.224477 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 12:34:58.224607 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.224494 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 12:34:58.225852 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.225381 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f5928\"" Jul 28 12:34:58.225852 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.225477 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.226776 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.226750 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 12:34:58.227397 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.227379 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hzq7h\"" Jul 28 12:34:58.230363 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.230290 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 12:34:58.230467 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.230394 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 12:34:58.230682 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.230655 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-29llq" Jul 28 12:34:58.232742 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.232722 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 12:34:58.232949 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.232922 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 12:34:58.233044 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.233021 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 12:34:58.233179 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.233151 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kckjg\"" Jul 28 12:34:58.233274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.233255 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.235027 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.235007 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vzvdd\"" Jul 28 12:34:58.235356 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.235338 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 12:34:58.235948 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.235713 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 12:34:58.235948 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.235714 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 12:34:58.235948 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.235714 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 12:34:58.235948 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.235719 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 12:34:58.235948 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.235857 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 12:34:58.313523 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.313498 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 12:34:58.324516 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324492 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-system-cni-dir\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.324660 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324523 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-run-multus-certs\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.324660 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324544 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.324660 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324568 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-multus-socket-dir-parent\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.324660 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324616 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-var-lib-cni-multus\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.324660 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324642 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-run-multus-certs\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.324898 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324649 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-system-cni-dir\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.324898 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324708 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dfcf362b-2f70-4960-9560-109a7b677692-kubelet-config\") pod \"global-pull-secret-syncer-8mckt\" (UID: \"dfcf362b-2f70-4960-9560-109a7b677692\") " pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:34:58.324898 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324728 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-multus-socket-dir-parent\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.324898 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324768 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dfcf362b-2f70-4960-9560-109a7b677692-kubelet-config\") pod \"global-pull-secret-syncer-8mckt\" (UID: \"dfcf362b-2f70-4960-9560-109a7b677692\") " pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:34:58.324898 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324772 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f6a422f-12a3-4a38-a815-885197adc8a3-hosts-file\") pod \"node-resolver-v5n5n\" (UID: \"6f6a422f-12a3-4a38-a815-885197adc8a3\") " pod="openshift-dns/node-resolver-v5n5n" Jul 28 12:34:58.324898 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324767 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-var-lib-cni-multus\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.324898 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324843 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-registration-dir\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.324898 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324882 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f6a422f-12a3-4a38-a815-885197adc8a3-hosts-file\") pod \"node-resolver-v5n5n\" (UID: \"6f6a422f-12a3-4a38-a815-885197adc8a3\") " pod="openshift-dns/node-resolver-v5n5n" Jul 28 12:34:58.325251 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324930 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-log-socket\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.325251 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324956 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf30b692-7b37-45ee-8a67-262a2bdab3f3-host\") pod \"node-ca-xj4pd\" (UID: \"bf30b692-7b37-45ee-8a67-262a2bdab3f3\") " pod="openshift-image-registry/node-ca-xj4pd" Jul 28 12:34:58.325251 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.324986 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-os-release\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.325251 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325012 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01cceaff-a5df-4586-b5d6-dc036823143a-multus-daemon-config\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.325251 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325040 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-modprobe-d\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.325251 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325064 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-sysctl-d\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.325251 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325073 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-os-release\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.325251 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325090 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-systemd\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.325251 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325208 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-run-k8s-cni-cncf-io\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.325696 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325304 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k7xt\" (UniqueName: \"kubernetes.io/projected/5fac9ee4-848f-482d-a3d3-65f1af61d9d3-kube-api-access-8k7xt\") pod \"iptables-alerter-29llq\" (UID: \"5fac9ee4-848f-482d-a3d3-65f1af61d9d3\") " pod="openshift-network-operator/iptables-alerter-29llq" Jul 28 12:34:58.325696 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325338 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-cni-netd\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.325696 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325327 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-run-k8s-cni-cncf-io\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.325696 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325368 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/62215987-8385-4369-9a68-78c84e1f1266-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.325696 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325407 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f6a422f-12a3-4a38-a815-885197adc8a3-tmp-dir\") pod \"node-resolver-v5n5n\" (UID: \"6f6a422f-12a3-4a38-a815-885197adc8a3\") " pod="openshift-dns/node-resolver-v5n5n" Jul 28 12:34:58.325696 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325447 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-run-ovn\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.325696 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325481 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-env-overrides\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.325696 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325504 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpxrp\" (UniqueName: \"kubernetes.io/projected/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-kube-api-access-bpxrp\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.325696 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325562 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-multus-cni-dir\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.325696 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325588 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01cceaff-a5df-4586-b5d6-dc036823143a-cni-binary-copy\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.325696 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325612 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.325696 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325638 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-systemd-units\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.325696 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325680 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bf30b692-7b37-45ee-8a67-262a2bdab3f3-serviceca\") pod \"node-ca-xj4pd\" (UID: \"bf30b692-7b37-45ee-8a67-262a2bdab3f3\") " pod="openshift-image-registry/node-ca-xj4pd" Jul 28 12:34:58.326302 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325712 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62215987-8385-4369-9a68-78c84e1f1266-system-cni-dir\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.326302 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325742 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret\") pod \"global-pull-secret-syncer-8mckt\" (UID: \"dfcf362b-2f70-4960-9560-109a7b677692\") " pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:34:58.326302 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325767 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-socket-dir\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.326302 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325792 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-device-dir\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.326302 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325815 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-sys-fs\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.326302 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325841 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-run-openvswitch\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.326302 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325850 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-multus-cni-dir\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.326302 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.325712 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01cceaff-a5df-4586-b5d6-dc036823143a-multus-daemon-config\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.326302 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326013 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-node-log\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.326302 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326044 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-cni-bin\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.326302 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326070 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-kubernetes\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.326302 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326126 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs\") pod \"network-metrics-daemon-z2bvn\" (UID: \"402ce15c-b3be-428c-99b3-20384ca207fb\") " pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:34:58.326302 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.326268 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:34:58.326302 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326257 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhwlg\" (UniqueName: \"kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg\") pod \"network-check-target-htckr\" (UID: \"53fbd277-d44a-440c-a94f-803405595342\") " pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:34:58.326986 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.326328 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:34:58.326986 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326384 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01cceaff-a5df-4586-b5d6-dc036823143a-cni-binary-copy\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.326986 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.326440 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs podName:402ce15c-b3be-428c-99b3-20384ca207fb nodeName:}" failed. No retries permitted until 2026-07-28 12:34:58.826389303 +0000 UTC m=+2.950625102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs") pod "network-metrics-daemon-z2bvn" (UID: "402ce15c-b3be-428c-99b3-20384ca207fb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:34:58.326986 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326446 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f6a422f-12a3-4a38-a815-885197adc8a3-tmp-dir\") pod \"node-resolver-v5n5n\" (UID: \"6f6a422f-12a3-4a38-a815-885197adc8a3\") " pod="openshift-dns/node-resolver-v5n5n" Jul 28 12:34:58.326986 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.326477 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret podName:dfcf362b-2f70-4960-9560-109a7b677692 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:58.826450726 +0000 UTC m=+2.950686506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret") pod "global-pull-secret-syncer-8mckt" (UID: "dfcf362b-2f70-4960-9560-109a7b677692") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:34:58.326986 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326518 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fac9ee4-848f-482d-a3d3-65f1af61d9d3-iptables-alerter-script\") pod \"iptables-alerter-29llq\" (UID: \"5fac9ee4-848f-482d-a3d3-65f1af61d9d3\") " pod="openshift-network-operator/iptables-alerter-29llq" Jul 28 12:34:58.326986 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326556 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-sys\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.326986 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326584 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-var-lib-kubelet\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.326986 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326626 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-tuned\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.326986 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326657 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm5l8\" (UniqueName: \"kubernetes.io/projected/ac29508f-022d-4d6c-af0e-1ff5f584fe99-kube-api-access-qm5l8\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.326986 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326681 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-run-netns\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.326986 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326719 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-hostroot\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.326986 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326737 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-run-netns\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.326986 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326745 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fac9ee4-848f-482d-a3d3-65f1af61d9d3-host-slash\") pod \"iptables-alerter-29llq\" (UID: \"5fac9ee4-848f-482d-a3d3-65f1af61d9d3\") " pod="openshift-network-operator/iptables-alerter-29llq" Jul 28 12:34:58.326986 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326775 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-ovnkube-config\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.326986 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326775 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-hostroot\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326797 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-etc-kubernetes\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326820 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dfcf362b-2f70-4960-9560-109a7b677692-dbus\") pod \"global-pull-secret-syncer-8mckt\" (UID: \"dfcf362b-2f70-4960-9560-109a7b677692\") " pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326837 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzfc9\" (UniqueName: \"kubernetes.io/projected/511476c9-e185-4f2c-bc11-1bd84c605db7-kube-api-access-wzfc9\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326854 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-kubelet\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326872 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-var-lib-openvswitch\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326877 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-etc-kubernetes\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326886 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62215987-8385-4369-9a68-78c84e1f1266-cnibin\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326921 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-var-lib-cni-bin\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326957 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bb5b\" (UniqueName: \"kubernetes.io/projected/01cceaff-a5df-4586-b5d6-dc036823143a-kube-api-access-6bb5b\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.326971 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-var-lib-cni-bin\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327001 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1-konnectivity-ca\") pod \"konnectivity-agent-dw2z4\" (UID: \"fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1\") " pod="kube-system/konnectivity-agent-dw2z4" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327026 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-run-netns\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327041 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dfcf362b-2f70-4960-9560-109a7b677692-dbus\") pod \"global-pull-secret-syncer-8mckt\" (UID: \"dfcf362b-2f70-4960-9560-109a7b677692\") " pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327182 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-etc-openvswitch\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327235 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-ovnkube-script-lib\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327261 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-lib-modules\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.327769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327299 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/62215987-8385-4369-9a68-78c84e1f1266-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327330 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-var-lib-kubelet\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327363 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-slash\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327387 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-run-systemd\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327443 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-ovn-node-metrics-cert\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327452 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-host-var-lib-kubelet\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327479 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-sysctl-conf\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327518 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62215987-8385-4369-9a68-78c84e1f1266-os-release\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327554 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2vhd\" (UniqueName: \"kubernetes.io/projected/62215987-8385-4369-9a68-78c84e1f1266-kube-api-access-c2vhd\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327598 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-cnibin\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327614 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1-konnectivity-ca\") pod \"konnectivity-agent-dw2z4\" (UID: \"fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1\") " pod="kube-system/konnectivity-agent-dw2z4" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327639 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72stn\" (UniqueName: \"kubernetes.io/projected/402ce15c-b3be-428c-99b3-20384ca207fb-kube-api-access-72stn\") pod \"network-metrics-daemon-z2bvn\" (UID: \"402ce15c-b3be-428c-99b3-20384ca207fb\") " pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327670 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prppt\" (UniqueName: \"kubernetes.io/projected/6f6a422f-12a3-4a38-a815-885197adc8a3-kube-api-access-prppt\") pod \"node-resolver-v5n5n\" (UID: \"6f6a422f-12a3-4a38-a815-885197adc8a3\") " pod="openshift-dns/node-resolver-v5n5n" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327753 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-cnibin\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327795 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327833 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvvl6\" (UniqueName: \"kubernetes.io/projected/bf30b692-7b37-45ee-8a67-262a2bdab3f3-kube-api-access-nvvl6\") pod \"node-ca-xj4pd\" (UID: \"bf30b692-7b37-45ee-8a67-262a2bdab3f3\") " pod="openshift-image-registry/node-ca-xj4pd" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327911 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-run\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.328515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327935 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac29508f-022d-4d6c-af0e-1ff5f584fe99-tmp\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.329165 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327962 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62215987-8385-4369-9a68-78c84e1f1266-cni-binary-copy\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.329165 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.327992 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-multus-conf-dir\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.329165 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.328018 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1-agent-certs\") pod \"konnectivity-agent-dw2z4\" (UID: \"fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1\") " pod="kube-system/konnectivity-agent-dw2z4" Jul 28 12:34:58.329165 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.328044 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-sysconfig\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.329165 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.328068 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-host\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.329165 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.328092 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62215987-8385-4369-9a68-78c84e1f1266-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.329165 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.328120 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01cceaff-a5df-4586-b5d6-dc036823143a-multus-conf-dir\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.329165 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.328127 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.329165 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.328525 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 12:34:58.332016 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.331991 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1-agent-certs\") pod \"konnectivity-agent-dw2z4\" (UID: \"fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1\") " pod="kube-system/konnectivity-agent-dw2z4" Jul 28 12:34:58.334124 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.334093 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:34:58.334124 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.334119 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:34:58.334842 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.334133 2557 projected.go:196] Error preparing data for projected volume kube-api-access-jhwlg for pod openshift-network-diagnostics/network-check-target-htckr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:34:58.334842 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.334209 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg podName:53fbd277-d44a-440c-a94f-803405595342 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:58.834193026 +0000 UTC m=+2.958428820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jhwlg" (UniqueName: "kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg") pod "network-check-target-htckr" (UID: "53fbd277-d44a-440c-a94f-803405595342") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:34:58.336574 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.336555 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bb5b\" (UniqueName: \"kubernetes.io/projected/01cceaff-a5df-4586-b5d6-dc036823143a-kube-api-access-6bb5b\") pod \"multus-zsgg5\" (UID: \"01cceaff-a5df-4586-b5d6-dc036823143a\") " pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.337085 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.337065 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prppt\" (UniqueName: \"kubernetes.io/projected/6f6a422f-12a3-4a38-a815-885197adc8a3-kube-api-access-prppt\") pod \"node-resolver-v5n5n\" (UID: \"6f6a422f-12a3-4a38-a815-885197adc8a3\") " pod="openshift-dns/node-resolver-v5n5n" Jul 28 12:34:58.337633 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.337612 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72stn\" (UniqueName: \"kubernetes.io/projected/402ce15c-b3be-428c-99b3-20384ca207fb-kube-api-access-72stn\") pod \"network-metrics-daemon-z2bvn\" (UID: \"402ce15c-b3be-428c-99b3-20384ca207fb\") " pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:34:58.363090 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.363054 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hpmlq" Jul 28 12:34:58.369395 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.369372 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hpmlq" Jul 28 12:34:58.381155 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.381091 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" event={"ID":"3a383476bc9f7e9ae2f5ba60fa098087","Type":"ContainerStarted","Data":"d8c8e36a1d233a40baf0dec2ffedbb7189e72701ed9b123950e1854ffcf5dc23"} Jul 28 12:34:58.429029 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.428993 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k7xt\" (UniqueName: \"kubernetes.io/projected/5fac9ee4-848f-482d-a3d3-65f1af61d9d3-kube-api-access-8k7xt\") pod \"iptables-alerter-29llq\" (UID: \"5fac9ee4-848f-482d-a3d3-65f1af61d9d3\") " pod="openshift-network-operator/iptables-alerter-29llq" Jul 28 12:34:58.429207 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429037 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-cni-netd\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.429207 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429065 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/62215987-8385-4369-9a68-78c84e1f1266-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.429207 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429095 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-run-ovn\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.429207 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429123 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-env-overrides\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.429207 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429148 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpxrp\" (UniqueName: \"kubernetes.io/projected/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-kube-api-access-bpxrp\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.429207 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429190 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429203 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-run-ovn\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429216 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-systemd-units\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429133 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-cni-netd\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429242 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bf30b692-7b37-45ee-8a67-262a2bdab3f3-serviceca\") pod \"node-ca-xj4pd\" (UID: \"bf30b692-7b37-45ee-8a67-262a2bdab3f3\") " pod="openshift-image-registry/node-ca-xj4pd" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429267 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62215987-8385-4369-9a68-78c84e1f1266-system-cni-dir\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429306 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-socket-dir\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429322 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-device-dir\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429342 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-sys-fs\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429365 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-run-openvswitch\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429389 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-node-log\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429412 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-cni-bin\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429416 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-device-dir\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429442 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-kubernetes\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429469 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62215987-8385-4369-9a68-78c84e1f1266-system-cni-dir\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429480 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-socket-dir\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429494 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fac9ee4-848f-482d-a3d3-65f1af61d9d3-iptables-alerter-script\") pod \"iptables-alerter-29llq\" (UID: \"5fac9ee4-848f-482d-a3d3-65f1af61d9d3\") " pod="openshift-network-operator/iptables-alerter-29llq" Jul 28 12:34:58.429579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429514 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-systemd-units\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429518 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-sys\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429553 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-var-lib-kubelet\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429541 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-node-log\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429566 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-etc-selinux\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429583 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-tuned\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429572 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-sys\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429611 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm5l8\" (UniqueName: \"kubernetes.io/projected/ac29508f-022d-4d6c-af0e-1ff5f584fe99-kube-api-access-qm5l8\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429621 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-run-openvswitch\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429624 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-kubernetes\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429641 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fac9ee4-848f-482d-a3d3-65f1af61d9d3-host-slash\") pod \"iptables-alerter-29llq\" (UID: \"5fac9ee4-848f-482d-a3d3-65f1af61d9d3\") " pod="openshift-network-operator/iptables-alerter-29llq" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429664 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-var-lib-kubelet\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429684 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-cni-bin\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429696 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-env-overrides\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429714 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-ovnkube-config\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429746 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzfc9\" (UniqueName: \"kubernetes.io/projected/511476c9-e185-4f2c-bc11-1bd84c605db7-kube-api-access-wzfc9\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429764 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-sys-fs\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.430568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429771 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/62215987-8385-4369-9a68-78c84e1f1266-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429780 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-kubelet\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429806 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-var-lib-openvswitch\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429830 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62215987-8385-4369-9a68-78c84e1f1266-cnibin\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429868 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fac9ee4-848f-482d-a3d3-65f1af61d9d3-host-slash\") pod \"iptables-alerter-29llq\" (UID: \"5fac9ee4-848f-482d-a3d3-65f1af61d9d3\") " pod="openshift-network-operator/iptables-alerter-29llq" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429889 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bf30b692-7b37-45ee-8a67-262a2bdab3f3-serviceca\") pod \"node-ca-xj4pd\" (UID: \"bf30b692-7b37-45ee-8a67-262a2bdab3f3\") " pod="openshift-image-registry/node-ca-xj4pd" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429920 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-var-lib-openvswitch\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429946 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62215987-8385-4369-9a68-78c84e1f1266-cnibin\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429860 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-run-netns\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429967 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-run-netns\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429990 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-etc-openvswitch\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430012 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-ovnkube-script-lib\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430024 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-etc-openvswitch\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430036 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-lib-modules\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430065 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/62215987-8385-4369-9a68-78c84e1f1266-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430091 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-slash\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.429963 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-kubelet\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.431446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430135 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-run-systemd\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430150 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fac9ee4-848f-482d-a3d3-65f1af61d9d3-iptables-alerter-script\") pod \"iptables-alerter-29llq\" (UID: \"5fac9ee4-848f-482d-a3d3-65f1af61d9d3\") " pod="openshift-network-operator/iptables-alerter-29llq" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430181 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-run-systemd\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430190 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-lib-modules\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430182 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-ovn-node-metrics-cert\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430226 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-sysctl-conf\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430249 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-slash\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430252 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-ovnkube-config\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430252 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62215987-8385-4369-9a68-78c84e1f1266-os-release\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430309 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2vhd\" (UniqueName: \"kubernetes.io/projected/62215987-8385-4369-9a68-78c84e1f1266-kube-api-access-c2vhd\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430347 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430382 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-sysctl-conf\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430412 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvvl6\" (UniqueName: \"kubernetes.io/projected/bf30b692-7b37-45ee-8a67-262a2bdab3f3-kube-api-access-nvvl6\") pod \"node-ca-xj4pd\" (UID: \"bf30b692-7b37-45ee-8a67-262a2bdab3f3\") " pod="openshift-image-registry/node-ca-xj4pd" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430413 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62215987-8385-4369-9a68-78c84e1f1266-os-release\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430436 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-run\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430461 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac29508f-022d-4d6c-af0e-1ff5f584fe99-tmp\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430466 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.432274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430495 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62215987-8385-4369-9a68-78c84e1f1266-cni-binary-copy\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430526 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-sysconfig\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430550 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-host\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430575 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62215987-8385-4369-9a68-78c84e1f1266-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430597 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/62215987-8385-4369-9a68-78c84e1f1266-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430599 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430635 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430652 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-ovnkube-script-lib\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430669 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430703 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-registration-dir\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430730 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-log-socket\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430752 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf30b692-7b37-45ee-8a67-262a2bdab3f3-host\") pod \"node-ca-xj4pd\" (UID: \"bf30b692-7b37-45ee-8a67-262a2bdab3f3\") " pod="openshift-image-registry/node-ca-xj4pd" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430776 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-modprobe-d\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430800 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-sysctl-d\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430822 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-systemd\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430852 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/511476c9-e185-4f2c-bc11-1bd84c605db7-registration-dir\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430915 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-host\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.433122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430925 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-systemd\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.433977 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430941 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-run\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.433977 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430968 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-sysconfig\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.433977 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430972 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.433977 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.430997 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf30b692-7b37-45ee-8a67-262a2bdab3f3-host\") pod \"node-ca-xj4pd\" (UID: \"bf30b692-7b37-45ee-8a67-262a2bdab3f3\") " pod="openshift-image-registry/node-ca-xj4pd" Jul 28 12:34:58.433977 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.431037 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-log-socket\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.433977 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.431061 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62215987-8385-4369-9a68-78c84e1f1266-cni-binary-copy\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.433977 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.431067 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-modprobe-d\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.433977 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.431089 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-sysctl-d\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.433977 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.431180 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62215987-8385-4369-9a68-78c84e1f1266-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.433977 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.433206 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-ovn-node-metrics-cert\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.433977 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.433523 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac29508f-022d-4d6c-af0e-1ff5f584fe99-tmp\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.433977 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.433560 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac29508f-022d-4d6c-af0e-1ff5f584fe99-etc-tuned\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.438131 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.437899 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k7xt\" (UniqueName: \"kubernetes.io/projected/5fac9ee4-848f-482d-a3d3-65f1af61d9d3-kube-api-access-8k7xt\") pod \"iptables-alerter-29llq\" (UID: \"5fac9ee4-848f-482d-a3d3-65f1af61d9d3\") " pod="openshift-network-operator/iptables-alerter-29llq" Jul 28 12:34:58.438131 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.438085 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzfc9\" (UniqueName: \"kubernetes.io/projected/511476c9-e185-4f2c-bc11-1bd84c605db7-kube-api-access-wzfc9\") pod \"aws-ebs-csi-driver-node-6qhph\" (UID: \"511476c9-e185-4f2c-bc11-1bd84c605db7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.438744 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.438725 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm5l8\" (UniqueName: \"kubernetes.io/projected/ac29508f-022d-4d6c-af0e-1ff5f584fe99-kube-api-access-qm5l8\") pod \"tuned-c68j2\" (UID: \"ac29508f-022d-4d6c-af0e-1ff5f584fe99\") " pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.438843 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.438722 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpxrp\" (UniqueName: \"kubernetes.io/projected/ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c-kube-api-access-bpxrp\") pod \"ovnkube-node-m4hrl\" (UID: \"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.439299 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.439260 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2vhd\" (UniqueName: \"kubernetes.io/projected/62215987-8385-4369-9a68-78c84e1f1266-kube-api-access-c2vhd\") pod \"multus-additional-cni-plugins-hctxj\" (UID: \"62215987-8385-4369-9a68-78c84e1f1266\") " pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.439619 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.439599 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvvl6\" (UniqueName: \"kubernetes.io/projected/bf30b692-7b37-45ee-8a67-262a2bdab3f3-kube-api-access-nvvl6\") pod \"node-ca-xj4pd\" (UID: \"bf30b692-7b37-45ee-8a67-262a2bdab3f3\") " pod="openshift-image-registry/node-ca-xj4pd" Jul 28 12:34:58.514475 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.514397 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dw2z4" Jul 28 12:34:58.522186 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.522163 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v5n5n" Jul 28 12:34:58.533267 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.533242 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zsgg5" Jul 28 12:34:58.540269 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.540245 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xj4pd" Jul 28 12:34:58.547287 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.547268 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" Jul 28 12:34:58.555367 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.555342 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c68j2" Jul 28 12:34:58.555463 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.555447 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 12:34:58.563166 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.563135 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hctxj" Jul 28 12:34:58.571940 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.571922 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-29llq" Jul 28 12:34:58.577823 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.577803 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:34:58.832447 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.832373 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret\") pod \"global-pull-secret-syncer-8mckt\" (UID: \"dfcf362b-2f70-4960-9560-109a7b677692\") " pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:34:58.832447 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.832419 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs\") pod \"network-metrics-daemon-z2bvn\" (UID: \"402ce15c-b3be-428c-99b3-20384ca207fb\") " pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:34:58.832660 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.832570 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:34:58.832660 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.832631 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs podName:402ce15c-b3be-428c-99b3-20384ca207fb nodeName:}" failed. No retries permitted until 2026-07-28 12:34:59.83261335 +0000 UTC m=+3.956849142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs") pod "network-metrics-daemon-z2bvn" (UID: "402ce15c-b3be-428c-99b3-20384ca207fb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:34:58.832774 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.832571 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:34:58.832774 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.832730 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret podName:dfcf362b-2f70-4960-9560-109a7b677692 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:59.832705988 +0000 UTC m=+3.956941785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret") pod "global-pull-secret-syncer-8mckt" (UID: "dfcf362b-2f70-4960-9560-109a7b677692") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:34:58.933301 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:58.933263 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhwlg\" (UniqueName: \"kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg\") pod \"network-check-target-htckr\" (UID: \"53fbd277-d44a-440c-a94f-803405595342\") " pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:34:58.933446 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.933417 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:34:58.933446 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.933440 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:34:58.933511 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.933450 2557 projected.go:196] Error preparing data for projected volume kube-api-access-jhwlg for pod openshift-network-diagnostics/network-check-target-htckr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:34:58.933511 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:58.933501 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg podName:53fbd277-d44a-440c-a94f-803405595342 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:59.933487937 +0000 UTC m=+4.057723719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhwlg" (UniqueName: "kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg") pod "network-check-target-htckr" (UID: "53fbd277-d44a-440c-a94f-803405595342") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:34:58.972507 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:58.972473 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fac9ee4_848f_482d_a3d3_65f1af61d9d3.slice/crio-a5c687ded67ac9b9efd96ae62a45e2ce99463282445fb502dbf7da3a2fa94eea WatchSource:0}: Error finding container a5c687ded67ac9b9efd96ae62a45e2ce99463282445fb502dbf7da3a2fa94eea: Status 404 returned error can't find the container with id a5c687ded67ac9b9efd96ae62a45e2ce99463282445fb502dbf7da3a2fa94eea Jul 28 12:34:58.973215 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:58.973193 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf30b692_7b37_45ee_8a67_262a2bdab3f3.slice/crio-0735f99b8809d5746bc262368c7bbffa29cc31429e2b318b4694704d3a6caa4a WatchSource:0}: Error finding container 0735f99b8809d5746bc262368c7bbffa29cc31429e2b318b4694704d3a6caa4a: Status 404 returned error can't find the container with id 0735f99b8809d5746bc262368c7bbffa29cc31429e2b318b4694704d3a6caa4a Jul 28 12:34:58.974503 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:58.974467 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac29508f_022d_4d6c_af0e_1ff5f584fe99.slice/crio-65625d51da2ecbd82d15ccd7f649b348e60d6eefcc6ca7166c5ec1dce8724aaa WatchSource:0}: Error finding container 65625d51da2ecbd82d15ccd7f649b348e60d6eefcc6ca7166c5ec1dce8724aaa: Status 404 returned error can't find the container with id 65625d51da2ecbd82d15ccd7f649b348e60d6eefcc6ca7166c5ec1dce8724aaa Jul 28 12:34:58.976375 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:58.976299 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6a422f_12a3_4a38_a815_885197adc8a3.slice/crio-0813333452e117f28c33bfbdfd002d95125a634f733b0e5bedd1184e9216afb6 WatchSource:0}: Error finding container 0813333452e117f28c33bfbdfd002d95125a634f733b0e5bedd1184e9216afb6: Status 404 returned error can't find the container with id 0813333452e117f28c33bfbdfd002d95125a634f733b0e5bedd1184e9216afb6 Jul 28 12:34:58.979166 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:58.979128 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01cceaff_a5df_4586_b5d6_dc036823143a.slice/crio-92f0fdd0e87c92d743b0459f2dd2187334c240782970bf82f47255592f62d7af WatchSource:0}: Error finding container 92f0fdd0e87c92d743b0459f2dd2187334c240782970bf82f47255592f62d7af: Status 404 returned error can't find the container with id 92f0fdd0e87c92d743b0459f2dd2187334c240782970bf82f47255592f62d7af Jul 28 12:34:58.980368 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:58.980344 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1a46e7_6d6d_4e75_aa63_cb578ee8da7c.slice/crio-37fcc36e6abce24e33eb4340985ee41bce54d78236c53d760ef22e5b1e3aaa15 WatchSource:0}: Error finding container 37fcc36e6abce24e33eb4340985ee41bce54d78236c53d760ef22e5b1e3aaa15: Status 404 returned error can't find the container with id 37fcc36e6abce24e33eb4340985ee41bce54d78236c53d760ef22e5b1e3aaa15 Jul 28 12:34:58.982954 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:58.981586 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod511476c9_e185_4f2c_bc11_1bd84c605db7.slice/crio-47795ab41148e74f0dd1060b778e126223840325d68576db2b9261935baa90d9 WatchSource:0}: Error finding container 47795ab41148e74f0dd1060b778e126223840325d68576db2b9261935baa90d9: Status 404 returned error can't find the container with id 47795ab41148e74f0dd1060b778e126223840325d68576db2b9261935baa90d9 Jul 28 12:34:58.982954 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:58.982352 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbcffaa_ec9f_46a9_a13e_32f47a57ebf1.slice/crio-cb83fb7839d0317f3c67f9aa4a5fbdcee3cc36e2f0c145f2f59a8583a2690f66 WatchSource:0}: Error finding container cb83fb7839d0317f3c67f9aa4a5fbdcee3cc36e2f0c145f2f59a8583a2690f66: Status 404 returned error can't find the container with id cb83fb7839d0317f3c67f9aa4a5fbdcee3cc36e2f0c145f2f59a8583a2690f66 Jul 28 12:34:58.983431 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:58.982959 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88579fe3f1536e01095c0f663c2ca914.slice/crio-23de66fd45be6c38a10fec2653302a0aeea549c311d3dfec8cdf501df7de3936 WatchSource:0}: Error finding container 23de66fd45be6c38a10fec2653302a0aeea549c311d3dfec8cdf501df7de3936: Status 404 returned error can't find the container with id 23de66fd45be6c38a10fec2653302a0aeea549c311d3dfec8cdf501df7de3936 Jul 28 12:34:59.003879 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:34:59.003769 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62215987_8385_4369_9a68_78c84e1f1266.slice/crio-443b20d8991b573e2cfc917add6880d873586542960c73fbf5e2daa37d686172 WatchSource:0}: Error finding container 443b20d8991b573e2cfc917add6880d873586542960c73fbf5e2daa37d686172: Status 404 returned error can't find the container with id 443b20d8991b573e2cfc917add6880d873586542960c73fbf5e2daa37d686172 Jul 28 12:34:59.373884 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.373833 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 12:29:58 +0000 UTC" deadline="2028-03-27 20:30:05.164513857 +0000 UTC" Jul 28 12:34:59.373884 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.373881 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14599h55m5.790637458s" Jul 28 12:34:59.388943 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.388863 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-29llq" event={"ID":"5fac9ee4-848f-482d-a3d3-65f1af61d9d3","Type":"ContainerStarted","Data":"a5c687ded67ac9b9efd96ae62a45e2ce99463282445fb502dbf7da3a2fa94eea"} Jul 28 12:34:59.394653 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.394160 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" event={"ID":"3a383476bc9f7e9ae2f5ba60fa098087","Type":"ContainerStarted","Data":"f4f9b85b653d1d06b26e2c55f0fb81b0b78f7eec67b245daf94d99a37f11a694"} Jul 28 12:34:59.405655 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.405624 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dw2z4" event={"ID":"fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1","Type":"ContainerStarted","Data":"cb83fb7839d0317f3c67f9aa4a5fbdcee3cc36e2f0c145f2f59a8583a2690f66"} Jul 28 12:34:59.408041 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.407968 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" event={"ID":"511476c9-e185-4f2c-bc11-1bd84c605db7","Type":"ContainerStarted","Data":"47795ab41148e74f0dd1060b778e126223840325d68576db2b9261935baa90d9"} Jul 28 12:34:59.410422 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.410400 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v5n5n" event={"ID":"6f6a422f-12a3-4a38-a815-885197adc8a3","Type":"ContainerStarted","Data":"0813333452e117f28c33bfbdfd002d95125a634f733b0e5bedd1184e9216afb6"} Jul 28 12:34:59.414346 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.414324 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c68j2" event={"ID":"ac29508f-022d-4d6c-af0e-1ff5f584fe99","Type":"ContainerStarted","Data":"65625d51da2ecbd82d15ccd7f649b348e60d6eefcc6ca7166c5ec1dce8724aaa"} Jul 28 12:34:59.415786 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.415731 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" podStartSLOduration=2.415713625 podStartE2EDuration="2.415713625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:34:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:34:59.415272772 +0000 UTC m=+3.539508572" watchObservedRunningTime="2026-07-28 12:34:59.415713625 +0000 UTC m=+3.539949425" Jul 28 12:34:59.416742 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.416715 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hctxj" event={"ID":"62215987-8385-4369-9a68-78c84e1f1266","Type":"ContainerStarted","Data":"443b20d8991b573e2cfc917add6880d873586542960c73fbf5e2daa37d686172"} Jul 28 12:34:59.420497 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.420471 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" event={"ID":"88579fe3f1536e01095c0f663c2ca914","Type":"ContainerStarted","Data":"23de66fd45be6c38a10fec2653302a0aeea549c311d3dfec8cdf501df7de3936"} Jul 28 12:34:59.423314 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.423287 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" event={"ID":"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c","Type":"ContainerStarted","Data":"37fcc36e6abce24e33eb4340985ee41bce54d78236c53d760ef22e5b1e3aaa15"} Jul 28 12:34:59.425677 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.425651 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zsgg5" event={"ID":"01cceaff-a5df-4586-b5d6-dc036823143a","Type":"ContainerStarted","Data":"92f0fdd0e87c92d743b0459f2dd2187334c240782970bf82f47255592f62d7af"} Jul 28 12:34:59.427109 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.427076 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xj4pd" event={"ID":"bf30b692-7b37-45ee-8a67-262a2bdab3f3","Type":"ContainerStarted","Data":"0735f99b8809d5746bc262368c7bbffa29cc31429e2b318b4694704d3a6caa4a"} Jul 28 12:34:59.841031 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.840185 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret\") pod \"global-pull-secret-syncer-8mckt\" (UID: \"dfcf362b-2f70-4960-9560-109a7b677692\") " pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:34:59.841031 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.840236 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs\") pod \"network-metrics-daemon-z2bvn\" (UID: \"402ce15c-b3be-428c-99b3-20384ca207fb\") " pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:34:59.841031 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:59.840387 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:34:59.841031 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:59.840443 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs podName:402ce15c-b3be-428c-99b3-20384ca207fb nodeName:}" failed. No retries permitted until 2026-07-28 12:35:01.840424337 +0000 UTC m=+5.964660115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs") pod "network-metrics-daemon-z2bvn" (UID: "402ce15c-b3be-428c-99b3-20384ca207fb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:34:59.841031 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:59.840868 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:34:59.841031 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:59.840946 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret podName:dfcf362b-2f70-4960-9560-109a7b677692 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:01.84092721 +0000 UTC m=+5.965163001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret") pod "global-pull-secret-syncer-8mckt" (UID: "dfcf362b-2f70-4960-9560-109a7b677692") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:34:59.940845 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:34:59.940812 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhwlg\" (UniqueName: \"kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg\") pod \"network-check-target-htckr\" (UID: \"53fbd277-d44a-440c-a94f-803405595342\") " pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:34:59.941055 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:59.941036 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:34:59.941118 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:59.941066 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:34:59.941118 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:59.941078 2557 projected.go:196] Error preparing data for projected volume kube-api-access-jhwlg for pod openshift-network-diagnostics/network-check-target-htckr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:34:59.941525 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:34:59.941131 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg podName:53fbd277-d44a-440c-a94f-803405595342 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:01.941113486 +0000 UTC m=+6.065349268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhwlg" (UniqueName: "kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg") pod "network-check-target-htckr" (UID: "53fbd277-d44a-440c-a94f-803405595342") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:00.375539 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:00.374418 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 12:29:58 +0000 UTC" deadline="2028-03-02 06:19:55.740881725 +0000 UTC" Jul 28 12:35:00.375539 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:00.374698 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13985h44m55.366190215s" Jul 28 12:35:00.375539 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:00.374799 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:00.375539 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:00.375011 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:00.375539 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:00.375410 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:00.375539 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:00.375500 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:00.375539 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:00.375528 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:00.376357 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:00.375616 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:01.859343 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:01.859306 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret\") pod \"global-pull-secret-syncer-8mckt\" (UID: \"dfcf362b-2f70-4960-9560-109a7b677692\") " pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:01.859798 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:01.859364 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs\") pod \"network-metrics-daemon-z2bvn\" (UID: \"402ce15c-b3be-428c-99b3-20384ca207fb\") " pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:01.859798 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:01.859544 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:01.859798 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:01.859608 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs podName:402ce15c-b3be-428c-99b3-20384ca207fb nodeName:}" failed. No retries permitted until 2026-07-28 12:35:05.859589015 +0000 UTC m=+9.983824807 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs") pod "network-metrics-daemon-z2bvn" (UID: "402ce15c-b3be-428c-99b3-20384ca207fb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:01.860046 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:01.860031 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:01.860113 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:01.860082 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret podName:dfcf362b-2f70-4960-9560-109a7b677692 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:05.860066943 +0000 UTC m=+9.984302724 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret") pod "global-pull-secret-syncer-8mckt" (UID: "dfcf362b-2f70-4960-9560-109a7b677692") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:01.961359 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:01.960769 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhwlg\" (UniqueName: \"kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg\") pod \"network-check-target-htckr\" (UID: \"53fbd277-d44a-440c-a94f-803405595342\") " pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:01.961359 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:01.960922 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:35:01.961359 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:01.960942 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:35:01.961359 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:01.960954 2557 projected.go:196] Error preparing data for projected volume kube-api-access-jhwlg for pod openshift-network-diagnostics/network-check-target-htckr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:01.961359 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:01.961013 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg podName:53fbd277-d44a-440c-a94f-803405595342 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:05.960996456 +0000 UTC m=+10.085232237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhwlg" (UniqueName: "kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg") pod "network-check-target-htckr" (UID: "53fbd277-d44a-440c-a94f-803405595342") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:02.374937 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:02.374908 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:02.375120 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:02.375052 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:02.375120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:02.375097 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:02.375296 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:02.375241 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:02.375352 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:02.375307 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:02.375481 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:02.375433 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:04.374340 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:04.374311 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:04.374744 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:04.374441 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:04.374744 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:04.374317 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:04.374744 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:04.374589 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:04.374744 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:04.374656 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:04.374744 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:04.374721 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:05.899182 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:05.899132 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs\") pod \"network-metrics-daemon-z2bvn\" (UID: \"402ce15c-b3be-428c-99b3-20384ca207fb\") " pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:05.899648 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:05.899263 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret\") pod \"global-pull-secret-syncer-8mckt\" (UID: \"dfcf362b-2f70-4960-9560-109a7b677692\") " pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:05.899648 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:05.899385 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:05.899648 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:05.899446 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret podName:dfcf362b-2f70-4960-9560-109a7b677692 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:13.899427744 +0000 UTC m=+18.023663525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret") pod "global-pull-secret-syncer-8mckt" (UID: "dfcf362b-2f70-4960-9560-109a7b677692") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:05.899844 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:05.899678 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:05.899844 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:05.899743 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs podName:402ce15c-b3be-428c-99b3-20384ca207fb nodeName:}" failed. No retries permitted until 2026-07-28 12:35:13.899723581 +0000 UTC m=+18.023959373 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs") pod "network-metrics-daemon-z2bvn" (UID: "402ce15c-b3be-428c-99b3-20384ca207fb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:06.000518 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:06.000474 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhwlg\" (UniqueName: \"kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg\") pod \"network-check-target-htckr\" (UID: \"53fbd277-d44a-440c-a94f-803405595342\") " pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:06.000693 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:06.000644 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:35:06.000693 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:06.000666 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:35:06.000693 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:06.000680 2557 projected.go:196] Error preparing data for projected volume kube-api-access-jhwlg for pod openshift-network-diagnostics/network-check-target-htckr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:06.000809 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:06.000743 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg podName:53fbd277-d44a-440c-a94f-803405595342 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:14.000725663 +0000 UTC m=+18.124961457 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhwlg" (UniqueName: "kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg") pod "network-check-target-htckr" (UID: "53fbd277-d44a-440c-a94f-803405595342") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:06.376592 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:06.375872 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:06.376592 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:06.376000 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:06.376592 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:06.376369 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:06.376592 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:06.376454 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:06.376592 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:06.376495 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:06.376592 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:06.376561 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:08.374430 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:08.374376 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:08.374430 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:08.374391 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:08.374864 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:08.374529 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:08.374864 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:08.374525 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:08.374864 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:08.374637 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:08.374864 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:08.374714 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:10.374363 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:10.374328 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:10.374363 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:10.374352 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:10.374886 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:10.374368 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:10.374886 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:10.374473 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:10.374886 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:10.374544 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:10.374886 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:10.374609 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:12.374663 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:12.374631 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:12.375116 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:12.374664 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:12.375116 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:12.374631 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:12.375116 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:12.374755 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:12.375116 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:12.374855 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:12.375116 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:12.374927 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:13.957780 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:13.957689 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret\") pod \"global-pull-secret-syncer-8mckt\" (UID: \"dfcf362b-2f70-4960-9560-109a7b677692\") " pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:13.957780 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:13.957735 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs\") pod \"network-metrics-daemon-z2bvn\" (UID: \"402ce15c-b3be-428c-99b3-20384ca207fb\") " pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:13.958264 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:13.957844 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:13.958264 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:13.957872 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:13.958264 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:13.957914 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret podName:dfcf362b-2f70-4960-9560-109a7b677692 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:29.957893374 +0000 UTC m=+34.082129158 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret") pod "global-pull-secret-syncer-8mckt" (UID: "dfcf362b-2f70-4960-9560-109a7b677692") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:13.958264 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:13.957934 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs podName:402ce15c-b3be-428c-99b3-20384ca207fb nodeName:}" failed. No retries permitted until 2026-07-28 12:35:29.95792404 +0000 UTC m=+34.082159822 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs") pod "network-metrics-daemon-z2bvn" (UID: "402ce15c-b3be-428c-99b3-20384ca207fb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:14.058362 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:14.058325 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhwlg\" (UniqueName: \"kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg\") pod \"network-check-target-htckr\" (UID: \"53fbd277-d44a-440c-a94f-803405595342\") " pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:14.058506 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:14.058468 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:35:14.058506 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:14.058485 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:35:14.058506 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:14.058495 2557 projected.go:196] Error preparing data for projected volume kube-api-access-jhwlg for pod openshift-network-diagnostics/network-check-target-htckr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:14.058629 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:14.058551 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg podName:53fbd277-d44a-440c-a94f-803405595342 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:30.058532907 +0000 UTC m=+34.182768700 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhwlg" (UniqueName: "kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg") pod "network-check-target-htckr" (UID: "53fbd277-d44a-440c-a94f-803405595342") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:14.374852 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:14.374816 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:14.375042 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:14.374816 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:14.375042 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:14.374951 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:14.375169 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:14.375062 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:14.375169 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:14.374821 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:14.375280 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:14.375167 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:16.374836 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:16.374800 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:16.375306 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:16.374913 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:16.375306 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:16.374923 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:16.375306 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:16.375031 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:16.375306 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:16.375089 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:16.375306 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:16.375176 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:18.374543 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.374312 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:18.375339 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.374313 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:18.375339 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:18.374638 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:18.375339 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:18.374737 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:18.375339 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.374421 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:18.375339 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:18.374820 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:18.475984 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.475944 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dw2z4" event={"ID":"fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1","Type":"ContainerStarted","Data":"dad195519afaa0ff0d7425ab7f4cf4e636013ea40f9d91d3531401a391958cae"} Jul 28 12:35:18.477571 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.477543 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" event={"ID":"511476c9-e185-4f2c-bc11-1bd84c605db7","Type":"ContainerStarted","Data":"2a42dfb1acb197061900923abc50d47ef2f2f54d190c41287085197249053db3"} Jul 28 12:35:18.478943 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.478917 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v5n5n" event={"ID":"6f6a422f-12a3-4a38-a815-885197adc8a3","Type":"ContainerStarted","Data":"1e02661abbaeda10170ef94de6fc299e274cb4462ab088aaa269dbf00295cce6"} Jul 28 12:35:18.480450 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.480414 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c68j2" event={"ID":"ac29508f-022d-4d6c-af0e-1ff5f584fe99","Type":"ContainerStarted","Data":"0989671d48e8aac6d688b57c91722711fad4cc811cce8df8b05489ec253c4286"} Jul 28 12:35:18.482113 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.482030 2557 generic.go:356] "Generic (PLEG): container finished" podID="62215987-8385-4369-9a68-78c84e1f1266" containerID="058624a22687feb037b98ad6d3d1589cc208d91ffe44cd1b127a94656d2d0f93" exitCode=0 Jul 28 12:35:18.482113 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.482104 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hctxj" event={"ID":"62215987-8385-4369-9a68-78c84e1f1266","Type":"ContainerDied","Data":"058624a22687feb037b98ad6d3d1589cc208d91ffe44cd1b127a94656d2d0f93"} Jul 28 12:35:18.483791 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.483763 2557 generic.go:356] "Generic (PLEG): container finished" podID="88579fe3f1536e01095c0f663c2ca914" containerID="fde9e0bbb850094d7199b838aeffc8769217e82c553712010595ecc9b56aa469" exitCode=0 Jul 28 12:35:18.483863 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.483844 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" event={"ID":"88579fe3f1536e01095c0f663c2ca914","Type":"ContainerDied","Data":"fde9e0bbb850094d7199b838aeffc8769217e82c553712010595ecc9b56aa469"} Jul 28 12:35:18.487395 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.487376 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" event={"ID":"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c","Type":"ContainerStarted","Data":"02713725df7f8dbffdd89e57c7afdbe2ab27b74cdbf4654f7ba6aaf84bbb8162"} Jul 28 12:35:18.487482 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.487437 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" event={"ID":"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c","Type":"ContainerStarted","Data":"ecaffc07c18d2659aecef088974b618df75c863282cc83d1e212b0aaf97bdf8f"} Jul 28 12:35:18.487532 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.487485 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" event={"ID":"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c","Type":"ContainerStarted","Data":"646b9a1d49cc87160a0a8dc160bd51f0280711ea270e865fd03fc3ca26643a78"} Jul 28 12:35:18.487532 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.487515 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" event={"ID":"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c","Type":"ContainerStarted","Data":"ead5d1d354a97c1a6bcfa28e3a956e5cab8bb5e92feec4d4c925e05a62af25f6"} Jul 28 12:35:18.487636 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.487541 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" event={"ID":"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c","Type":"ContainerStarted","Data":"75e03787313afddbbb7cd1f730846a0c77e90758bd349f38acfa70a2b3689c43"} Jul 28 12:35:18.487636 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.487583 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" event={"ID":"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c","Type":"ContainerStarted","Data":"3bbbf4e3fd93d5a7d6e46e1d066fafa48891886b26f682c552d8374944d58958"} Jul 28 12:35:18.488790 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.488768 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zsgg5" event={"ID":"01cceaff-a5df-4586-b5d6-dc036823143a","Type":"ContainerStarted","Data":"3ac9748dda07f25f336912135676ed4ba737336b9b976d27815cd68b4694fa08"} Jul 28 12:35:18.490030 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.490012 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xj4pd" event={"ID":"bf30b692-7b37-45ee-8a67-262a2bdab3f3","Type":"ContainerStarted","Data":"47d6c78c2753d0a282d23cdd5551a4c0dac2b65fbdb0af119e875d458b7817a4"} Jul 28 12:35:18.493698 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.493656 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dw2z4" podStartSLOduration=3.852119197 podStartE2EDuration="22.493622961s" totalImagesPullingTime="18.641503764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:18.493329287 +0000 UTC m=+22.617565085" watchObservedRunningTime="2026-07-28 12:35:18.493622961 +0000 UTC m=+22.617858762" Jul 28 12:35:18.508431 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.508400 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v5n5n" podStartSLOduration=3.841260057 podStartE2EDuration="22.508390352s" totalImagesPullingTime="18.667130295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:18.5081988 +0000 UTC m=+22.632434598" watchObservedRunningTime="2026-07-28 12:35:18.508390352 +0000 UTC m=+22.632626151" Jul 28 12:35:18.526418 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.526212 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zsgg5" podStartSLOduration=3.805362106 podStartE2EDuration="22.526199464s" totalImagesPullingTime="18.720837358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:18.525620322 +0000 UTC m=+22.649856145" watchObservedRunningTime="2026-07-28 12:35:18.526199464 +0000 UTC m=+22.650435263" Jul 28 12:35:18.539757 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.539712 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xj4pd" podStartSLOduration=3.871230788 podStartE2EDuration="22.539701732s" totalImagesPullingTime="18.668470944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:18.539023798 +0000 UTC m=+22.663259622" watchObservedRunningTime="2026-07-28 12:35:18.539701732 +0000 UTC m=+22.663937531" Jul 28 12:35:18.560043 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.560002 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c68j2" podStartSLOduration=3.87715295 podStartE2EDuration="22.559988691s" totalImagesPullingTime="18.682835741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:18.559529619 +0000 UTC m=+22.683765436" watchObservedRunningTime="2026-07-28 12:35:18.559988691 +0000 UTC m=+22.684224490" Jul 28 12:35:18.683759 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.683722 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:18.759164 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:18.759123 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:19.053198 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:19.053127 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 12:35:19.144513 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:19.144479 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:19.202667 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:19.202588 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:19.280802 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:19.280697 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T12:35:19.053195243Z","UUID":"a981d45e-d194-4d39-9784-9c76681959bd","Handler":null,"Name":"","Endpoint":""} Jul 28 12:35:19.282500 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:19.282475 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 12:35:19.282631 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:19.282522 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 12:35:19.494067 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:19.493992 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-29llq" event={"ID":"5fac9ee4-848f-482d-a3d3-65f1af61d9d3","Type":"ContainerStarted","Data":"ee153c396910b3dc6192345592d4edac1db0a17662460fd3e9c31daa60eda1c1"} Jul 28 12:35:19.495915 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:19.495886 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" event={"ID":"511476c9-e185-4f2c-bc11-1bd84c605db7","Type":"ContainerStarted","Data":"10fa17de878c3547c9e9db39fcef5f8af7e5bab6385ffd12f5e91d6da23a1d38"} Jul 28 12:35:19.497843 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:19.497793 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" event={"ID":"88579fe3f1536e01095c0f663c2ca914","Type":"ContainerStarted","Data":"c2cede983378d6fe29774d3bec9e63c9867fd7449297f810397d44ee5c703810"} Jul 28 12:35:19.511056 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:19.510997 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-29llq" podStartSLOduration=4.842178895 podStartE2EDuration="23.510977097s" totalImagesPullingTime="18.668798202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:19.510175561 +0000 UTC m=+23.634411360" watchObservedRunningTime="2026-07-28 12:35:19.510977097 +0000 UTC m=+23.635212899" Jul 28 12:35:19.524107 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:19.524057 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" podStartSLOduration=22.524040328 podStartE2EDuration="22.524040328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:34:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:19.523615723 +0000 UTC m=+23.647851523" watchObservedRunningTime="2026-07-28 12:35:19.524040328 +0000 UTC m=+23.648276128" Jul 28 12:35:19.610281 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:19.610245 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:19.670376 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:19.670318 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:20.374763 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:20.374732 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:20.374763 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:20.374732 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:20.374973 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:20.374763 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:20.374973 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:20.374877 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:20.375079 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:20.374963 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:20.375079 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:20.375051 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:20.502804 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:20.502770 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" event={"ID":"511476c9-e185-4f2c-bc11-1bd84c605db7","Type":"ContainerStarted","Data":"c24c732321f957673a39079816522ec89bb97c719911d1ee98a7828636073736"} Jul 28 12:35:20.506580 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:20.506552 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" event={"ID":"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c","Type":"ContainerStarted","Data":"0d1eb99a198a06845c97da12c65780e49bc623146901e33c82fa59eda1331165"} Jul 28 12:35:20.520369 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:20.520328 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6qhph" podStartSLOduration=3.793015018 podStartE2EDuration="24.52031209s" totalImagesPullingTime="20.727297072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:34:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:20.520255155 +0000 UTC m=+24.644490956" watchObservedRunningTime="2026-07-28 12:35:20.52031209 +0000 UTC m=+24.644547894" Jul 28 12:35:21.258516 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:21.258477 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:21.329876 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:21.329824 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:21.399933 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:21.399898 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:22.177851 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:22.177815 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dw2z4" Jul 28 12:35:22.178512 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:22.178494 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dw2z4" Jul 28 12:35:22.374682 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:22.374646 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:22.374682 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:22.374681 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:22.374919 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:22.374647 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:22.374919 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:22.374784 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:22.374919 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:22.374899 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:22.375056 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:22.374979 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:22.511523 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:22.511453 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dw2z4" Jul 28 12:35:22.511943 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:22.511925 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dw2z4" Jul 28 12:35:22.576121 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:22.575981 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:23.514750 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:23.514715 2557 generic.go:356] "Generic (PLEG): container finished" podID="62215987-8385-4369-9a68-78c84e1f1266" containerID="ef0c6a86d26d6df4168b28f387ce2f82adddd24e6e0744c31c0caa473ebf0a73" exitCode=0 Jul 28 12:35:23.515549 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:23.514801 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hctxj" event={"ID":"62215987-8385-4369-9a68-78c84e1f1266","Type":"ContainerDied","Data":"ef0c6a86d26d6df4168b28f387ce2f82adddd24e6e0744c31c0caa473ebf0a73"} Jul 28 12:35:23.518547 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:23.518519 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" event={"ID":"ba1a46e7-6d6d-4e75-aa63-cb578ee8da7c","Type":"ContainerStarted","Data":"7eca2df4d3aff0854aa34ced5c59e0959ff6f7fc6b1fafc0eb7d812508adccc5"} Jul 28 12:35:23.518760 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:23.518744 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:35:23.533774 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:23.533755 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:35:23.560470 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:23.560429 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" podStartSLOduration=8.83750717 podStartE2EDuration="27.560414833s" totalImagesPullingTime="18.722907663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:23.559538185 +0000 UTC m=+27.683773984" watchObservedRunningTime="2026-07-28 12:35:23.560414833 +0000 UTC m=+27.684650632" Jul 28 12:35:24.374034 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:24.373860 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:24.374238 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:24.373861 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:24.374238 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:24.374150 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:24.374238 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:24.373868 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:24.374238 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:24.374226 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:24.374389 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:24.374309 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:24.521059 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:24.521021 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:35:24.521526 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:24.521429 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:35:24.537118 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:24.537092 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:35:24.569201 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:24.569172 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-htckr"] Jul 28 12:35:24.569382 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:24.569266 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:24.569382 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:24.569367 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:24.572398 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:24.572362 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8mckt"] Jul 28 12:35:24.572557 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:24.572447 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:24.572557 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:24.572545 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:24.572979 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:24.572958 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z2bvn"] Jul 28 12:35:24.573082 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:24.573024 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:24.573127 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:24.573091 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:26.375294 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:26.375260 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:26.375754 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:26.375374 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:26.375754 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:26.375403 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:26.375754 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:26.375445 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:26.375754 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:26.375365 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:26.375754 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:26.375514 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:26.527495 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:26.527460 2557 generic.go:356] "Generic (PLEG): container finished" podID="62215987-8385-4369-9a68-78c84e1f1266" containerID="45606315bbc0a6a0624d59af09190d270b15dbcdd46d0f56c52202929bb3a768" exitCode=0 Jul 28 12:35:26.527665 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:26.527541 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hctxj" event={"ID":"62215987-8385-4369-9a68-78c84e1f1266","Type":"ContainerDied","Data":"45606315bbc0a6a0624d59af09190d270b15dbcdd46d0f56c52202929bb3a768"} Jul 28 12:35:28.374324 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:28.374118 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:28.374801 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:28.374114 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:28.374801 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:28.374394 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:28.374801 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:28.374156 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:28.374801 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:28.374476 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:28.374801 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:28.374556 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:28.534587 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:28.534557 2557 generic.go:356] "Generic (PLEG): container finished" podID="62215987-8385-4369-9a68-78c84e1f1266" containerID="a08628c718bae5ecd1377dd8c3fa5b1e5fd2cbb9f93f0c521b517786d14fa1fa" exitCode=0 Jul 28 12:35:28.534764 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:28.534598 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hctxj" event={"ID":"62215987-8385-4369-9a68-78c84e1f1266","Type":"ContainerDied","Data":"a08628c718bae5ecd1377dd8c3fa5b1e5fd2cbb9f93f0c521b517786d14fa1fa"} Jul 28 12:35:29.113371 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:29.113337 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:29.195094 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:29.195061 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:29.296187 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:29.296158 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:29.396500 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:29.396419 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:29.978948 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:29.978921 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret\") pod \"global-pull-secret-syncer-8mckt\" (UID: \"dfcf362b-2f70-4960-9560-109a7b677692\") " pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:29.979115 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:29.978957 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs\") pod \"network-metrics-daemon-z2bvn\" (UID: \"402ce15c-b3be-428c-99b3-20384ca207fb\") " pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:29.979115 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:29.979066 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:29.979214 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:29.979121 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret podName:dfcf362b-2f70-4960-9560-109a7b677692 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:01.979108564 +0000 UTC m=+66.103344344 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret") pod "global-pull-secret-syncer-8mckt" (UID: "dfcf362b-2f70-4960-9560-109a7b677692") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:35:29.979214 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:29.979066 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:29.979214 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:29.979192 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs podName:402ce15c-b3be-428c-99b3-20384ca207fb nodeName:}" failed. No retries permitted until 2026-07-28 12:36:01.979181303 +0000 UTC m=+66.103417095 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs") pod "network-metrics-daemon-z2bvn" (UID: "402ce15c-b3be-428c-99b3-20384ca207fb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:35:30.024427 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:30.024396 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:30.079933 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:30.079897 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhwlg\" (UniqueName: \"kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg\") pod \"network-check-target-htckr\" (UID: \"53fbd277-d44a-440c-a94f-803405595342\") " pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:30.080110 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:30.080078 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:35:30.080110 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:30.080099 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:35:30.080225 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:30.080113 2557 projected.go:196] Error preparing data for projected volume kube-api-access-jhwlg for pod openshift-network-diagnostics/network-check-target-htckr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:30.080225 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:30.080191 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg podName:53fbd277-d44a-440c-a94f-803405595342 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:02.080172519 +0000 UTC m=+66.204408297 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jhwlg" (UniqueName: "kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg") pod "network-check-target-htckr" (UID: "53fbd277-d44a-440c-a94f-803405595342") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:35:30.124380 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:30.124349 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:30.374978 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:30.374914 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:30.374978 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:30.374954 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:30.375248 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:30.374914 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:30.375248 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:30.375048 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-htckr" podUID="53fbd277-d44a-440c-a94f-803405595342" Jul 28 12:35:30.375248 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:30.375128 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2bvn" podUID="402ce15c-b3be-428c-99b3-20384ca207fb" Jul 28 12:35:30.375248 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:30.375232 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mckt" podUID="dfcf362b-2f70-4960-9560-109a7b677692" Jul 28 12:35:30.436969 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:30.436932 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:30.500250 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:30.500211 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:31.269820 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.269792 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeReady" Jul 28 12:35:31.269988 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.269978 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 12:35:31.325182 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.325132 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xhn6f"] Jul 28 12:35:31.328654 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.328631 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mqm6b"] Jul 28 12:35:31.328782 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.328753 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:31.330786 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.330762 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 12:35:31.330921 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.330841 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 12:35:31.331149 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.331119 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hhw68\"" Jul 28 12:35:31.332607 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.332585 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqm6b" Jul 28 12:35:31.334528 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.334511 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l2lc2\"" Jul 28 12:35:31.334816 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.334763 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 12:35:31.334816 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.334790 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 12:35:31.334971 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.334887 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 12:35:31.340876 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.340857 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xhn6f"] Jul 28 12:35:31.344778 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.344724 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mqm6b"] Jul 28 12:35:31.478999 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.478920 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:31.488972 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.488941 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rmvq\" (UniqueName: \"kubernetes.io/projected/79e554ec-3cf9-47c2-8c82-2dde86d3c221-kube-api-access-8rmvq\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:31.489121 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.489003 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79e554ec-3cf9-47c2-8c82-2dde86d3c221-config-volume\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:31.489121 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.489065 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79e554ec-3cf9-47c2-8c82-2dde86d3c221-tmp-dir\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:31.489121 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.489105 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:31.489121 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.489122 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6093022a-8be1-4ba2-94cc-3c2728666b3c-cert\") pod \"ingress-canary-mqm6b\" (UID: \"6093022a-8be1-4ba2-94cc-3c2728666b3c\") " pod="openshift-ingress-canary/ingress-canary-mqm6b" Jul 28 12:35:31.489305 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.489155 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwvhx\" (UniqueName: \"kubernetes.io/projected/6093022a-8be1-4ba2-94cc-3c2728666b3c-kube-api-access-lwvhx\") pod \"ingress-canary-mqm6b\" (UID: \"6093022a-8be1-4ba2-94cc-3c2728666b3c\") " pod="openshift-ingress-canary/ingress-canary-mqm6b" Jul 28 12:35:31.554912 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.554878 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:31.590270 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.590243 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rmvq\" (UniqueName: \"kubernetes.io/projected/79e554ec-3cf9-47c2-8c82-2dde86d3c221-kube-api-access-8rmvq\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:31.590448 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.590283 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79e554ec-3cf9-47c2-8c82-2dde86d3c221-config-volume\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:31.590448 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.590304 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79e554ec-3cf9-47c2-8c82-2dde86d3c221-tmp-dir\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:31.590448 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.590340 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:31.590448 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.590364 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6093022a-8be1-4ba2-94cc-3c2728666b3c-cert\") pod \"ingress-canary-mqm6b\" (UID: \"6093022a-8be1-4ba2-94cc-3c2728666b3c\") " pod="openshift-ingress-canary/ingress-canary-mqm6b" Jul 28 12:35:31.590448 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.590385 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwvhx\" (UniqueName: \"kubernetes.io/projected/6093022a-8be1-4ba2-94cc-3c2728666b3c-kube-api-access-lwvhx\") pod \"ingress-canary-mqm6b\" (UID: \"6093022a-8be1-4ba2-94cc-3c2728666b3c\") " pod="openshift-ingress-canary/ingress-canary-mqm6b" Jul 28 12:35:31.590700 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:31.590653 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:35:31.590700 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.590665 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79e554ec-3cf9-47c2-8c82-2dde86d3c221-tmp-dir\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:31.590810 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:31.590716 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls podName:79e554ec-3cf9-47c2-8c82-2dde86d3c221 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:32.090699871 +0000 UTC m=+36.214935647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls") pod "dns-default-xhn6f" (UID: "79e554ec-3cf9-47c2-8c82-2dde86d3c221") : secret "dns-default-metrics-tls" not found Jul 28 12:35:31.590872 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.590846 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79e554ec-3cf9-47c2-8c82-2dde86d3c221-config-volume\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:31.594977 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.594955 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6093022a-8be1-4ba2-94cc-3c2728666b3c-cert\") pod \"ingress-canary-mqm6b\" (UID: \"6093022a-8be1-4ba2-94cc-3c2728666b3c\") " pod="openshift-ingress-canary/ingress-canary-mqm6b" Jul 28 12:35:31.600071 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.600051 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwvhx\" (UniqueName: \"kubernetes.io/projected/6093022a-8be1-4ba2-94cc-3c2728666b3c-kube-api-access-lwvhx\") pod \"ingress-canary-mqm6b\" (UID: \"6093022a-8be1-4ba2-94cc-3c2728666b3c\") " pod="openshift-ingress-canary/ingress-canary-mqm6b" Jul 28 12:35:31.601267 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.601240 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rmvq\" (UniqueName: \"kubernetes.io/projected/79e554ec-3cf9-47c2-8c82-2dde86d3c221-kube-api-access-8rmvq\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:31.647341 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.647302 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqm6b" Jul 28 12:35:31.804206 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:31.804172 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mqm6b"] Jul 28 12:35:31.809708 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:35:31.809676 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6093022a_8be1_4ba2_94cc_3c2728666b3c.slice/crio-9b4ef3ad9ad7cf303fd451b586b60f41164b19daa32c04ef002c176e1d7cec79 WatchSource:0}: Error finding container 9b4ef3ad9ad7cf303fd451b586b60f41164b19daa32c04ef002c176e1d7cec79: Status 404 returned error can't find the container with id 9b4ef3ad9ad7cf303fd451b586b60f41164b19daa32c04ef002c176e1d7cec79 Jul 28 12:35:32.095390 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:32.095351 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:32.095582 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:32.095506 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:35:32.095582 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:32.095582 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls podName:79e554ec-3cf9-47c2-8c82-2dde86d3c221 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:33.095560501 +0000 UTC m=+37.219796279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls") pod "dns-default-xhn6f" (UID: "79e554ec-3cf9-47c2-8c82-2dde86d3c221") : secret "dns-default-metrics-tls" not found Jul 28 12:35:32.374883 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:32.374799 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:35:32.375056 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:32.374799 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:35:32.375056 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:32.374945 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:35:32.377377 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:32.377354 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 12:35:32.377377 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:32.377373 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 12:35:32.377965 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:32.377947 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 12:35:32.378097 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:32.378080 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7tstl\"" Jul 28 12:35:32.378181 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:32.377952 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dc2k9\"" Jul 28 12:35:32.378356 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:32.378338 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 12:35:32.544409 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:32.544374 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mqm6b" event={"ID":"6093022a-8be1-4ba2-94cc-3c2728666b3c","Type":"ContainerStarted","Data":"9b4ef3ad9ad7cf303fd451b586b60f41164b19daa32c04ef002c176e1d7cec79"} Jul 28 12:35:33.103560 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:33.103332 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:33.103747 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:33.103488 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:35:33.103747 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:33.103719 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls podName:79e554ec-3cf9-47c2-8c82-2dde86d3c221 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:35.103693455 +0000 UTC m=+39.227929237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls") pod "dns-default-xhn6f" (UID: "79e554ec-3cf9-47c2-8c82-2dde86d3c221") : secret "dns-default-metrics-tls" not found Jul 28 12:35:34.551699 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:34.551621 2557 generic.go:356] "Generic (PLEG): container finished" podID="62215987-8385-4369-9a68-78c84e1f1266" containerID="03a69b1f4830fa0a45eeaf2b1cfe65c6c0f43ccafd43e5babec07ce344d7e01e" exitCode=0 Jul 28 12:35:34.552156 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:34.551697 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hctxj" event={"ID":"62215987-8385-4369-9a68-78c84e1f1266","Type":"ContainerDied","Data":"03a69b1f4830fa0a45eeaf2b1cfe65c6c0f43ccafd43e5babec07ce344d7e01e"} Jul 28 12:35:35.117538 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:35.117499 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:35.117758 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:35.117639 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:35:35.117758 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:35.117709 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls podName:79e554ec-3cf9-47c2-8c82-2dde86d3c221 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:39.117690078 +0000 UTC m=+43.241925855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls") pod "dns-default-xhn6f" (UID: "79e554ec-3cf9-47c2-8c82-2dde86d3c221") : secret "dns-default-metrics-tls" not found Jul 28 12:35:35.153178 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:35.153125 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:35.285342 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:35.285310 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:35.556467 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:35.556437 2557 generic.go:356] "Generic (PLEG): container finished" podID="62215987-8385-4369-9a68-78c84e1f1266" containerID="91e3398db5e5ac8c532a2c03bc445e2cace7619b626ee9c6661e990f5cee0f90" exitCode=0 Jul 28 12:35:35.556823 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:35.556489 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hctxj" event={"ID":"62215987-8385-4369-9a68-78c84e1f1266","Type":"ContainerDied","Data":"91e3398db5e5ac8c532a2c03bc445e2cace7619b626ee9c6661e990f5cee0f90"} Jul 28 12:35:36.562229 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:36.562181 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hctxj" event={"ID":"62215987-8385-4369-9a68-78c84e1f1266","Type":"ContainerStarted","Data":"49b7b0305109ce525f8275da5d9aed6e6ee1f6bd2bb83c51735d45486ad0c3e9"} Jul 28 12:35:36.563528 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:36.563496 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mqm6b" event={"ID":"6093022a-8be1-4ba2-94cc-3c2728666b3c","Type":"ContainerStarted","Data":"80fb1889b3662244fadd26ebad59c06b7bee2bcbec0fa65fb8b14dc6da12f6f4"} Jul 28 12:35:36.586880 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:36.586828 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hctxj" podStartSLOduration=9.268510927 podStartE2EDuration="40.586806947s" totalImagesPullingTime="31.31829602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:34:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:36.586001379 +0000 UTC m=+40.710237191" watchObservedRunningTime="2026-07-28 12:35:36.586806947 +0000 UTC m=+40.711042769" Jul 28 12:35:36.604850 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:36.604797 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mqm6b" podStartSLOduration=1.69698008 podStartE2EDuration="5.60477486s" totalImagesPullingTime="3.90779478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:36.604059554 +0000 UTC m=+40.728295350" watchObservedRunningTime="2026-07-28 12:35:36.60477486 +0000 UTC m=+40.729010660" Jul 28 12:35:36.731484 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:36.731452 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:36.822603 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:36.822531 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:37.598240 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.598203 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l"] Jul 28 12:35:37.628512 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.628484 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-br7dg"] Jul 28 12:35:37.628671 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.628647 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:35:37.632305 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.632271 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 28 12:35:37.632305 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.632284 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 12:35:37.632506 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.632329 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 12:35:37.632506 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.632365 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w772c\"" Jul 28 12:35:37.632506 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.632375 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 28 12:35:37.648570 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.648546 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-56478d6f5-lmml8"] Jul 28 12:35:37.648570 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.648544 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:37.650572 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.650551 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 28 12:35:37.650721 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.650703 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 28 12:35:37.650777 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.650736 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 28 12:35:37.650937 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.650916 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 28 12:35:37.651175 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.651160 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vpl4m\"" Jul 28 12:35:37.658822 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.658803 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 28 12:35:37.672184 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.672159 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l"] Jul 28 12:35:37.672288 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.672192 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-br7dg"] Jul 28 12:35:37.672288 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.672206 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56478d6f5-lmml8"] Jul 28 12:35:37.672288 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.672254 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:37.674443 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.674421 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 28 12:35:37.674773 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.674759 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 28 12:35:37.674830 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.674789 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 28 12:35:37.675210 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.675189 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 28 12:35:37.675313 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.675241 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 28 12:35:37.675313 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.675292 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 28 12:35:37.675428 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.675319 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gdj6r\"" Jul 28 12:35:37.708337 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.708297 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l"] Jul 28 12:35:37.729242 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.729211 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74b6d599d6-85nxg"] Jul 28 12:35:37.729380 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.729320 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" Jul 28 12:35:37.732078 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.732056 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 28 12:35:37.732301 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.732285 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 28 12:35:37.732610 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.732388 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 28 12:35:37.732694 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.732435 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-sqlgb\"" Jul 28 12:35:37.735766 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.735735 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/849f14b1-2639-4b88-ad46-49fcb4b0aa04-serving-cert\") pod \"console-operator-584dcb6b54-br7dg\" (UID: \"849f14b1-2639-4b88-ad46-49fcb4b0aa04\") " pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:37.735859 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.735771 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-8jn6l\" (UID: \"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:35:37.735859 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.735802 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg6q7\" (UniqueName: \"kubernetes.io/projected/849f14b1-2639-4b88-ad46-49fcb4b0aa04-kube-api-access-fg6q7\") pod \"console-operator-584dcb6b54-br7dg\" (UID: \"849f14b1-2639-4b88-ad46-49fcb4b0aa04\") " pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:37.735992 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.735926 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/849f14b1-2639-4b88-ad46-49fcb4b0aa04-trusted-ca\") pod \"console-operator-584dcb6b54-br7dg\" (UID: \"849f14b1-2639-4b88-ad46-49fcb4b0aa04\") " pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:37.736177 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.736132 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-8jn6l\" (UID: \"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:35:37.736253 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.736215 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/849f14b1-2639-4b88-ad46-49fcb4b0aa04-config\") pod \"console-operator-584dcb6b54-br7dg\" (UID: \"849f14b1-2639-4b88-ad46-49fcb4b0aa04\") " pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:37.736253 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.736246 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47hqk\" (UniqueName: \"kubernetes.io/projected/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-kube-api-access-47hqk\") pod \"cluster-monitoring-operator-548b489cb8-8jn6l\" (UID: \"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:35:37.752643 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.752619 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-4qkf2"] Jul 28 12:35:37.752746 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.752730 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:37.754842 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.754814 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 12:35:37.754992 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.754898 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 12:35:37.755110 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.755097 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-smcc4\"" Jul 28 12:35:37.755187 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.755105 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 12:35:37.761281 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.761264 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 12:35:37.772679 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.772655 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l"] Jul 28 12:35:37.772772 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.772695 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-4qkf2"] Jul 28 12:35:37.772772 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.772714 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74b6d599d6-85nxg"] Jul 28 12:35:37.772772 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.772763 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-4qkf2" Jul 28 12:35:37.774824 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.774808 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-6vkkv\"" Jul 28 12:35:37.837522 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.837492 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47hqk\" (UniqueName: \"kubernetes.io/projected/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-kube-api-access-47hqk\") pod \"cluster-monitoring-operator-548b489cb8-8jn6l\" (UID: \"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:35:37.837695 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.837542 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/849f14b1-2639-4b88-ad46-49fcb4b0aa04-serving-cert\") pod \"console-operator-584dcb6b54-br7dg\" (UID: \"849f14b1-2639-4b88-ad46-49fcb4b0aa04\") " pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:37.837695 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.837570 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-8jn6l\" (UID: \"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:35:37.837695 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:37.837652 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 12:35:37.837804 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:37.837709 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls podName:4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab nodeName:}" failed. No retries permitted until 2026-07-28 12:35:38.337691557 +0000 UTC m=+42.461927335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-8jn6l" (UID: "4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab") : secret "cluster-monitoring-operator-tls" not found Jul 28 12:35:37.837804 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.837737 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-default-certificate\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:37.837804 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.837779 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg6q7\" (UniqueName: \"kubernetes.io/projected/849f14b1-2639-4b88-ad46-49fcb4b0aa04-kube-api-access-fg6q7\") pod \"console-operator-584dcb6b54-br7dg\" (UID: \"849f14b1-2639-4b88-ad46-49fcb4b0aa04\") " pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:37.837910 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.837865 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/849f14b1-2639-4b88-ad46-49fcb4b0aa04-trusted-ca\") pod \"console-operator-584dcb6b54-br7dg\" (UID: \"849f14b1-2639-4b88-ad46-49fcb4b0aa04\") " pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:37.837910 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.837897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkh68\" (UniqueName: \"kubernetes.io/projected/c5db00b3-fd88-446d-8bbb-a179e0852df6-kube-api-access-qkh68\") pod \"cluster-samples-operator-6748489656-c4f5l\" (UID: \"c5db00b3-fd88-446d-8bbb-a179e0852df6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" Jul 28 12:35:37.837978 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.837925 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-c4f5l\" (UID: \"c5db00b3-fd88-446d-8bbb-a179e0852df6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" Jul 28 12:35:37.838026 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.837981 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-8jn6l\" (UID: \"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:35:37.838080 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.838022 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:37.838080 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.838053 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:37.838080 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.838071 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-stats-auth\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:37.838251 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.838116 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/849f14b1-2639-4b88-ad46-49fcb4b0aa04-config\") pod \"console-operator-584dcb6b54-br7dg\" (UID: \"849f14b1-2639-4b88-ad46-49fcb4b0aa04\") " pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:37.838251 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.838203 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfsh7\" (UniqueName: \"kubernetes.io/projected/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-kube-api-access-gfsh7\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:37.838715 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.838691 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-8jn6l\" (UID: \"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:35:37.838715 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.838707 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/849f14b1-2639-4b88-ad46-49fcb4b0aa04-config\") pod \"console-operator-584dcb6b54-br7dg\" (UID: \"849f14b1-2639-4b88-ad46-49fcb4b0aa04\") " pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:37.838841 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.838699 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/849f14b1-2639-4b88-ad46-49fcb4b0aa04-trusted-ca\") pod \"console-operator-584dcb6b54-br7dg\" (UID: \"849f14b1-2639-4b88-ad46-49fcb4b0aa04\") " pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:37.840988 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.840969 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/849f14b1-2639-4b88-ad46-49fcb4b0aa04-serving-cert\") pod \"console-operator-584dcb6b54-br7dg\" (UID: \"849f14b1-2639-4b88-ad46-49fcb4b0aa04\") " pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:37.842857 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.842834 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:37.845799 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.845779 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg6q7\" (UniqueName: \"kubernetes.io/projected/849f14b1-2639-4b88-ad46-49fcb4b0aa04-kube-api-access-fg6q7\") pod \"console-operator-584dcb6b54-br7dg\" (UID: \"849f14b1-2639-4b88-ad46-49fcb4b0aa04\") " pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:37.845894 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.845873 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47hqk\" (UniqueName: \"kubernetes.io/projected/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-kube-api-access-47hqk\") pod \"cluster-monitoring-operator-548b489cb8-8jn6l\" (UID: \"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:35:37.931510 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.931425 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:37.938473 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.938449 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-c4f5l\" (UID: \"c5db00b3-fd88-446d-8bbb-a179e0852df6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" Jul 28 12:35:37.938564 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.938485 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkh68\" (UniqueName: \"kubernetes.io/projected/c5db00b3-fd88-446d-8bbb-a179e0852df6-kube-api-access-qkh68\") pod \"cluster-samples-operator-6748489656-c4f5l\" (UID: \"c5db00b3-fd88-446d-8bbb-a179e0852df6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" Jul 28 12:35:37.938564 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.938508 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/052d9c03-6817-49f4-b445-e3c0acba540a-trusted-ca\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:37.938564 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.938531 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:37.938564 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.938547 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:37.938728 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.938593 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/052d9c03-6817-49f4-b445-e3c0acba540a-registry-certificates\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:37.938728 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:37.938602 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 12:35:37.938728 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.938630 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfsh7\" (UniqueName: \"kubernetes.io/projected/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-kube-api-access-gfsh7\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:37.938728 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.938677 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh2ms\" (UniqueName: \"kubernetes.io/projected/267e909a-ce3b-4f41-a198-f86a223c803f-kube-api-access-wh2ms\") pod \"network-check-source-7d88cb55d8-4qkf2\" (UID: \"267e909a-ce3b-4f41-a198-f86a223c803f\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-4qkf2" Jul 28 12:35:37.938728 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:37.938711 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle podName:54e64e8c-6beb-4e4a-8da8-b7095e0950b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:38.438687119 +0000 UTC m=+42.562922918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle") pod "router-default-56478d6f5-lmml8" (UID: "54e64e8c-6beb-4e4a-8da8-b7095e0950b4") : configmap references non-existent config key: service-ca.crt Jul 28 12:35:37.938963 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:37.938791 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls podName:c5db00b3-fd88-446d-8bbb-a179e0852df6 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:38.438769995 +0000 UTC m=+42.563005778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls") pod "cluster-samples-operator-6748489656-c4f5l" (UID: "c5db00b3-fd88-446d-8bbb-a179e0852df6") : secret "samples-operator-tls" not found Jul 28 12:35:37.938963 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.938847 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/052d9c03-6817-49f4-b445-e3c0acba540a-installation-pull-secrets\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:37.938963 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.938905 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-stats-auth\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:37.939104 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.938973 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:37.939104 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.939000 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkgbr\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-kube-api-access-nkgbr\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:37.939104 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.939041 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-bound-sa-token\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:37.939257 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.939106 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/052d9c03-6817-49f4-b445-e3c0acba540a-image-registry-private-configuration\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:37.939257 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:37.939120 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 12:35:37.939257 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.939188 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/052d9c03-6817-49f4-b445-e3c0acba540a-ca-trust-extracted\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:37.939257 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:37.939248 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs podName:54e64e8c-6beb-4e4a-8da8-b7095e0950b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:38.439231856 +0000 UTC m=+42.563467638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs") pod "router-default-56478d6f5-lmml8" (UID: "54e64e8c-6beb-4e4a-8da8-b7095e0950b4") : secret "router-metrics-certs-default" not found Jul 28 12:35:37.939422 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.939295 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-default-certificate\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:37.941309 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.941278 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-stats-auth\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:37.941447 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.941433 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-default-certificate\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:37.949474 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.949452 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkh68\" (UniqueName: \"kubernetes.io/projected/c5db00b3-fd88-446d-8bbb-a179e0852df6-kube-api-access-qkh68\") pod \"cluster-samples-operator-6748489656-c4f5l\" (UID: \"c5db00b3-fd88-446d-8bbb-a179e0852df6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" Jul 28 12:35:37.949566 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.949484 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfsh7\" (UniqueName: \"kubernetes.io/projected/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-kube-api-access-gfsh7\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:37.958072 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:37.958050 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:38.031118 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.031081 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:38.040054 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.040029 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/052d9c03-6817-49f4-b445-e3c0acba540a-image-registry-private-configuration\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:38.040368 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.040065 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/052d9c03-6817-49f4-b445-e3c0acba540a-ca-trust-extracted\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:38.040484 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.040463 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/052d9c03-6817-49f4-b445-e3c0acba540a-trusted-ca\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:38.040618 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.040606 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:38.040699 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.040689 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/052d9c03-6817-49f4-b445-e3c0acba540a-registry-certificates\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:38.041057 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.040537 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/052d9c03-6817-49f4-b445-e3c0acba540a-ca-trust-extracted\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:38.041057 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:38.040765 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 12:35:38.041057 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:38.040783 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74b6d599d6-85nxg: secret "image-registry-tls" not found Jul 28 12:35:38.041057 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:38.040866 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls podName:052d9c03-6817-49f4-b445-e3c0acba540a nodeName:}" failed. No retries permitted until 2026-07-28 12:35:38.540831826 +0000 UTC m=+42.665067605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls") pod "image-registry-74b6d599d6-85nxg" (UID: "052d9c03-6817-49f4-b445-e3c0acba540a") : secret "image-registry-tls" not found Jul 28 12:35:38.041057 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.040769 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh2ms\" (UniqueName: \"kubernetes.io/projected/267e909a-ce3b-4f41-a198-f86a223c803f-kube-api-access-wh2ms\") pod \"network-check-source-7d88cb55d8-4qkf2\" (UID: \"267e909a-ce3b-4f41-a198-f86a223c803f\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-4qkf2" Jul 28 12:35:38.041057 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.041003 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/052d9c03-6817-49f4-b445-e3c0acba540a-installation-pull-secrets\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:38.041439 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.041075 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkgbr\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-kube-api-access-nkgbr\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:38.041439 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.041114 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-bound-sa-token\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:38.041439 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.041269 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/052d9c03-6817-49f4-b445-e3c0acba540a-trusted-ca\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:38.041439 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.041289 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/052d9c03-6817-49f4-b445-e3c0acba540a-registry-certificates\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:38.042587 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.042571 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/052d9c03-6817-49f4-b445-e3c0acba540a-image-registry-private-configuration\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:38.043659 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.043639 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/052d9c03-6817-49f4-b445-e3c0acba540a-installation-pull-secrets\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:38.054747 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.054694 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-bound-sa-token\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:38.055036 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.055015 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkgbr\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-kube-api-access-nkgbr\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:38.055452 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.055431 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh2ms\" (UniqueName: \"kubernetes.io/projected/267e909a-ce3b-4f41-a198-f86a223c803f-kube-api-access-wh2ms\") pod \"network-check-source-7d88cb55d8-4qkf2\" (UID: \"267e909a-ce3b-4f41-a198-f86a223c803f\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-4qkf2" Jul 28 12:35:38.080447 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.080421 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-4qkf2" Jul 28 12:35:38.109682 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.109662 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-br7dg"] Jul 28 12:35:38.110740 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.110696 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:38.113845 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:35:38.113822 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod849f14b1_2639_4b88_ad46_49fcb4b0aa04.slice/crio-eba82eed25b0398da11e9914fd7845b6def76497d2d29ee63c60c1c91278e96f WatchSource:0}: Error finding container eba82eed25b0398da11e9914fd7845b6def76497d2d29ee63c60c1c91278e96f: Status 404 returned error can't find the container with id eba82eed25b0398da11e9914fd7845b6def76497d2d29ee63c60c1c91278e96f Jul 28 12:35:38.232258 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.232221 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-4qkf2"] Jul 28 12:35:38.235716 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:35:38.235687 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod267e909a_ce3b_4f41_a198_f86a223c803f.slice/crio-7050661d748cae62037f5af99950e2d1a1de92ed0736da8804e13d3ef3fd194a WatchSource:0}: Error finding container 7050661d748cae62037f5af99950e2d1a1de92ed0736da8804e13d3ef3fd194a: Status 404 returned error can't find the container with id 7050661d748cae62037f5af99950e2d1a1de92ed0736da8804e13d3ef3fd194a Jul 28 12:35:38.344468 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.344423 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-8jn6l\" (UID: \"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:35:38.344637 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:38.344565 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 12:35:38.344675 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:38.344641 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls podName:4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab nodeName:}" failed. No retries permitted until 2026-07-28 12:35:39.344622016 +0000 UTC m=+43.468857793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-8jn6l" (UID: "4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab") : secret "cluster-monitoring-operator-tls" not found Jul 28 12:35:38.445604 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.445511 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:38.445604 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.445590 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-c4f5l\" (UID: \"c5db00b3-fd88-446d-8bbb-a179e0852df6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" Jul 28 12:35:38.445782 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:38.445663 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 12:35:38.445782 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.445700 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:38.445782 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:38.445669 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 12:35:38.445782 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:38.445725 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs podName:54e64e8c-6beb-4e4a-8da8-b7095e0950b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:39.445709829 +0000 UTC m=+43.569945606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs") pod "router-default-56478d6f5-lmml8" (UID: "54e64e8c-6beb-4e4a-8da8-b7095e0950b4") : secret "router-metrics-certs-default" not found Jul 28 12:35:38.445782 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:38.445776 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls podName:c5db00b3-fd88-446d-8bbb-a179e0852df6 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:39.445751065 +0000 UTC m=+43.569986842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls") pod "cluster-samples-operator-6748489656-c4f5l" (UID: "c5db00b3-fd88-446d-8bbb-a179e0852df6") : secret "samples-operator-tls" not found Jul 28 12:35:38.445932 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:38.445801 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle podName:54e64e8c-6beb-4e4a-8da8-b7095e0950b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:39.445790955 +0000 UTC m=+43.570026734 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle") pod "router-default-56478d6f5-lmml8" (UID: "54e64e8c-6beb-4e4a-8da8-b7095e0950b4") : configmap references non-existent config key: service-ca.crt Jul 28 12:35:38.546855 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.546815 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:38.547001 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:38.546978 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 12:35:38.547001 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:38.546999 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74b6d599d6-85nxg: secret "image-registry-tls" not found Jul 28 12:35:38.547083 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:38.547050 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls podName:052d9c03-6817-49f4-b445-e3c0acba540a nodeName:}" failed. No retries permitted until 2026-07-28 12:35:39.547035778 +0000 UTC m=+43.671271555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls") pod "image-registry-74b6d599d6-85nxg" (UID: "052d9c03-6817-49f4-b445-e3c0acba540a") : secret "image-registry-tls" not found Jul 28 12:35:38.572274 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.572237 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" event={"ID":"849f14b1-2639-4b88-ad46-49fcb4b0aa04","Type":"ContainerStarted","Data":"eba82eed25b0398da11e9914fd7845b6def76497d2d29ee63c60c1c91278e96f"} Jul 28 12:35:38.573319 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:38.573296 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-4qkf2" event={"ID":"267e909a-ce3b-4f41-a198-f86a223c803f","Type":"ContainerStarted","Data":"7050661d748cae62037f5af99950e2d1a1de92ed0736da8804e13d3ef3fd194a"} Jul 28 12:35:39.152456 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:39.152415 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:39.152859 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:39.152592 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:35:39.152859 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:39.152678 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls podName:79e554ec-3cf9-47c2-8c82-2dde86d3c221 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:47.152654348 +0000 UTC m=+51.276890141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls") pod "dns-default-xhn6f" (UID: "79e554ec-3cf9-47c2-8c82-2dde86d3c221") : secret "dns-default-metrics-tls" not found Jul 28 12:35:39.354428 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:39.354382 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-8jn6l\" (UID: \"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:35:39.354597 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:39.354558 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 12:35:39.354680 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:39.354657 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls podName:4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab nodeName:}" failed. No retries permitted until 2026-07-28 12:35:41.354633502 +0000 UTC m=+45.478869279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-8jn6l" (UID: "4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab") : secret "cluster-monitoring-operator-tls" not found Jul 28 12:35:39.455275 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:39.455183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:39.455441 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:39.455335 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 12:35:39.455441 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:39.455356 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-c4f5l\" (UID: \"c5db00b3-fd88-446d-8bbb-a179e0852df6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" Jul 28 12:35:39.455441 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:39.455399 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs podName:54e64e8c-6beb-4e4a-8da8-b7095e0950b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:41.455384144 +0000 UTC m=+45.579619921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs") pod "router-default-56478d6f5-lmml8" (UID: "54e64e8c-6beb-4e4a-8da8-b7095e0950b4") : secret "router-metrics-certs-default" not found Jul 28 12:35:39.455601 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:39.455446 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:39.455601 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:39.455461 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 12:35:39.455601 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:39.455522 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls podName:c5db00b3-fd88-446d-8bbb-a179e0852df6 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:41.455506597 +0000 UTC m=+45.579742392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls") pod "cluster-samples-operator-6748489656-c4f5l" (UID: "c5db00b3-fd88-446d-8bbb-a179e0852df6") : secret "samples-operator-tls" not found Jul 28 12:35:39.455601 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:39.455541 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle podName:54e64e8c-6beb-4e4a-8da8-b7095e0950b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:41.455531488 +0000 UTC m=+45.579767270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle") pod "router-default-56478d6f5-lmml8" (UID: "54e64e8c-6beb-4e4a-8da8-b7095e0950b4") : configmap references non-existent config key: service-ca.crt Jul 28 12:35:39.556866 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:39.556822 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:39.557019 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:39.556973 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 12:35:39.557019 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:39.556995 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74b6d599d6-85nxg: secret "image-registry-tls" not found Jul 28 12:35:39.557102 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:39.557052 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls podName:052d9c03-6817-49f4-b445-e3c0acba540a nodeName:}" failed. No retries permitted until 2026-07-28 12:35:41.557035935 +0000 UTC m=+45.681271734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls") pod "image-registry-74b6d599d6-85nxg" (UID: "052d9c03-6817-49f4-b445-e3c0acba540a") : secret "image-registry-tls" not found Jul 28 12:35:40.580632 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:40.580607 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-br7dg_849f14b1-2639-4b88-ad46-49fcb4b0aa04/console-operator/0.log" Jul 28 12:35:40.581027 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:40.580654 2557 generic.go:356] "Generic (PLEG): container finished" podID="849f14b1-2639-4b88-ad46-49fcb4b0aa04" containerID="3c22a6c2e49cfdb4355b0077e2451fa028da5299ce10f1faccde81a5bb51168d" exitCode=255 Jul 28 12:35:40.581027 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:40.580724 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" event={"ID":"849f14b1-2639-4b88-ad46-49fcb4b0aa04","Type":"ContainerDied","Data":"3c22a6c2e49cfdb4355b0077e2451fa028da5299ce10f1faccde81a5bb51168d"} Jul 28 12:35:40.581027 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:40.580984 2557 scope.go:117] "RemoveContainer" containerID="3c22a6c2e49cfdb4355b0077e2451fa028da5299ce10f1faccde81a5bb51168d" Jul 28 12:35:41.253266 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:41.253230 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:41.352260 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:41.352202 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:41.372398 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:41.372365 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-8jn6l\" (UID: \"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:35:41.372576 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:41.372557 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 12:35:41.372677 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:41.372652 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls podName:4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab nodeName:}" failed. No retries permitted until 2026-07-28 12:35:45.372626719 +0000 UTC m=+49.496862498 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-8jn6l" (UID: "4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab") : secret "cluster-monitoring-operator-tls" not found Jul 28 12:35:41.454221 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:41.454171 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:41.473283 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:41.473249 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-c4f5l\" (UID: \"c5db00b3-fd88-446d-8bbb-a179e0852df6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" Jul 28 12:35:41.473445 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:41.473310 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:41.473445 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:41.473382 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:41.473445 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:41.473423 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 12:35:41.473593 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:41.473485 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls podName:c5db00b3-fd88-446d-8bbb-a179e0852df6 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:45.47346723 +0000 UTC m=+49.597703028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls") pod "cluster-samples-operator-6748489656-c4f5l" (UID: "c5db00b3-fd88-446d-8bbb-a179e0852df6") : secret "samples-operator-tls" not found Jul 28 12:35:41.473593 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:41.473506 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle podName:54e64e8c-6beb-4e4a-8da8-b7095e0950b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:45.473497139 +0000 UTC m=+49.597732916 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle") pod "router-default-56478d6f5-lmml8" (UID: "54e64e8c-6beb-4e4a-8da8-b7095e0950b4") : configmap references non-existent config key: service-ca.crt Jul 28 12:35:41.473593 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:41.473548 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 12:35:41.473731 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:41.473610 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs podName:54e64e8c-6beb-4e4a-8da8-b7095e0950b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:45.473592371 +0000 UTC m=+49.597828154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs") pod "router-default-56478d6f5-lmml8" (UID: "54e64e8c-6beb-4e4a-8da8-b7095e0950b4") : secret "router-metrics-certs-default" not found Jul 28 12:35:41.574050 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:41.573947 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:41.574249 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:41.574148 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 12:35:41.574249 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:41.574175 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74b6d599d6-85nxg: secret "image-registry-tls" not found Jul 28 12:35:41.574249 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:41.574232 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls podName:052d9c03-6817-49f4-b445-e3c0acba540a nodeName:}" failed. No retries permitted until 2026-07-28 12:35:45.574213635 +0000 UTC m=+49.698449411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls") pod "image-registry-74b6d599d6-85nxg" (UID: "052d9c03-6817-49f4-b445-e3c0acba540a") : secret "image-registry-tls" not found Jul 28 12:35:41.584896 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:41.584869 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-br7dg_849f14b1-2639-4b88-ad46-49fcb4b0aa04/console-operator/1.log" Jul 28 12:35:41.585390 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:41.585372 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-br7dg_849f14b1-2639-4b88-ad46-49fcb4b0aa04/console-operator/0.log" Jul 28 12:35:41.585453 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:41.585415 2557 generic.go:356] "Generic (PLEG): container finished" podID="849f14b1-2639-4b88-ad46-49fcb4b0aa04" containerID="ec7f4809a63155f1cf71dff7108960e306e5e9fa1b565a3fe668d44297b7cd63" exitCode=255 Jul 28 12:35:41.585494 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:41.585476 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" event={"ID":"849f14b1-2639-4b88-ad46-49fcb4b0aa04","Type":"ContainerDied","Data":"ec7f4809a63155f1cf71dff7108960e306e5e9fa1b565a3fe668d44297b7cd63"} Jul 28 12:35:41.585577 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:41.585528 2557 scope.go:117] "RemoveContainer" containerID="3c22a6c2e49cfdb4355b0077e2451fa028da5299ce10f1faccde81a5bb51168d" Jul 28 12:35:41.585739 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:41.585716 2557 scope.go:117] "RemoveContainer" containerID="ec7f4809a63155f1cf71dff7108960e306e5e9fa1b565a3fe668d44297b7cd63" Jul 28 12:35:41.585908 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:41.585886 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-br7dg_openshift-console-operator(849f14b1-2639-4b88-ad46-49fcb4b0aa04)\"" pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" podUID="849f14b1-2639-4b88-ad46-49fcb4b0aa04" Jul 28 12:35:42.313634 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:42.313601 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:42.589722 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:42.589697 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-br7dg_849f14b1-2639-4b88-ad46-49fcb4b0aa04/console-operator/1.log" Jul 28 12:35:42.590096 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:42.590003 2557 scope.go:117] "RemoveContainer" containerID="ec7f4809a63155f1cf71dff7108960e306e5e9fa1b565a3fe668d44297b7cd63" Jul 28 12:35:42.590184 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:42.590163 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-br7dg_openshift-console-operator(849f14b1-2639-4b88-ad46-49fcb4b0aa04)\"" pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" podUID="849f14b1-2639-4b88-ad46-49fcb4b0aa04" Jul 28 12:35:43.010013 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.009925 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:43.113661 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.113624 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vvd6l"] Jul 28 12:35:43.133543 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.133512 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:43.135626 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.135602 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 12:35:43.135750 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.135614 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cl7xz\"" Jul 28 12:35:43.136256 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.136238 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 12:35:43.136348 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.136238 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 12:35:43.136403 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.136291 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 12:35:43.141360 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.141337 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vvd6l"] Jul 28 12:35:43.160477 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.160449 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:43.186816 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.186778 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-crio-socket\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:43.186988 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.186908 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:43.187066 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.186999 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbp8n\" (UniqueName: \"kubernetes.io/projected/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-api-access-mbp8n\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:43.187066 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.187040 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-data-volume\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:43.187196 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.187086 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:43.280171 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.280077 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:43.288232 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.288203 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:43.288364 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.288278 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbp8n\" (UniqueName: \"kubernetes.io/projected/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-api-access-mbp8n\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:43.288364 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.288304 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-data-volume\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:43.288364 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.288344 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:43.288506 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:43.288370 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:35:43.288506 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.288400 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-crio-socket\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:43.288506 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:43.288437 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls podName:fac8dfed-eb29-45fc-a85d-98a4f5e1ee77 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:43.788417763 +0000 UTC m=+47.912653553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvd6l" (UID: "fac8dfed-eb29-45fc-a85d-98a4f5e1ee77") : secret "insights-runtime-extractor-tls" not found Jul 28 12:35:43.288506 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:43.288484 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 12:35:43.288687 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:43.288567 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm podName:fac8dfed-eb29-45fc-a85d-98a4f5e1ee77 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:43.788556859 +0000 UTC m=+47.912792643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvd6l" (UID: "fac8dfed-eb29-45fc-a85d-98a4f5e1ee77") : configmap "kube-rbac-proxy" not found Jul 28 12:35:43.288687 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.288590 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-crio-socket\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:43.288687 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.288674 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-data-volume\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:43.297250 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.297228 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbp8n\" (UniqueName: \"kubernetes.io/projected/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-api-access-mbp8n\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:43.381255 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.381215 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:43.518544 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.518511 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:43.594999 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.594960 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-4qkf2" event={"ID":"267e909a-ce3b-4f41-a198-f86a223c803f","Type":"ContainerStarted","Data":"24aec76136a2f041fed7c68ddf87c94e6f8506b26681183c13a28c7d8f31a0e9"} Jul 28 12:35:43.605978 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.605942 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:43.611735 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.611694 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-4qkf2" podStartSLOduration=2.144993244 podStartE2EDuration="6.611677135s" totalImagesPullingTime="4.466683891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:43.611291941 +0000 UTC m=+47.735527737" watchObservedRunningTime="2026-07-28 12:35:43.611677135 +0000 UTC m=+47.735912933" Jul 28 12:35:43.684221 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.684185 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:43.777586 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.777552 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:43.793017 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.792991 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:43.793116 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:43.793062 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:43.793185 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:43.793128 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:35:43.793185 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:43.793163 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 12:35:43.793274 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:43.793197 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls podName:fac8dfed-eb29-45fc-a85d-98a4f5e1ee77 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:44.79317898 +0000 UTC m=+48.917414757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvd6l" (UID: "fac8dfed-eb29-45fc-a85d-98a4f5e1ee77") : secret "insights-runtime-extractor-tls" not found Jul 28 12:35:43.793274 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:43.793216 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm podName:fac8dfed-eb29-45fc-a85d-98a4f5e1ee77 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:44.793206544 +0000 UTC m=+48.917442321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvd6l" (UID: "fac8dfed-eb29-45fc-a85d-98a4f5e1ee77") : configmap "kube-rbac-proxy" not found Jul 28 12:35:44.801673 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:44.801633 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:44.802092 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:44.801741 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:44.802092 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:44.801758 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 12:35:44.802092 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:44.801829 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:35:44.802092 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:44.801850 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm podName:fac8dfed-eb29-45fc-a85d-98a4f5e1ee77 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:46.801833807 +0000 UTC m=+50.926069587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvd6l" (UID: "fac8dfed-eb29-45fc-a85d-98a4f5e1ee77") : configmap "kube-rbac-proxy" not found Jul 28 12:35:44.802092 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:44.801874 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls podName:fac8dfed-eb29-45fc-a85d-98a4f5e1ee77 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:46.801863533 +0000 UTC m=+50.926099313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvd6l" (UID: "fac8dfed-eb29-45fc-a85d-98a4f5e1ee77") : secret "insights-runtime-extractor-tls" not found Jul 28 12:35:45.141066 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:45.141024 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:45.218116 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:45.218079 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:45.293515 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:45.293489 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v5n5n_6f6a422f-12a3-4a38-a815-885197adc8a3/dns-node-resolver/0.log" Jul 28 12:35:45.406621 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:45.406533 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-8jn6l\" (UID: \"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:35:45.406755 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:45.406680 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 12:35:45.406755 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:45.406745 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls podName:4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab nodeName:}" failed. No retries permitted until 2026-07-28 12:35:53.406728985 +0000 UTC m=+57.530964762 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-8jn6l" (UID: "4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab") : secret "cluster-monitoring-operator-tls" not found Jul 28 12:35:45.426996 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:45.426957 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:45.507633 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:45.507594 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:45.507796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:45.507678 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-c4f5l\" (UID: \"c5db00b3-fd88-446d-8bbb-a179e0852df6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" Jul 28 12:35:45.507796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:45.507720 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:45.507796 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:45.507741 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 12:35:45.507890 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:45.507800 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs podName:54e64e8c-6beb-4e4a-8da8-b7095e0950b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:53.5077832 +0000 UTC m=+57.632018977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs") pod "router-default-56478d6f5-lmml8" (UID: "54e64e8c-6beb-4e4a-8da8-b7095e0950b4") : secret "router-metrics-certs-default" not found Jul 28 12:35:45.507890 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:45.507814 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 12:35:45.507890 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:45.507840 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle podName:54e64e8c-6beb-4e4a-8da8-b7095e0950b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:53.507828141 +0000 UTC m=+57.632063936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle") pod "router-default-56478d6f5-lmml8" (UID: "54e64e8c-6beb-4e4a-8da8-b7095e0950b4") : configmap references non-existent config key: service-ca.crt Jul 28 12:35:45.507890 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:45.507855 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls podName:c5db00b3-fd88-446d-8bbb-a179e0852df6 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:53.507849175 +0000 UTC m=+57.632084952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls") pod "cluster-samples-operator-6748489656-c4f5l" (UID: "c5db00b3-fd88-446d-8bbb-a179e0852df6") : secret "samples-operator-tls" not found Jul 28 12:35:45.531509 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:45.531466 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:45.608121 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:45.608082 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:45.608295 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:45.608199 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 12:35:45.608295 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:45.608214 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74b6d599d6-85nxg: secret "image-registry-tls" not found Jul 28 12:35:45.608295 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:45.608271 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls podName:052d9c03-6817-49f4-b445-e3c0acba540a nodeName:}" failed. No retries permitted until 2026-07-28 12:35:53.60825322 +0000 UTC m=+57.732489016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls") pod "image-registry-74b6d599d6-85nxg" (UID: "052d9c03-6817-49f4-b445-e3c0acba540a") : secret "image-registry-tls" not found Jul 28 12:35:45.919301 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:45.919263 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:45.986548 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:45.986512 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:46.300813 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:46.300737 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xj4pd_bf30b692-7b37-45ee-8a67-262a2bdab3f3/node-ca/0.log" Jul 28 12:35:46.818701 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:46.818660 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:46.818879 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:46.818731 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:46.818879 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:46.818808 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 12:35:46.818879 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:46.818816 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:35:46.818879 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:46.818865 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm podName:fac8dfed-eb29-45fc-a85d-98a4f5e1ee77 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:50.818850213 +0000 UTC m=+54.943085990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvd6l" (UID: "fac8dfed-eb29-45fc-a85d-98a4f5e1ee77") : configmap "kube-rbac-proxy" not found Jul 28 12:35:46.818879 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:46.818877 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls podName:fac8dfed-eb29-45fc-a85d-98a4f5e1ee77 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:50.818871871 +0000 UTC m=+54.943107648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvd6l" (UID: "fac8dfed-eb29-45fc-a85d-98a4f5e1ee77") : secret "insights-runtime-extractor-tls" not found Jul 28 12:35:47.096058 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:47.096031 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mqm6b_6093022a-8be1-4ba2-94cc-3c2728666b3c/serve-healthcheck-canary/0.log" Jul 28 12:35:47.193217 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:47.193183 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:47.221438 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:47.221408 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:35:47.221573 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:47.221556 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:35:47.221627 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:47.221617 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls podName:79e554ec-3cf9-47c2-8c82-2dde86d3c221 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:03.221600864 +0000 UTC m=+67.345836642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls") pod "dns-default-xhn6f" (UID: "79e554ec-3cf9-47c2-8c82-2dde86d3c221") : secret "dns-default-metrics-tls" not found Jul 28 12:35:47.959058 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:47.959018 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:47.959216 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:47.959080 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:47.959440 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:47.959427 2557 scope.go:117] "RemoveContainer" containerID="ec7f4809a63155f1cf71dff7108960e306e5e9fa1b565a3fe668d44297b7cd63" Jul 28 12:35:47.959603 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:47.959583 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-br7dg_openshift-console-operator(849f14b1-2639-4b88-ad46-49fcb4b0aa04)\"" pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" podUID="849f14b1-2639-4b88-ad46-49fcb4b0aa04" Jul 28 12:35:50.215457 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:50.215404 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:50.320544 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:50.320501 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:50.426030 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:50.425998 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:50.542847 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:50.542760 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:50.631476 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:50.631441 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:50.853932 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:50.853902 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:50.854099 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:50.853979 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:50.854099 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:50.854058 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:35:50.854099 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:50.854065 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 12:35:50.854271 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:50.854121 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls podName:fac8dfed-eb29-45fc-a85d-98a4f5e1ee77 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:58.854108039 +0000 UTC m=+62.978343820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvd6l" (UID: "fac8dfed-eb29-45fc-a85d-98a4f5e1ee77") : secret "insights-runtime-extractor-tls" not found Jul 28 12:35:50.854271 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:50.854157 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm podName:fac8dfed-eb29-45fc-a85d-98a4f5e1ee77 nodeName:}" failed. No retries permitted until 2026-07-28 12:35:58.854130591 +0000 UTC m=+62.978366367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvd6l" (UID: "fac8dfed-eb29-45fc-a85d-98a4f5e1ee77") : configmap "kube-rbac-proxy" not found Jul 28 12:35:51.326490 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:51.326460 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:51.861354 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:51.861322 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:51.959494 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:51.959405 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:52.132814 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:52.132765 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:52.329795 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:52.329752 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:52.785247 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:52.785126 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:53.134233 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:53.134190 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:53.477867 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:53.477774 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-8jn6l\" (UID: \"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:35:53.478283 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:53.477906 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 12:35:53.478283 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:53.477964 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls podName:4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab nodeName:}" failed. No retries permitted until 2026-07-28 12:36:09.477949826 +0000 UTC m=+73.602185604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-8jn6l" (UID: "4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab") : secret "cluster-monitoring-operator-tls" not found Jul 28 12:35:53.578916 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:53.578875 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:53.579104 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:53.578982 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-c4f5l\" (UID: \"c5db00b3-fd88-446d-8bbb-a179e0852df6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" Jul 28 12:35:53.579104 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:53.579052 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:35:53.579104 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:53.579059 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 12:35:53.579295 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:53.579163 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs podName:54e64e8c-6beb-4e4a-8da8-b7095e0950b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:09.579118299 +0000 UTC m=+73.703354101 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs") pod "router-default-56478d6f5-lmml8" (UID: "54e64e8c-6beb-4e4a-8da8-b7095e0950b4") : secret "router-metrics-certs-default" not found Jul 28 12:35:53.579295 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:53.579207 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle podName:54e64e8c-6beb-4e4a-8da8-b7095e0950b4 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:09.579190265 +0000 UTC m=+73.703426046 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle") pod "router-default-56478d6f5-lmml8" (UID: "54e64e8c-6beb-4e4a-8da8-b7095e0950b4") : configmap references non-existent config key: service-ca.crt Jul 28 12:35:53.581358 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:53.581337 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5db00b3-fd88-446d-8bbb-a179e0852df6-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-c4f5l\" (UID: \"c5db00b3-fd88-446d-8bbb-a179e0852df6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" Jul 28 12:35:53.639293 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:53.639255 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" Jul 28 12:35:53.679525 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:53.679494 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:35:53.679688 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:53.679663 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 12:35:53.679730 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:53.679692 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74b6d599d6-85nxg: secret "image-registry-tls" not found Jul 28 12:35:53.679815 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:53.679805 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls podName:052d9c03-6817-49f4-b445-e3c0acba540a nodeName:}" failed. No retries permitted until 2026-07-28 12:36:09.679779544 +0000 UTC m=+73.804015338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls") pod "image-registry-74b6d599d6-85nxg" (UID: "052d9c03-6817-49f4-b445-e3c0acba540a") : secret "image-registry-tls" not found Jul 28 12:35:53.741290 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:53.741215 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:53.766096 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:53.766068 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l"] Jul 28 12:35:53.920039 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:53.920002 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:54.131335 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:54.131305 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:54.620698 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:54.620662 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" event={"ID":"c5db00b3-fd88-446d-8bbb-a179e0852df6","Type":"ContainerStarted","Data":"afd00497742b2358fd4ac623c82f8352f1bf17a6dc5f61064f5f058951317351"} Jul 28 12:35:54.982559 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:54.982445 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:55.045564 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:55.045513 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:55.128719 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:55.128686 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:55.575311 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:55.575277 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:56.133771 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:56.133689 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:56.335776 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:56.335743 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:56.531465 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:56.531430 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:56.544755 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:56.544731 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4hrl" Jul 28 12:35:56.618769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:56.618694 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:56.627235 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:56.627207 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" event={"ID":"c5db00b3-fd88-446d-8bbb-a179e0852df6","Type":"ContainerStarted","Data":"d286cf451c7748e7b8563531614a5f043b650a4ff4fddb6d741d6ebda462112a"} Jul 28 12:35:56.627369 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:56.627260 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" event={"ID":"c5db00b3-fd88-446d-8bbb-a179e0852df6","Type":"ContainerStarted","Data":"c31ea767c68e88a5eaba3c07f3db92761502d9ac0e01677fdd65d4174cadd0da"} Jul 28 12:35:56.921799 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:56.921726 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:57.123122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:57.123089 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:57.532917 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:57.532884 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:58.328154 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:58.328097 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:58.530626 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:58.530592 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:58.738582 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:58.738499 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:58.806324 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:58.806293 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:58.924266 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:58.924225 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:58.924430 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:58.924292 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:58.924430 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:58.924374 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:35:58.924503 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:35:58.924441 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls podName:fac8dfed-eb29-45fc-a85d-98a4f5e1ee77 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:14.92442523 +0000 UTC m=+79.048661008 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvd6l" (UID: "fac8dfed-eb29-45fc-a85d-98a4f5e1ee77") : secret "insights-runtime-extractor-tls" not found Jul 28 12:35:58.924732 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:58.924715 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:35:59.119965 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:59.119931 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:59.374366 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:59.374294 2557 scope.go:117] "RemoveContainer" containerID="ec7f4809a63155f1cf71dff7108960e306e5e9fa1b565a3fe668d44297b7cd63" Jul 28 12:35:59.518043 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:59.518010 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:35:59.637375 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:59.637299 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-br7dg_849f14b1-2639-4b88-ad46-49fcb4b0aa04/console-operator/1.log" Jul 28 12:35:59.637375 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:59.637353 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" event={"ID":"849f14b1-2639-4b88-ad46-49fcb4b0aa04","Type":"ContainerStarted","Data":"7863d98eb411551f7d32232814a300ef56b6e7e4dc0f13d97a4761087f651dba"} Jul 28 12:35:59.637638 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:59.637618 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:35:59.655251 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:59.655201 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-c4f5l" podStartSLOduration=20.425522253 podStartE2EDuration="22.655184429s" totalImagesPullingTime="2.229662176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:56.64971311 +0000 UTC m=+60.773948907" watchObservedRunningTime="2026-07-28 12:35:59.655184429 +0000 UTC m=+63.779420228" Jul 28 12:35:59.655440 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:35:59.655419 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" podStartSLOduration=20.370853373 podStartE2EDuration="22.655415225s" totalImagesPullingTime="2.284561852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:59.654821551 +0000 UTC m=+63.779057384" watchObservedRunningTime="2026-07-28 12:35:59.655415225 +0000 UTC m=+63.779651082" Jul 28 12:36:00.269604 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:00.269573 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-br7dg" Jul 28 12:36:00.863876 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:00.863847 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:00.962346 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:00.962315 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:01.139519 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:01.139441 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:01.241283 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:01.241258 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:02.051496 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.051457 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret\") pod \"global-pull-secret-syncer-8mckt\" (UID: \"dfcf362b-2f70-4960-9560-109a7b677692\") " pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:36:02.051496 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.051494 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs\") pod \"network-metrics-daemon-z2bvn\" (UID: \"402ce15c-b3be-428c-99b3-20384ca207fb\") " pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:36:02.055378 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.055349 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 12:36:02.055768 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.055750 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 12:36:02.064467 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.064441 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfcf362b-2f70-4960-9560-109a7b677692-original-pull-secret\") pod \"global-pull-secret-syncer-8mckt\" (UID: \"dfcf362b-2f70-4960-9560-109a7b677692\") " pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:36:02.064577 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.064467 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/402ce15c-b3be-428c-99b3-20384ca207fb-metrics-certs\") pod \"network-metrics-daemon-z2bvn\" (UID: \"402ce15c-b3be-428c-99b3-20384ca207fb\") " pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:36:02.093682 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.093649 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mckt" Jul 28 12:36:02.102589 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.102563 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7tstl\"" Jul 28 12:36:02.110584 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.110562 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2bvn" Jul 28 12:36:02.152928 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.152886 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhwlg\" (UniqueName: \"kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg\") pod \"network-check-target-htckr\" (UID: \"53fbd277-d44a-440c-a94f-803405595342\") " pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:36:02.156419 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.156360 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhwlg\" (UniqueName: \"kubernetes.io/projected/53fbd277-d44a-440c-a94f-803405595342-kube-api-access-jhwlg\") pod \"network-check-target-htckr\" (UID: \"53fbd277-d44a-440c-a94f-803405595342\") " pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:36:02.172383 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.172282 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:02.225010 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.224978 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8mckt"] Jul 28 12:36:02.227767 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:36:02.227738 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfcf362b_2f70_4960_9560_109a7b677692.slice/crio-a3e8f290a60975d7c1732d2940192a40da54bd07e4e78b2e2c93e37bc3eb5a83 WatchSource:0}: Error finding container a3e8f290a60975d7c1732d2940192a40da54bd07e4e78b2e2c93e37bc3eb5a83: Status 404 returned error can't find the container with id a3e8f290a60975d7c1732d2940192a40da54bd07e4e78b2e2c93e37bc3eb5a83 Jul 28 12:36:02.236035 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.235981 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:02.240557 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.240533 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z2bvn"] Jul 28 12:36:02.242912 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:36:02.242890 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402ce15c_b3be_428c_99b3_20384ca207fb.slice/crio-7e2c4e4aa95aee462b06ccc6fd57ea613585f53f51675645b338a838bb49692c WatchSource:0}: Error finding container 7e2c4e4aa95aee462b06ccc6fd57ea613585f53f51675645b338a838bb49692c: Status 404 returned error can't find the container with id 7e2c4e4aa95aee462b06ccc6fd57ea613585f53f51675645b338a838bb49692c Jul 28 12:36:02.389531 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.389505 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dc2k9\"" Jul 28 12:36:02.397510 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.397487 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:36:02.449551 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.449456 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:02.517320 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.517286 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-htckr"] Jul 28 12:36:02.520109 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:36:02.520082 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53fbd277_d44a_440c_a94f_803405595342.slice/crio-0b80b729faac06f0d35a151afd97bc6788091e2e00c163b57452120f49f69e90 WatchSource:0}: Error finding container 0b80b729faac06f0d35a151afd97bc6788091e2e00c163b57452120f49f69e90: Status 404 returned error can't find the container with id 0b80b729faac06f0d35a151afd97bc6788091e2e00c163b57452120f49f69e90 Jul 28 12:36:02.560636 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.560614 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:02.646181 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.646080 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8mckt" event={"ID":"dfcf362b-2f70-4960-9560-109a7b677692","Type":"ContainerStarted","Data":"a3e8f290a60975d7c1732d2940192a40da54bd07e4e78b2e2c93e37bc3eb5a83"} Jul 28 12:36:02.647358 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.647331 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-htckr" event={"ID":"53fbd277-d44a-440c-a94f-803405595342","Type":"ContainerStarted","Data":"ff232853fd18c86f9440f62f5c8a8688160f248829fcae6c9882e1744255834e"} Jul 28 12:36:02.647482 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.647377 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-htckr" event={"ID":"53fbd277-d44a-440c-a94f-803405595342","Type":"ContainerStarted","Data":"0b80b729faac06f0d35a151afd97bc6788091e2e00c163b57452120f49f69e90"} Jul 28 12:36:02.647482 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.647414 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:36:02.648442 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.648422 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z2bvn" event={"ID":"402ce15c-b3be-428c-99b3-20384ca207fb","Type":"ContainerStarted","Data":"7e2c4e4aa95aee462b06ccc6fd57ea613585f53f51675645b338a838bb49692c"} Jul 28 12:36:02.665477 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.665436 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-htckr" podStartSLOduration=66.665423359 podStartE2EDuration="1m6.665423359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:34:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:02.664704433 +0000 UTC m=+66.788940256" watchObservedRunningTime="2026-07-28 12:36:02.665423359 +0000 UTC m=+66.789659137" Jul 28 12:36:02.963005 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:02.962926 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:03.262206 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:03.262106 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:36:03.264802 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:03.264776 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79e554ec-3cf9-47c2-8c82-2dde86d3c221-metrics-tls\") pod \"dns-default-xhn6f\" (UID: \"79e554ec-3cf9-47c2-8c82-2dde86d3c221\") " pod="openshift-dns/dns-default-xhn6f" Jul 28 12:36:03.441848 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:03.441812 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hhw68\"" Jul 28 12:36:03.450627 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:03.450602 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xhn6f" Jul 28 12:36:03.613554 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:03.613522 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xhn6f"] Jul 28 12:36:03.617487 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:36:03.617450 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e554ec_3cf9_47c2_8c82_2dde86d3c221.slice/crio-569711912e93a2d369a637cda82ac3519348232ac68e50c43627600bfe97033c WatchSource:0}: Error finding container 569711912e93a2d369a637cda82ac3519348232ac68e50c43627600bfe97033c: Status 404 returned error can't find the container with id 569711912e93a2d369a637cda82ac3519348232ac68e50c43627600bfe97033c Jul 28 12:36:03.654119 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:03.654073 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xhn6f" event={"ID":"79e554ec-3cf9-47c2-8c82-2dde86d3c221","Type":"ContainerStarted","Data":"569711912e93a2d369a637cda82ac3519348232ac68e50c43627600bfe97033c"} Jul 28 12:36:04.660416 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:04.660345 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z2bvn" event={"ID":"402ce15c-b3be-428c-99b3-20384ca207fb","Type":"ContainerStarted","Data":"cd02f77aa98013383ad0ffcc47b23e521c97c433c42b9913c17cee5979bcfa56"} Jul 28 12:36:05.666449 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:05.666418 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z2bvn" event={"ID":"402ce15c-b3be-428c-99b3-20384ca207fb","Type":"ContainerStarted","Data":"4c5d699abd7fb245a0a24ffc1eef509ca89317172fbbc6e04f47553a290f59d0"} Jul 28 12:36:05.704492 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:05.704427 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z2bvn" podStartSLOduration=67.54070089 podStartE2EDuration="1m9.704403428s" totalImagesPullingTime="2.163702538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:05.702832499 +0000 UTC m=+69.827068297" watchObservedRunningTime="2026-07-28 12:36:05.704403428 +0000 UTC m=+69.828639230" Jul 28 12:36:07.675228 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:07.675186 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xhn6f" event={"ID":"79e554ec-3cf9-47c2-8c82-2dde86d3c221","Type":"ContainerStarted","Data":"26be560ebc1c72d51b67b0cc89a9ae17f76680b42b4d700250f9b9e33069aa5b"} Jul 28 12:36:07.675786 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:07.675253 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xhn6f" event={"ID":"79e554ec-3cf9-47c2-8c82-2dde86d3c221","Type":"ContainerStarted","Data":"bc46521d94653398c7165002f069056885af5b717eef2b9556f45854fbac6266"} Jul 28 12:36:07.675786 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:07.675304 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xhn6f" Jul 28 12:36:07.676935 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:07.676905 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8mckt" event={"ID":"dfcf362b-2f70-4960-9560-109a7b677692","Type":"ContainerStarted","Data":"21e35a959ce3aa54ebf3e7ec38d21e069561dd886414ff9a6bc6a7e290bfe026"} Jul 28 12:36:07.703030 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:07.702982 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xhn6f" podStartSLOduration=33.591587072 podStartE2EDuration="36.70296666s" totalImagesPullingTime="3.111379588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:07.702373873 +0000 UTC m=+71.826609671" watchObservedRunningTime="2026-07-28 12:36:07.70296666 +0000 UTC m=+71.827202459" Jul 28 12:36:07.723369 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:07.723324 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8mckt" podStartSLOduration=67.216383246 podStartE2EDuration="1m11.72330957s" totalImagesPullingTime="4.506926324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:07.722367641 +0000 UTC m=+71.846603442" watchObservedRunningTime="2026-07-28 12:36:07.72330957 +0000 UTC m=+71.847545370" Jul 28 12:36:09.046850 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.046817 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4"] Jul 28 12:36:09.050080 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.050059 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4" Jul 28 12:36:09.053570 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.053551 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 12:36:09.053658 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.053556 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 28 12:36:09.053658 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.053584 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 12:36:09.054287 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.054269 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 12:36:09.076869 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.076843 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4"] Jul 28 12:36:09.114499 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.114471 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bea89c0d-419f-4333-a437-6e79a79c5848-klusterlet-config\") pod \"klusterlet-addon-workmgr-6969dd484-4rmc4\" (UID: \"bea89c0d-419f-4333-a437-6e79a79c5848\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4" Jul 28 12:36:09.114634 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.114535 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bea89c0d-419f-4333-a437-6e79a79c5848-tmp\") pod \"klusterlet-addon-workmgr-6969dd484-4rmc4\" (UID: \"bea89c0d-419f-4333-a437-6e79a79c5848\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4" Jul 28 12:36:09.114634 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.114603 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6h4b\" (UniqueName: \"kubernetes.io/projected/bea89c0d-419f-4333-a437-6e79a79c5848-kube-api-access-q6h4b\") pod \"klusterlet-addon-workmgr-6969dd484-4rmc4\" (UID: \"bea89c0d-419f-4333-a437-6e79a79c5848\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4" Jul 28 12:36:09.118896 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.118873 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74b6d599d6-85nxg"] Jul 28 12:36:09.119093 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:36:09.119074 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" podUID="052d9c03-6817-49f4-b445-e3c0acba540a" Jul 28 12:36:09.215683 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.215646 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bea89c0d-419f-4333-a437-6e79a79c5848-tmp\") pod \"klusterlet-addon-workmgr-6969dd484-4rmc4\" (UID: \"bea89c0d-419f-4333-a437-6e79a79c5848\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4" Jul 28 12:36:09.215839 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.215696 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6h4b\" (UniqueName: \"kubernetes.io/projected/bea89c0d-419f-4333-a437-6e79a79c5848-kube-api-access-q6h4b\") pod \"klusterlet-addon-workmgr-6969dd484-4rmc4\" (UID: \"bea89c0d-419f-4333-a437-6e79a79c5848\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4" Jul 28 12:36:09.215839 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.215763 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bea89c0d-419f-4333-a437-6e79a79c5848-klusterlet-config\") pod \"klusterlet-addon-workmgr-6969dd484-4rmc4\" (UID: \"bea89c0d-419f-4333-a437-6e79a79c5848\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4" Jul 28 12:36:09.216178 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.216131 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bea89c0d-419f-4333-a437-6e79a79c5848-tmp\") pod \"klusterlet-addon-workmgr-6969dd484-4rmc4\" (UID: \"bea89c0d-419f-4333-a437-6e79a79c5848\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4" Jul 28 12:36:09.218218 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.218196 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bea89c0d-419f-4333-a437-6e79a79c5848-klusterlet-config\") pod \"klusterlet-addon-workmgr-6969dd484-4rmc4\" (UID: \"bea89c0d-419f-4333-a437-6e79a79c5848\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4" Jul 28 12:36:09.256360 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.256329 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:09.262289 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.262268 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6h4b\" (UniqueName: \"kubernetes.io/projected/bea89c0d-419f-4333-a437-6e79a79c5848-kube-api-access-q6h4b\") pod \"klusterlet-addon-workmgr-6969dd484-4rmc4\" (UID: \"bea89c0d-419f-4333-a437-6e79a79c5848\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4" Jul 28 12:36:09.359575 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.359542 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4" Jul 28 12:36:09.436073 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.436037 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:09.515774 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.515752 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4"] Jul 28 12:36:09.517736 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.517710 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-8jn6l\" (UID: \"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:36:09.518111 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:36:09.518090 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea89c0d_419f_4333_a437_6e79a79c5848.slice/crio-a55edc08bb87f7b0fb1fd6bf2ff73d3f2f4aea7dc7806526a2c9b5619b9480fb WatchSource:0}: Error finding container a55edc08bb87f7b0fb1fd6bf2ff73d3f2f4aea7dc7806526a2c9b5619b9480fb: Status 404 returned error can't find the container with id a55edc08bb87f7b0fb1fd6bf2ff73d3f2f4aea7dc7806526a2c9b5619b9480fb Jul 28 12:36:09.520178 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.520114 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-8jn6l\" (UID: \"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:36:09.608968 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.608929 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:09.619173 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.619089 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:36:09.619341 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.619183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:36:09.619769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.619749 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-service-ca-bundle\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:36:09.621430 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.621413 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/54e64e8c-6beb-4e4a-8da8-b7095e0950b4-metrics-certs\") pod \"router-default-56478d6f5-lmml8\" (UID: \"54e64e8c-6beb-4e4a-8da8-b7095e0950b4\") " pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:36:09.685736 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.685706 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:36:09.685736 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.685717 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4" event={"ID":"bea89c0d-419f-4333-a437-6e79a79c5848","Type":"ContainerStarted","Data":"a55edc08bb87f7b0fb1fd6bf2ff73d3f2f4aea7dc7806526a2c9b5619b9480fb"} Jul 28 12:36:09.693552 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.693528 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:36:09.720131 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.720099 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:36:09.722380 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.722361 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls\") pod \"image-registry-74b6d599d6-85nxg\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:36:09.742147 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.742119 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w772c\"" Jul 28 12:36:09.749280 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.749263 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" Jul 28 12:36:09.783594 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.783566 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gdj6r\"" Jul 28 12:36:09.792369 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.792341 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:36:09.824212 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.821421 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-bound-sa-token\") pod \"052d9c03-6817-49f4-b445-e3c0acba540a\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " Jul 28 12:36:09.824212 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.821483 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls\") pod \"052d9c03-6817-49f4-b445-e3c0acba540a\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " Jul 28 12:36:09.824212 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.821515 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/052d9c03-6817-49f4-b445-e3c0acba540a-image-registry-private-configuration\") pod \"052d9c03-6817-49f4-b445-e3c0acba540a\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " Jul 28 12:36:09.824212 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.821555 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkgbr\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-kube-api-access-nkgbr\") pod \"052d9c03-6817-49f4-b445-e3c0acba540a\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " Jul 28 12:36:09.824212 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.821599 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/052d9c03-6817-49f4-b445-e3c0acba540a-trusted-ca\") pod \"052d9c03-6817-49f4-b445-e3c0acba540a\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " Jul 28 12:36:09.824212 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.821641 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/052d9c03-6817-49f4-b445-e3c0acba540a-installation-pull-secrets\") pod \"052d9c03-6817-49f4-b445-e3c0acba540a\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " Jul 28 12:36:09.824212 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.821733 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/052d9c03-6817-49f4-b445-e3c0acba540a-registry-certificates\") pod \"052d9c03-6817-49f4-b445-e3c0acba540a\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " Jul 28 12:36:09.824212 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.821761 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/052d9c03-6817-49f4-b445-e3c0acba540a-ca-trust-extracted\") pod \"052d9c03-6817-49f4-b445-e3c0acba540a\" (UID: \"052d9c03-6817-49f4-b445-e3c0acba540a\") " Jul 28 12:36:09.824212 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.822277 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052d9c03-6817-49f4-b445-e3c0acba540a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "052d9c03-6817-49f4-b445-e3c0acba540a" (UID: "052d9c03-6817-49f4-b445-e3c0acba540a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 12:36:09.825323 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.824720 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:09.825454 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.825398 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/052d9c03-6817-49f4-b445-e3c0acba540a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "052d9c03-6817-49f4-b445-e3c0acba540a" (UID: "052d9c03-6817-49f4-b445-e3c0acba540a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:36:09.825763 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.825714 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/052d9c03-6817-49f4-b445-e3c0acba540a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "052d9c03-6817-49f4-b445-e3c0acba540a" (UID: "052d9c03-6817-49f4-b445-e3c0acba540a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:36:09.830868 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.830838 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "052d9c03-6817-49f4-b445-e3c0acba540a" (UID: "052d9c03-6817-49f4-b445-e3c0acba540a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:36:09.831039 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.831011 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/052d9c03-6817-49f4-b445-e3c0acba540a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "052d9c03-6817-49f4-b445-e3c0acba540a" (UID: "052d9c03-6817-49f4-b445-e3c0acba540a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:36:09.831129 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.831081 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-kube-api-access-nkgbr" (OuterVolumeSpecName: "kube-api-access-nkgbr") pod "052d9c03-6817-49f4-b445-e3c0acba540a" (UID: "052d9c03-6817-49f4-b445-e3c0acba540a"). InnerVolumeSpecName "kube-api-access-nkgbr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:36:09.831356 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.831333 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "052d9c03-6817-49f4-b445-e3c0acba540a" (UID: "052d9c03-6817-49f4-b445-e3c0acba540a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:36:09.831472 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.831345 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/052d9c03-6817-49f4-b445-e3c0acba540a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "052d9c03-6817-49f4-b445-e3c0acba540a" (UID: "052d9c03-6817-49f4-b445-e3c0acba540a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:36:09.923396 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.923362 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/052d9c03-6817-49f4-b445-e3c0acba540a-registry-certificates\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:36:09.923396 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.923390 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/052d9c03-6817-49f4-b445-e3c0acba540a-ca-trust-extracted\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:36:09.923396 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.923402 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-bound-sa-token\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:36:09.923620 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.923412 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-registry-tls\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:36:09.923620 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.923420 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/052d9c03-6817-49f4-b445-e3c0acba540a-image-registry-private-configuration\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:36:09.923620 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.923428 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkgbr\" (UniqueName: \"kubernetes.io/projected/052d9c03-6817-49f4-b445-e3c0acba540a-kube-api-access-nkgbr\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:36:09.923620 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.923436 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/052d9c03-6817-49f4-b445-e3c0acba540a-trusted-ca\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:36:09.923620 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.923446 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/052d9c03-6817-49f4-b445-e3c0acba540a-installation-pull-secrets\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:36:09.932997 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.932940 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l"] Jul 28 12:36:09.936932 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:36:09.936903 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f4d5e6a_4f3e_4a58_9217_80d2b71cf7ab.slice/crio-903d47257acb622bc9f82731dca3b8fecf6dfbef5b39cd7e0c56355e3867531f WatchSource:0}: Error finding container 903d47257acb622bc9f82731dca3b8fecf6dfbef5b39cd7e0c56355e3867531f: Status 404 returned error can't find the container with id 903d47257acb622bc9f82731dca3b8fecf6dfbef5b39cd7e0c56355e3867531f Jul 28 12:36:09.967545 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.967514 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56478d6f5-lmml8"] Jul 28 12:36:09.969258 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:36:09.969232 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e64e8c_6beb_4e4a_8da8_b7095e0950b4.slice/crio-913c9cbca8b20b3e443f3aa1cba4ae493abc11fbcc7365a6c39d8aab5317beca WatchSource:0}: Error finding container 913c9cbca8b20b3e443f3aa1cba4ae493abc11fbcc7365a6c39d8aab5317beca: Status 404 returned error can't find the container with id 913c9cbca8b20b3e443f3aa1cba4ae493abc11fbcc7365a6c39d8aab5317beca Jul 28 12:36:09.978366 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:09.978344 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:10.692191 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:10.691972 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" event={"ID":"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab","Type":"ContainerStarted","Data":"903d47257acb622bc9f82731dca3b8fecf6dfbef5b39cd7e0c56355e3867531f"} Jul 28 12:36:10.695533 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:10.695505 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74b6d599d6-85nxg" Jul 28 12:36:10.696593 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:10.696514 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56478d6f5-lmml8" event={"ID":"54e64e8c-6beb-4e4a-8da8-b7095e0950b4","Type":"ContainerStarted","Data":"666046e2b66364b4a8300a32735305fa1ec3c72539a08e936732e36fb1ce2ee0"} Jul 28 12:36:10.696593 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:10.696561 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56478d6f5-lmml8" event={"ID":"54e64e8c-6beb-4e4a-8da8-b7095e0950b4","Type":"ContainerStarted","Data":"913c9cbca8b20b3e443f3aa1cba4ae493abc11fbcc7365a6c39d8aab5317beca"} Jul 28 12:36:10.736288 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:10.736206 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-56478d6f5-lmml8" podStartSLOduration=33.736182701 podStartE2EDuration="33.736182701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:10.734541648 +0000 UTC m=+74.858777448" watchObservedRunningTime="2026-07-28 12:36:10.736182701 +0000 UTC m=+74.860418501" Jul 28 12:36:10.778534 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:10.778504 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74b6d599d6-85nxg"] Jul 28 12:36:10.780995 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:10.780944 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74b6d599d6-85nxg"] Jul 28 12:36:10.792540 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:10.792483 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:36:10.795498 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:10.795467 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:36:11.700431 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:11.700333 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:36:11.702092 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:11.702068 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-56478d6f5-lmml8" Jul 28 12:36:12.004578 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.004490 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:12.023670 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.023636 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-857c8bbfb9-wl5fk"] Jul 28 12:36:12.026736 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.026712 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.030709 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.030688 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 12:36:12.030862 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.030814 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 12:36:12.030940 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.030908 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 12:36:12.031174 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.031123 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 12:36:12.031372 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.031347 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 12:36:12.031660 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.031642 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 12:36:12.031773 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.031753 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lwprw\"" Jul 28 12:36:12.031856 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.031830 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 12:36:12.051830 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.051799 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-857c8bbfb9-wl5fk"] Jul 28 12:36:12.092988 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.092948 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:12.142082 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.142039 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-oauth-serving-cert\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.142268 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.142089 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-console-config\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.142268 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.142118 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfda3fae-a409-4757-9c4c-667d27863e0f-console-oauth-config\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.142268 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.142182 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-service-ca\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.142268 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.142205 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlxst\" (UniqueName: \"kubernetes.io/projected/cfda3fae-a409-4757-9c4c-667d27863e0f-kube-api-access-wlxst\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.142268 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.142245 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfda3fae-a409-4757-9c4c-667d27863e0f-console-serving-cert\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.242637 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.242598 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfda3fae-a409-4757-9c4c-667d27863e0f-console-serving-cert\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.242833 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.242675 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-oauth-serving-cert\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.242833 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.242707 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-console-config\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.242833 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.242733 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfda3fae-a409-4757-9c4c-667d27863e0f-console-oauth-config\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.242833 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.242769 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-service-ca\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.242833 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.242794 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlxst\" (UniqueName: \"kubernetes.io/projected/cfda3fae-a409-4757-9c4c-667d27863e0f-kube-api-access-wlxst\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.243612 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.243586 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-console-config\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.243725 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.243626 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-service-ca\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.243725 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.243677 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-oauth-serving-cert\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.245399 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.245373 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfda3fae-a409-4757-9c4c-667d27863e0f-console-serving-cert\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.245568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.245530 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfda3fae-a409-4757-9c4c-667d27863e0f-console-oauth-config\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.252446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.252417 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlxst\" (UniqueName: \"kubernetes.io/projected/cfda3fae-a409-4757-9c4c-667d27863e0f-kube-api-access-wlxst\") pod \"console-857c8bbfb9-wl5fk\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.336988 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.336954 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:12.379447 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:12.379413 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="052d9c03-6817-49f4-b445-e3c0acba540a" path="/var/lib/kubelet/pods/052d9c03-6817-49f4-b445-e3c0acba540a/volumes" Jul 28 12:36:14.002533 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.002463 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-857c8bbfb9-wl5fk"] Jul 28 12:36:14.011350 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:36:14.011323 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfda3fae_a409_4757_9c4c_667d27863e0f.slice/crio-d4f28c1b9a070c7d4bab5629514323fafef2a58f88e0d702f48af6463a34b2f8 WatchSource:0}: Error finding container d4f28c1b9a070c7d4bab5629514323fafef2a58f88e0d702f48af6463a34b2f8: Status 404 returned error can't find the container with id d4f28c1b9a070c7d4bab5629514323fafef2a58f88e0d702f48af6463a34b2f8 Jul 28 12:36:14.031964 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.031933 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dc6dfdc84-llcbh"] Jul 28 12:36:14.054429 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.054397 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc6dfdc84-llcbh"] Jul 28 12:36:14.055507 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.055477 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:14.068207 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.068179 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.083740 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.083678 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 12:36:14.139568 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.139536 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:14.156716 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.156687 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-config\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.156716 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.156720 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-service-ca\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.156922 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.156754 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-trusted-ca-bundle\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.156922 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.156785 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-oauth-serving-cert\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.156922 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.156803 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcgwt\" (UniqueName: \"kubernetes.io/projected/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-kube-api-access-fcgwt\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.156922 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.156832 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-oauth-config\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.157061 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.156969 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-serving-cert\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.258463 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.258367 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-trusted-ca-bundle\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.259179 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.258776 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-oauth-serving-cert\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.259179 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.258839 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcgwt\" (UniqueName: \"kubernetes.io/projected/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-kube-api-access-fcgwt\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.259179 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.258906 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-oauth-config\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.259417 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.259303 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-serving-cert\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.259417 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.259358 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-config\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.259417 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.259387 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-service-ca\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.262168 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.260426 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-trusted-ca-bundle\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.262168 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.260799 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-service-ca\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.262168 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.260881 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-oauth-serving-cert\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.262168 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.261542 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-config\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.262753 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.262727 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-oauth-config\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.266719 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.266699 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-serving-cert\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.281324 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.281295 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcgwt\" (UniqueName: \"kubernetes.io/projected/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-kube-api-access-fcgwt\") pod \"console-dc6dfdc84-llcbh\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.336362 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.336276 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:14.380199 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.380169 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:14.445946 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.445902 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:14.516420 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.516384 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc6dfdc84-llcbh"] Jul 28 12:36:14.519727 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:36:14.519700 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf14bd413_4d84_4f54_bb51_7a3ea2b5e98c.slice/crio-db56f3a5c35fc0cea666c72a1a5c3d440bbad9616c6812efca4e86915d916346 WatchSource:0}: Error finding container db56f3a5c35fc0cea666c72a1a5c3d440bbad9616c6812efca4e86915d916346: Status 404 returned error can't find the container with id db56f3a5c35fc0cea666c72a1a5c3d440bbad9616c6812efca4e86915d916346 Jul 28 12:36:14.543674 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.543650 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:14.636784 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.636696 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:14.713349 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.713301 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc6dfdc84-llcbh" event={"ID":"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c","Type":"ContainerStarted","Data":"db56f3a5c35fc0cea666c72a1a5c3d440bbad9616c6812efca4e86915d916346"} Jul 28 12:36:14.716604 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.716566 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4" event={"ID":"bea89c0d-419f-4333-a437-6e79a79c5848","Type":"ContainerStarted","Data":"9b642bea94d8bad6e2f8c2ed5266d08b2c003dfb18f91acc0503851f6ec4d60a"} Jul 28 12:36:14.716752 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.716632 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4" Jul 28 12:36:14.719180 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.719006 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4" Jul 28 12:36:14.720058 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.719972 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857c8bbfb9-wl5fk" event={"ID":"cfda3fae-a409-4757-9c4c-667d27863e0f","Type":"ContainerStarted","Data":"d4f28c1b9a070c7d4bab5629514323fafef2a58f88e0d702f48af6463a34b2f8"} Jul 28 12:36:14.722381 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.722357 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" event={"ID":"4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab","Type":"ContainerStarted","Data":"6edcb84b565f125235aece54eeb574b051eb9d00cfa20a3a2843b1e24c6e9dbf"} Jul 28 12:36:14.738360 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.737791 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6969dd484-4rmc4" podStartSLOduration=1.392212488 podStartE2EDuration="5.737771741s" totalImagesPullingTime="4.345559253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:36:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:14.737635147 +0000 UTC m=+78.861870947" watchObservedRunningTime="2026-07-28 12:36:14.737771741 +0000 UTC m=+78.862007541" Jul 28 12:36:14.770870 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.770811 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-8jn6l" podStartSLOduration=33.862394748 podStartE2EDuration="37.770788819s" totalImagesPullingTime="3.908394071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:14.769985227 +0000 UTC m=+78.894221038" watchObservedRunningTime="2026-07-28 12:36:14.770788819 +0000 UTC m=+78.895024619" Jul 28 12:36:14.966571 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.966486 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:36:14.974361 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:14.974296 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fac8dfed-eb29-45fc-a85d-98a4f5e1ee77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvd6l\" (UID: \"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77\") " pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:36:15.208751 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:15.208678 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:15.246079 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:15.245827 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cl7xz\"" Jul 28 12:36:15.254672 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:15.254373 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vvd6l" Jul 28 12:36:15.443699 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:15.443641 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vvd6l"] Jul 28 12:36:15.446803 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:36:15.446772 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac8dfed_eb29_45fc_a85d_98a4f5e1ee77.slice/crio-ef3a80240178649ab0c0a28fdf1707acca5f73bd663a5aec5a113cc02e67bb13 WatchSource:0}: Error finding container ef3a80240178649ab0c0a28fdf1707acca5f73bd663a5aec5a113cc02e67bb13: Status 404 returned error can't find the container with id ef3a80240178649ab0c0a28fdf1707acca5f73bd663a5aec5a113cc02e67bb13 Jul 28 12:36:15.731351 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:15.731276 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvd6l" event={"ID":"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77","Type":"ContainerStarted","Data":"ef3a80240178649ab0c0a28fdf1707acca5f73bd663a5aec5a113cc02e67bb13"} Jul 28 12:36:17.682850 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:17.682773 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xhn6f" Jul 28 12:36:17.861697 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:17.861650 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:17.960969 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:17.960875 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:18.289682 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:18.289534 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:18.363823 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:18.363795 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:18.747859 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:18.747821 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857c8bbfb9-wl5fk" event={"ID":"cfda3fae-a409-4757-9c4c-667d27863e0f","Type":"ContainerStarted","Data":"2ce06c169e169e8c4476f6b57f50929fd0668ab1c821cecc2363da30904d7b7a"} Jul 28 12:36:18.749516 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:18.749490 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc6dfdc84-llcbh" event={"ID":"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c","Type":"ContainerStarted","Data":"9a1ba80b007f69c53d12c8327092c627db9b61a72ef761995ffe608964129fd0"} Jul 28 12:36:18.769659 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:18.769606 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-857c8bbfb9-wl5fk" podStartSLOduration=3.951428278 podStartE2EDuration="7.769587335s" totalImagesPullingTime="3.818159057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:18.76953498 +0000 UTC m=+82.893770815" watchObservedRunningTime="2026-07-28 12:36:18.769587335 +0000 UTC m=+82.893823136" Jul 28 12:36:18.792303 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:18.792249 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dc6dfdc84-llcbh" podStartSLOduration=2.47214052 podStartE2EDuration="5.792230399s" totalImagesPullingTime="3.320089879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:36:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:18.790631966 +0000 UTC m=+82.914867797" watchObservedRunningTime="2026-07-28 12:36:18.792230399 +0000 UTC m=+82.916466197" Jul 28 12:36:19.301657 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.301622 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:19.384255 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.384217 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:19.545623 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.545571 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:19.624845 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.624806 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:19.627951 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.627926 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-76d9s"] Jul 28 12:36:19.658505 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.658469 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-76d9s"] Jul 28 12:36:19.658670 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.658547 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" Jul 28 12:36:19.661352 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.661317 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 12:36:19.661352 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.661334 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 28 12:36:19.661352 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.661323 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-psvb6\"" Jul 28 12:36:19.661611 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.661341 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 28 12:36:19.699120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.699075 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:19.767991 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.767957 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:19.808277 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.808227 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af5c3673-59b7-40d9-9877-525c4ec85bbd-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-76d9s\" (UID: \"af5c3673-59b7-40d9-9877-525c4ec85bbd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" Jul 28 12:36:19.808474 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.808282 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9lfl\" (UniqueName: \"kubernetes.io/projected/af5c3673-59b7-40d9-9877-525c4ec85bbd-kube-api-access-d9lfl\") pod \"prometheus-operator-84d69f794d-76d9s\" (UID: \"af5c3673-59b7-40d9-9877-525c4ec85bbd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" Jul 28 12:36:19.808474 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.808337 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/af5c3673-59b7-40d9-9877-525c4ec85bbd-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-76d9s\" (UID: \"af5c3673-59b7-40d9-9877-525c4ec85bbd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" Jul 28 12:36:19.808474 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.808436 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af5c3673-59b7-40d9-9877-525c4ec85bbd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-76d9s\" (UID: \"af5c3673-59b7-40d9-9877-525c4ec85bbd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" Jul 28 12:36:19.909855 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.909766 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af5c3673-59b7-40d9-9877-525c4ec85bbd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-76d9s\" (UID: \"af5c3673-59b7-40d9-9877-525c4ec85bbd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" Jul 28 12:36:19.910680 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.910080 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af5c3673-59b7-40d9-9877-525c4ec85bbd-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-76d9s\" (UID: \"af5c3673-59b7-40d9-9877-525c4ec85bbd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" Jul 28 12:36:19.910680 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.910167 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9lfl\" (UniqueName: \"kubernetes.io/projected/af5c3673-59b7-40d9-9877-525c4ec85bbd-kube-api-access-d9lfl\") pod \"prometheus-operator-84d69f794d-76d9s\" (UID: \"af5c3673-59b7-40d9-9877-525c4ec85bbd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" Jul 28 12:36:19.910680 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.910322 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/af5c3673-59b7-40d9-9877-525c4ec85bbd-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-76d9s\" (UID: \"af5c3673-59b7-40d9-9877-525c4ec85bbd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" Jul 28 12:36:19.910894 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.910726 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af5c3673-59b7-40d9-9877-525c4ec85bbd-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-76d9s\" (UID: \"af5c3673-59b7-40d9-9877-525c4ec85bbd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" Jul 28 12:36:19.912667 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.912645 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af5c3673-59b7-40d9-9877-525c4ec85bbd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-76d9s\" (UID: \"af5c3673-59b7-40d9-9877-525c4ec85bbd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" Jul 28 12:36:19.912923 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.912906 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/af5c3673-59b7-40d9-9877-525c4ec85bbd-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-76d9s\" (UID: \"af5c3673-59b7-40d9-9877-525c4ec85bbd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" Jul 28 12:36:19.923530 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.923505 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9lfl\" (UniqueName: \"kubernetes.io/projected/af5c3673-59b7-40d9-9877-525c4ec85bbd-kube-api-access-d9lfl\") pod \"prometheus-operator-84d69f794d-76d9s\" (UID: \"af5c3673-59b7-40d9-9877-525c4ec85bbd\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" Jul 28 12:36:19.969522 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:19.969478 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" Jul 28 12:36:20.838540 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:20.838513 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-76d9s"] Jul 28 12:36:20.840810 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:36:20.840785 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf5c3673_59b7_40d9_9877_525c4ec85bbd.slice/crio-e33c4a1912b8e0b3698cc2c5e2d0f1902edeafcf16cf068df616bceb462ee70d WatchSource:0}: Error finding container e33c4a1912b8e0b3698cc2c5e2d0f1902edeafcf16cf068df616bceb462ee70d: Status 404 returned error can't find the container with id e33c4a1912b8e0b3698cc2c5e2d0f1902edeafcf16cf068df616bceb462ee70d Jul 28 12:36:21.764375 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:21.764280 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" event={"ID":"af5c3673-59b7-40d9-9877-525c4ec85bbd","Type":"ContainerStarted","Data":"e33c4a1912b8e0b3698cc2c5e2d0f1902edeafcf16cf068df616bceb462ee70d"} Jul 28 12:36:21.766686 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:21.766653 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvd6l" event={"ID":"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77","Type":"ContainerStarted","Data":"0f828f5a64d9d96c3c9be256469f3145641a3591c7650017a7a6dce1bb9a7af8"} Jul 28 12:36:22.337620 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:22.337581 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:22.337984 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:22.337659 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:22.343243 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:22.343215 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:22.532531 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:22.532457 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:22.773668 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:22.773454 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" event={"ID":"af5c3673-59b7-40d9-9877-525c4ec85bbd","Type":"ContainerStarted","Data":"7b580c9e8b3f441181249e45f7b7a296968bba2026711f1ae9e78b690d3def42"} Jul 28 12:36:22.773668 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:22.773523 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" event={"ID":"af5c3673-59b7-40d9-9877-525c4ec85bbd","Type":"ContainerStarted","Data":"beb2bedc3ab53d762be1da3ca80d628b959ef63ef9c1e90aabf6947b6dbcdef1"} Jul 28 12:36:22.778035 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:22.778005 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:22.797904 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:22.797771 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-76d9s" podStartSLOduration=2.5078236670000003 podStartE2EDuration="3.797755523s" totalImagesPullingTime="1.289931856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:36:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:22.796881007 +0000 UTC m=+86.921116806" watchObservedRunningTime="2026-07-28 12:36:22.797755523 +0000 UTC m=+86.921991323" Jul 28 12:36:23.581617 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:23.581547 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:23.682428 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:23.682397 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:24.380909 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:24.380882 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:24.381100 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:24.380937 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:24.385979 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:24.385952 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:24.401354 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:24.401318 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:24.489219 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:24.489189 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:24.594121 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:24.594089 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:24.710639 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:24.710540 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:24.782746 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:24.782711 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvd6l" event={"ID":"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77","Type":"ContainerStarted","Data":"35c2253600839d2e6de86c4f22f0be76a1024476a84954d3925f45143ade8261"} Jul 28 12:36:24.786795 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:24.786770 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:36:24.862493 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:24.862465 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:24.890897 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:24.890864 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-857c8bbfb9-wl5fk"] Jul 28 12:36:25.010680 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.010597 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:25.144691 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.144654 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:25.274233 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.274122 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t"] Jul 28 12:36:25.277712 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.277676 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7ngqn"] Jul 28 12:36:25.277859 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.277806 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.281028 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.281000 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xn6t6\"" Jul 28 12:36:25.281223 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.281065 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.281668 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.281630 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 28 12:36:25.282039 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.282018 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 28 12:36:25.285400 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.285377 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 28 12:36:25.287827 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.287805 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 12:36:25.287919 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.287867 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 12:36:25.289054 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.289036 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x6xhj\"" Jul 28 12:36:25.292954 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.292932 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 12:36:25.351074 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.351042 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:25.376256 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.375887 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t"] Jul 28 12:36:25.434461 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.434426 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:25.456003 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.455966 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-metrics-client-ca\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.456206 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.456007 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab5d40e6-3c8b-4962-ba56-844204bac934-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.456206 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.456038 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab5d40e6-3c8b-4962-ba56-844204bac934-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.456206 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.456110 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.456206 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.456157 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-sys\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.456206 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.456183 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-root\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.456492 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.456266 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab5d40e6-3c8b-4962-ba56-844204bac934-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.456492 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.456385 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab5d40e6-3c8b-4962-ba56-844204bac934-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.456492 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.456439 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.456655 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.456545 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zqn4\" (UniqueName: \"kubernetes.io/projected/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-kube-api-access-5zqn4\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.456655 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.456598 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab5d40e6-3c8b-4962-ba56-844204bac934-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.456655 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.456628 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nrqh\" (UniqueName: \"kubernetes.io/projected/ab5d40e6-3c8b-4962-ba56-844204bac934-kube-api-access-8nrqh\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.456791 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.456670 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-node-exporter-textfile\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.456791 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.456700 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-node-exporter-tls\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.456791 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.456725 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-node-exporter-wtmp\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.535927 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.535842 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:25.558086 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558045 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.558310 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558094 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-sys\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.558310 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558115 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-root\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.558310 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558188 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-root\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.558310 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558195 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-sys\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.558310 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558232 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab5d40e6-3c8b-4962-ba56-844204bac934-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.558310 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558257 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab5d40e6-3c8b-4962-ba56-844204bac934-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.558310 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558289 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.558663 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558328 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zqn4\" (UniqueName: \"kubernetes.io/projected/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-kube-api-access-5zqn4\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.558663 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:36:25.558408 2557 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 28 12:36:25.558663 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558458 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab5d40e6-3c8b-4962-ba56-844204bac934-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.558663 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:36:25.558487 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab5d40e6-3c8b-4962-ba56-844204bac934-kube-state-metrics-tls podName:ab5d40e6-3c8b-4962-ba56-844204bac934 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:26.058464801 +0000 UTC m=+90.182700593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ab5d40e6-3c8b-4962-ba56-844204bac934-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-9ws6t" (UID: "ab5d40e6-3c8b-4962-ba56-844204bac934") : secret "kube-state-metrics-tls" not found Jul 28 12:36:25.558663 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558529 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nrqh\" (UniqueName: \"kubernetes.io/projected/ab5d40e6-3c8b-4962-ba56-844204bac934-kube-api-access-8nrqh\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.558663 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558578 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-node-exporter-textfile\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.558663 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558607 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-node-exporter-tls\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.558663 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558632 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-node-exporter-wtmp\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.559921 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558669 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-metrics-client-ca\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.559921 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558693 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab5d40e6-3c8b-4962-ba56-844204bac934-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.559921 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.558727 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab5d40e6-3c8b-4962-ba56-844204bac934-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.559921 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.559095 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ab5d40e6-3c8b-4962-ba56-844204bac934-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.559921 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.559250 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ab5d40e6-3c8b-4962-ba56-844204bac934-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.559921 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.559505 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-node-exporter-textfile\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.559921 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.559724 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-node-exporter-wtmp\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.559921 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.559856 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab5d40e6-3c8b-4962-ba56-844204bac934-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.560344 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.560113 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.560598 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.560544 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-metrics-client-ca\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.561311 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.561277 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab5d40e6-3c8b-4962-ba56-844204bac934-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.561751 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.561706 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-node-exporter-tls\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.562092 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.562070 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.572013 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.571986 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zqn4\" (UniqueName: \"kubernetes.io/projected/6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a-kube-api-access-5zqn4\") pod \"node-exporter-7ngqn\" (UID: \"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a\") " pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.573500 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.573476 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nrqh\" (UniqueName: \"kubernetes.io/projected/ab5d40e6-3c8b-4962-ba56-844204bac934-kube-api-access-8nrqh\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:25.596348 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.596320 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7ngqn" Jul 28 12:36:25.649297 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.649199 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:25.751279 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.751229 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:25.789248 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.789172 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7ngqn" event={"ID":"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a","Type":"ContainerStarted","Data":"cb190056df3801d6bc879a710e4dd4965dd152999b5dfd4945f226b5b1e2f975"} Jul 28 12:36:25.969182 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:25.969119 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:26.063907 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:26.063087 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab5d40e6-3c8b-4962-ba56-844204bac934-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:26.066188 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:26.066157 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ab5d40e6-3c8b-4962-ba56-844204bac934-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-9ws6t\" (UID: \"ab5d40e6-3c8b-4962-ba56-844204bac934\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:26.089278 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:26.089242 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:26.190132 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:26.190095 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" Jul 28 12:36:26.324051 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:26.323924 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:26.384612 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:26.384584 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t"] Jul 28 12:36:26.613393 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:26.613354 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:26.714261 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:26.714233 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:26.794932 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:26.794890 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" event={"ID":"ab5d40e6-3c8b-4962-ba56-844204bac934","Type":"ContainerStarted","Data":"f4d343ce414c90177d08a068021a52853550958a0f5deab0de05dd36e277f1db"} Jul 28 12:36:28.006317 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:28.006272 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:28.805434 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:28.805338 2557 generic.go:356] "Generic (PLEG): container finished" podID="6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a" containerID="b0207896db3993f5817ae0740ab4115a8b239140ff65d0a638de38bb9f1c88a0" exitCode=0 Jul 28 12:36:28.805598 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:28.805428 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7ngqn" event={"ID":"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a","Type":"ContainerDied","Data":"b0207896db3993f5817ae0740ab4115a8b239140ff65d0a638de38bb9f1c88a0"} Jul 28 12:36:28.810218 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:28.810169 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvd6l" event={"ID":"fac8dfed-eb29-45fc-a85d-98a4f5e1ee77","Type":"ContainerStarted","Data":"bc1df5e9a857d0fa603c9457bfc6bf6813be571932388ae729d83858bde948b8"} Jul 28 12:36:28.825121 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:28.825081 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:28.851933 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:28.851877 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vvd6l" podStartSLOduration=32.967484962 podStartE2EDuration="45.851853736s" totalImagesPullingTime="12.884368774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:35:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:28.850568004 +0000 UTC m=+92.974803804" watchObservedRunningTime="2026-07-28 12:36:28.851853736 +0000 UTC m=+92.976089536" Jul 28 12:36:28.923748 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:28.923714 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:29.141814 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:29.141778 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:29.818134 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:29.818041 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7ngqn" event={"ID":"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a","Type":"ContainerStarted","Data":"91d72a5e624906f455b450cf00508af109d979bb600ba8d51585713f4d5f654c"} Jul 28 12:36:29.818134 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:29.818108 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7ngqn" event={"ID":"6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a","Type":"ContainerStarted","Data":"54e348c158f305ab3d948680463eb563b521fb435fc07106a6945c8db46f5a3b"} Jul 28 12:36:29.820298 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:29.820266 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" event={"ID":"ab5d40e6-3c8b-4962-ba56-844204bac934","Type":"ContainerStarted","Data":"10266493f079205ff25354b8e08bd822d71aafdb3b16184802b9e96b6031c3bb"} Jul 28 12:36:29.820418 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:29.820328 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" event={"ID":"ab5d40e6-3c8b-4962-ba56-844204bac934","Type":"ContainerStarted","Data":"988e80bcc8d35306142c4f1262c1028abdfabb90e3da291190afce5c4b6d3c4d"} Jul 28 12:36:29.820418 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:29.820351 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" event={"ID":"ab5d40e6-3c8b-4962-ba56-844204bac934","Type":"ContainerStarted","Data":"786cd536f92bda2bbcb595b6df8b58e918c14c4540511aed66ad92c9adf3c07e"} Jul 28 12:36:29.837808 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:29.837772 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:29.845008 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:29.844954 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7ngqn" podStartSLOduration=1.916232886 podStartE2EDuration="4.844936993s" totalImagesPullingTime="2.850392492s" totalInitContainerRuntime="78.311615ms" isStatefulPod=true podCreationTimestamp="2026-07-28 12:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:29.843865002 +0000 UTC m=+93.968100802" watchObservedRunningTime="2026-07-28 12:36:29.844936993 +0000 UTC m=+93.969172790" Jul 28 12:36:29.865228 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:29.865117 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9ws6t" podStartSLOduration=1.968853689 podStartE2EDuration="4.865093224s" totalImagesPullingTime="2.896239535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:29.864780389 +0000 UTC m=+93.989016247" watchObservedRunningTime="2026-07-28 12:36:29.865093224 +0000 UTC m=+93.989329024" Jul 28 12:36:29.966041 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:29.965992 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:30.063575 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:30.063541 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:30.432195 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:30.432160 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:30.536294 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:30.536262 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:30.972414 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:30.972377 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d6d688d68-fbhm7"] Jul 28 12:36:30.978564 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:30.978537 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:30.986365 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:30.986336 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6d688d68-fbhm7"] Jul 28 12:36:31.006252 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.006218 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-config\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.006252 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.006254 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-oauth-config\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.006503 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.006352 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-service-ca\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.006503 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.006418 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-oauth-serving-cert\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.006503 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.006458 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fngqq\" (UniqueName: \"kubernetes.io/projected/82b08979-2a9d-4f70-8d00-bd2164e4aefb-kube-api-access-fngqq\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.006633 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.006500 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-serving-cert\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.006633 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.006524 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-trusted-ca-bundle\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.107681 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.107638 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-oauth-serving-cert\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.107681 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.107687 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fngqq\" (UniqueName: \"kubernetes.io/projected/82b08979-2a9d-4f70-8d00-bd2164e4aefb-kube-api-access-fngqq\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.107923 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.107705 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-serving-cert\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.107923 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.107804 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-trusted-ca-bundle\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.107923 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.107890 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-config\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.108065 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.107923 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-oauth-config\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.108065 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.107947 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-service-ca\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.108555 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.108531 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-config\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.108671 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.108569 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-oauth-serving-cert\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.108671 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.108628 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-trusted-ca-bundle\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.108740 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.108721 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-service-ca\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.110374 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.110349 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-oauth-config\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.110490 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.110474 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-serving-cert\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.125391 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.125325 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fngqq\" (UniqueName: \"kubernetes.io/projected/82b08979-2a9d-4f70-8d00-bd2164e4aefb-kube-api-access-fngqq\") pod \"console-6d6d688d68-fbhm7\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.248717 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.248618 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:31.289101 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.289046 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:31.349842 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.349813 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:31.451799 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.451758 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6d688d68-fbhm7"] Jul 28 12:36:31.454899 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:36:31.454869 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b08979_2a9d_4f70_8d00_bd2164e4aefb.slice/crio-ed0a897800460db0239308758fe573b6a14a2358aba0409c5407286b6cc4d4d3 WatchSource:0}: Error finding container ed0a897800460db0239308758fe573b6a14a2358aba0409c5407286b6cc4d4d3: Status 404 returned error can't find the container with id ed0a897800460db0239308758fe573b6a14a2358aba0409c5407286b6cc4d4d3 Jul 28 12:36:31.467075 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.467042 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:31.830099 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.830064 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6d688d68-fbhm7" event={"ID":"82b08979-2a9d-4f70-8d00-bd2164e4aefb","Type":"ContainerStarted","Data":"e70089f679ccb36700ff77594b1edb9df2ad6c659f7837737581c4139be42c08"} Jul 28 12:36:31.830266 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.830113 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6d688d68-fbhm7" event={"ID":"82b08979-2a9d-4f70-8d00-bd2164e4aefb","Type":"ContainerStarted","Data":"ed0a897800460db0239308758fe573b6a14a2358aba0409c5407286b6cc4d4d3"} Jul 28 12:36:31.848408 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:31.848349 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d6d688d68-fbhm7" podStartSLOduration=1.8483256460000002 podStartE2EDuration="1.848325646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:36:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:31.847352462 +0000 UTC m=+95.971588262" watchObservedRunningTime="2026-07-28 12:36:31.848325646 +0000 UTC m=+95.972561446" Jul 28 12:36:33.657436 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:33.657404 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-htckr" Jul 28 12:36:41.143642 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:41.143570 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:41.250103 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:41.250061 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:41.290199 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:41.290158 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:41.290380 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:41.290238 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:41.295333 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:41.295302 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:41.869781 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:41.869751 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:36:41.921406 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:41.921374 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dc6dfdc84-llcbh"] Jul 28 12:36:42.045435 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:42.045397 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:42.145071 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:42.144988 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:42.247283 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:42.247246 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:44.479821 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:44.479785 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:44.581260 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:44.581202 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:45.428403 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:45.428366 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:45.529157 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:45.529104 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:49.910291 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:49.910230 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-857c8bbfb9-wl5fk" podUID="cfda3fae-a409-4757-9c4c-667d27863e0f" containerName="console" containerID="cri-o://2ce06c169e169e8c4476f6b57f50929fd0668ab1c821cecc2363da30904d7b7a" gracePeriod=15 Jul 28 12:36:50.152216 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.152188 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:50.252698 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.252591 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfda3fae-a409-4757-9c4c-667d27863e0f-console-oauth-config\") pod \"cfda3fae-a409-4757-9c4c-667d27863e0f\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " Jul 28 12:36:50.252698 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.252653 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlxst\" (UniqueName: \"kubernetes.io/projected/cfda3fae-a409-4757-9c4c-667d27863e0f-kube-api-access-wlxst\") pod \"cfda3fae-a409-4757-9c4c-667d27863e0f\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " Jul 28 12:36:50.252698 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.252681 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-service-ca\") pod \"cfda3fae-a409-4757-9c4c-667d27863e0f\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " Jul 28 12:36:50.252976 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.252783 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfda3fae-a409-4757-9c4c-667d27863e0f-console-serving-cert\") pod \"cfda3fae-a409-4757-9c4c-667d27863e0f\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " Jul 28 12:36:50.252976 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.252837 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-console-config\") pod \"cfda3fae-a409-4757-9c4c-667d27863e0f\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " Jul 28 12:36:50.252976 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.252950 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-oauth-serving-cert\") pod \"cfda3fae-a409-4757-9c4c-667d27863e0f\" (UID: \"cfda3fae-a409-4757-9c4c-667d27863e0f\") " Jul 28 12:36:50.253171 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.253119 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-service-ca" (OuterVolumeSpecName: "service-ca") pod "cfda3fae-a409-4757-9c4c-667d27863e0f" (UID: "cfda3fae-a409-4757-9c4c-667d27863e0f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:36:50.253270 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.253238 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-console-config" (OuterVolumeSpecName: "console-config") pod "cfda3fae-a409-4757-9c4c-667d27863e0f" (UID: "cfda3fae-a409-4757-9c4c-667d27863e0f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:36:50.253395 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.253341 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-console-config\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:36:50.253395 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.253360 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-service-ca\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:36:50.253395 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.253385 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cfda3fae-a409-4757-9c4c-667d27863e0f" (UID: "cfda3fae-a409-4757-9c4c-667d27863e0f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:36:50.255100 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.255080 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfda3fae-a409-4757-9c4c-667d27863e0f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cfda3fae-a409-4757-9c4c-667d27863e0f" (UID: "cfda3fae-a409-4757-9c4c-667d27863e0f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:36:50.255369 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.255354 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfda3fae-a409-4757-9c4c-667d27863e0f-kube-api-access-wlxst" (OuterVolumeSpecName: "kube-api-access-wlxst") pod "cfda3fae-a409-4757-9c4c-667d27863e0f" (UID: "cfda3fae-a409-4757-9c4c-667d27863e0f"). InnerVolumeSpecName "kube-api-access-wlxst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:36:50.255369 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.255357 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfda3fae-a409-4757-9c4c-667d27863e0f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cfda3fae-a409-4757-9c4c-667d27863e0f" (UID: "cfda3fae-a409-4757-9c4c-667d27863e0f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:36:50.354161 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.354089 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfda3fae-a409-4757-9c4c-667d27863e0f-console-oauth-config\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:36:50.354161 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.354164 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlxst\" (UniqueName: \"kubernetes.io/projected/cfda3fae-a409-4757-9c4c-667d27863e0f-kube-api-access-wlxst\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:36:50.354161 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.354179 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfda3fae-a409-4757-9c4c-667d27863e0f-console-serving-cert\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:36:50.354412 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.354188 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfda3fae-a409-4757-9c4c-667d27863e0f-oauth-serving-cert\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:36:50.898373 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.898332 2557 generic.go:356] "Generic (PLEG): container finished" podID="cfda3fae-a409-4757-9c4c-667d27863e0f" containerID="2ce06c169e169e8c4476f6b57f50929fd0668ab1c821cecc2363da30904d7b7a" exitCode=0 Jul 28 12:36:50.898565 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.898385 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-857c8bbfb9-wl5fk" Jul 28 12:36:50.898565 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.898418 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857c8bbfb9-wl5fk" event={"ID":"cfda3fae-a409-4757-9c4c-667d27863e0f","Type":"ContainerDied","Data":"2ce06c169e169e8c4476f6b57f50929fd0668ab1c821cecc2363da30904d7b7a"} Jul 28 12:36:50.898565 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.898478 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-857c8bbfb9-wl5fk" event={"ID":"cfda3fae-a409-4757-9c4c-667d27863e0f","Type":"ContainerDied","Data":"d4f28c1b9a070c7d4bab5629514323fafef2a58f88e0d702f48af6463a34b2f8"} Jul 28 12:36:50.898565 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.898499 2557 scope.go:117] "RemoveContainer" containerID="2ce06c169e169e8c4476f6b57f50929fd0668ab1c821cecc2363da30904d7b7a" Jul 28 12:36:50.906892 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.906872 2557 scope.go:117] "RemoveContainer" containerID="2ce06c169e169e8c4476f6b57f50929fd0668ab1c821cecc2363da30904d7b7a" Jul 28 12:36:50.907183 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:36:50.907158 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ce06c169e169e8c4476f6b57f50929fd0668ab1c821cecc2363da30904d7b7a\": container with ID starting with 2ce06c169e169e8c4476f6b57f50929fd0668ab1c821cecc2363da30904d7b7a not found: ID does not exist" containerID="2ce06c169e169e8c4476f6b57f50929fd0668ab1c821cecc2363da30904d7b7a" Jul 28 12:36:50.907275 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.907190 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ce06c169e169e8c4476f6b57f50929fd0668ab1c821cecc2363da30904d7b7a"} err="failed to get container status \"2ce06c169e169e8c4476f6b57f50929fd0668ab1c821cecc2363da30904d7b7a\": rpc error: code = NotFound desc = could not find container \"2ce06c169e169e8c4476f6b57f50929fd0668ab1c821cecc2363da30904d7b7a\": container with ID starting with 2ce06c169e169e8c4476f6b57f50929fd0668ab1c821cecc2363da30904d7b7a not found: ID does not exist" Jul 28 12:36:50.913832 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.913808 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-857c8bbfb9-wl5fk"] Jul 28 12:36:50.918002 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:50.917977 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-857c8bbfb9-wl5fk"] Jul 28 12:36:52.378664 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:52.378629 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfda3fae-a409-4757-9c4c-667d27863e0f" path="/var/lib/kubelet/pods/cfda3fae-a409-4757-9c4c-667d27863e0f/volumes" Jul 28 12:36:52.622018 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:52.621981 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:36:52.717476 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:36:52.717399 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:06.942927 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:06.942882 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-dc6dfdc84-llcbh" podUID="f14bd413-4d84-4f54-bb51-7a3ea2b5e98c" containerName="console" containerID="cri-o://9a1ba80b007f69c53d12c8327092c627db9b61a72ef761995ffe608964129fd0" gracePeriod=15 Jul 28 12:37:07.182752 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.182723 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:37:07.290256 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.290174 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-oauth-config\") pod \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " Jul 28 12:37:07.290256 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.290226 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-service-ca\") pod \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " Jul 28 12:37:07.290256 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.290249 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-oauth-serving-cert\") pod \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " Jul 28 12:37:07.290496 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.290269 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-serving-cert\") pod \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " Jul 28 12:37:07.290496 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.290306 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcgwt\" (UniqueName: \"kubernetes.io/projected/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-kube-api-access-fcgwt\") pod \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " Jul 28 12:37:07.290496 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.290448 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-trusted-ca-bundle\") pod \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " Jul 28 12:37:07.290668 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.290490 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-config\") pod \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\" (UID: \"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c\") " Jul 28 12:37:07.291097 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.291062 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f14bd413-4d84-4f54-bb51-7a3ea2b5e98c" (UID: "f14bd413-4d84-4f54-bb51-7a3ea2b5e98c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:37:07.291252 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.291169 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f14bd413-4d84-4f54-bb51-7a3ea2b5e98c" (UID: "f14bd413-4d84-4f54-bb51-7a3ea2b5e98c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:37:07.291417 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.291387 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-config" (OuterVolumeSpecName: "console-config") pod "f14bd413-4d84-4f54-bb51-7a3ea2b5e98c" (UID: "f14bd413-4d84-4f54-bb51-7a3ea2b5e98c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:37:07.295186 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.291686 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-oauth-serving-cert\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:37:07.295186 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.291712 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-trusted-ca-bundle\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:37:07.295186 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.291736 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-config\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:37:07.295186 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.293556 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-kube-api-access-fcgwt" (OuterVolumeSpecName: "kube-api-access-fcgwt") pod "f14bd413-4d84-4f54-bb51-7a3ea2b5e98c" (UID: "f14bd413-4d84-4f54-bb51-7a3ea2b5e98c"). InnerVolumeSpecName "kube-api-access-fcgwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:37:07.295186 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.293764 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f14bd413-4d84-4f54-bb51-7a3ea2b5e98c" (UID: "f14bd413-4d84-4f54-bb51-7a3ea2b5e98c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:37:07.295186 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.293994 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f14bd413-4d84-4f54-bb51-7a3ea2b5e98c" (UID: "f14bd413-4d84-4f54-bb51-7a3ea2b5e98c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:37:07.296450 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.296422 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-service-ca" (OuterVolumeSpecName: "service-ca") pod "f14bd413-4d84-4f54-bb51-7a3ea2b5e98c" (UID: "f14bd413-4d84-4f54-bb51-7a3ea2b5e98c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:37:07.392054 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.392024 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-service-ca\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:37:07.392054 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.392049 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-serving-cert\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:37:07.392054 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.392059 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcgwt\" (UniqueName: \"kubernetes.io/projected/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-kube-api-access-fcgwt\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:37:07.392298 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.392068 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c-console-oauth-config\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:37:07.960558 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.960522 2557 generic.go:356] "Generic (PLEG): container finished" podID="f14bd413-4d84-4f54-bb51-7a3ea2b5e98c" containerID="9a1ba80b007f69c53d12c8327092c627db9b61a72ef761995ffe608964129fd0" exitCode=0 Jul 28 12:37:07.961014 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.960593 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc6dfdc84-llcbh" Jul 28 12:37:07.961014 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.960608 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc6dfdc84-llcbh" event={"ID":"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c","Type":"ContainerDied","Data":"9a1ba80b007f69c53d12c8327092c627db9b61a72ef761995ffe608964129fd0"} Jul 28 12:37:07.961014 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.960674 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc6dfdc84-llcbh" event={"ID":"f14bd413-4d84-4f54-bb51-7a3ea2b5e98c","Type":"ContainerDied","Data":"db56f3a5c35fc0cea666c72a1a5c3d440bbad9616c6812efca4e86915d916346"} Jul 28 12:37:07.961014 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.960700 2557 scope.go:117] "RemoveContainer" containerID="9a1ba80b007f69c53d12c8327092c627db9b61a72ef761995ffe608964129fd0" Jul 28 12:37:07.969447 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.969432 2557 scope.go:117] "RemoveContainer" containerID="9a1ba80b007f69c53d12c8327092c627db9b61a72ef761995ffe608964129fd0" Jul 28 12:37:07.969714 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:37:07.969695 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a1ba80b007f69c53d12c8327092c627db9b61a72ef761995ffe608964129fd0\": container with ID starting with 9a1ba80b007f69c53d12c8327092c627db9b61a72ef761995ffe608964129fd0 not found: ID does not exist" containerID="9a1ba80b007f69c53d12c8327092c627db9b61a72ef761995ffe608964129fd0" Jul 28 12:37:07.969765 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.969722 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a1ba80b007f69c53d12c8327092c627db9b61a72ef761995ffe608964129fd0"} err="failed to get container status \"9a1ba80b007f69c53d12c8327092c627db9b61a72ef761995ffe608964129fd0\": rpc error: code = NotFound desc = could not find container \"9a1ba80b007f69c53d12c8327092c627db9b61a72ef761995ffe608964129fd0\": container with ID starting with 9a1ba80b007f69c53d12c8327092c627db9b61a72ef761995ffe608964129fd0 not found: ID does not exist" Jul 28 12:37:07.982331 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.982309 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dc6dfdc84-llcbh"] Jul 28 12:37:07.986364 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:07.986340 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dc6dfdc84-llcbh"] Jul 28 12:37:08.379048 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:08.379010 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f14bd413-4d84-4f54-bb51-7a3ea2b5e98c" path="/var/lib/kubelet/pods/f14bd413-4d84-4f54-bb51-7a3ea2b5e98c/volumes" Jul 28 12:37:15.432247 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:15.432211 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:15.533272 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:15.533243 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:20.431530 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:20.431484 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:44.385577 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:44.385524 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:44.905375 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:44.905341 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:49.492740 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.492650 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz"] Jul 28 12:37:49.493218 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.493069 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f14bd413-4d84-4f54-bb51-7a3ea2b5e98c" containerName="console" Jul 28 12:37:49.493218 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.493088 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f14bd413-4d84-4f54-bb51-7a3ea2b5e98c" containerName="console" Jul 28 12:37:49.493218 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.493108 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfda3fae-a409-4757-9c4c-667d27863e0f" containerName="console" Jul 28 12:37:49.493218 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.493118 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfda3fae-a409-4757-9c4c-667d27863e0f" containerName="console" Jul 28 12:37:49.493218 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.493200 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfda3fae-a409-4757-9c4c-667d27863e0f" containerName="console" Jul 28 12:37:49.493218 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.493213 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f14bd413-4d84-4f54-bb51-7a3ea2b5e98c" containerName="console" Jul 28 12:37:49.496522 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.496495 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.498910 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.498883 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 28 12:37:49.499271 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.499242 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 28 12:37:49.499479 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.499262 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 28 12:37:49.499615 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.499305 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 28 12:37:49.501409 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.499355 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 28 12:37:49.501577 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.499397 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-n265f\"" Jul 28 12:37:49.505578 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.505555 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 28 12:37:49.511243 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.511213 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz"] Jul 28 12:37:49.528090 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.528044 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.528285 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.528172 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4jkv\" (UniqueName: \"kubernetes.io/projected/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-kube-api-access-q4jkv\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.528285 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.528219 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-telemeter-client-tls\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.528285 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.528262 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.528480 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.528328 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-serving-certs-ca-bundle\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.528480 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.528365 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-federate-client-tls\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.528480 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.528468 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-secret-telemeter-client\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.528674 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.528500 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-metrics-client-ca\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.629090 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.629050 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-secret-telemeter-client\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.629090 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.629087 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-metrics-client-ca\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.629383 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.629126 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.629383 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.629177 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4jkv\" (UniqueName: \"kubernetes.io/projected/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-kube-api-access-q4jkv\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.629383 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.629198 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-telemeter-client-tls\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.629383 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.629222 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.629383 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.629243 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-serving-certs-ca-bundle\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.629383 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.629264 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-federate-client-tls\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.630031 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.629999 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-metrics-client-ca\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.630172 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.630073 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.630240 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.630072 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-serving-certs-ca-bundle\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.631881 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.631850 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.631989 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.631930 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-telemeter-client-tls\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.632271 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.632249 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-federate-client-tls\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.632320 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.632249 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-secret-telemeter-client\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.637511 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.637488 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4jkv\" (UniqueName: \"kubernetes.io/projected/eb13db89-e0bd-4d63-86d6-4aef14a0ace4-kube-api-access-q4jkv\") pod \"telemeter-client-7cb88fffbb-5bmdz\" (UID: \"eb13db89-e0bd-4d63-86d6-4aef14a0ace4\") " pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.810177 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.810048 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" Jul 28 12:37:49.950548 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:49.950505 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz"] Jul 28 12:37:49.953233 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:37:49.953194 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb13db89_e0bd_4d63_86d6_4aef14a0ace4.slice/crio-e9fb6c8c29d7f0b8d73f5392cd652bd8670e2aeb520199ae2b198ba5816cf152 WatchSource:0}: Error finding container e9fb6c8c29d7f0b8d73f5392cd652bd8670e2aeb520199ae2b198ba5816cf152: Status 404 returned error can't find the container with id e9fb6c8c29d7f0b8d73f5392cd652bd8670e2aeb520199ae2b198ba5816cf152 Jul 28 12:37:50.112871 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:50.112832 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" event={"ID":"eb13db89-e0bd-4d63-86d6-4aef14a0ace4","Type":"ContainerStarted","Data":"e9fb6c8c29d7f0b8d73f5392cd652bd8670e2aeb520199ae2b198ba5816cf152"} Jul 28 12:37:52.126580 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:52.126538 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" event={"ID":"eb13db89-e0bd-4d63-86d6-4aef14a0ace4","Type":"ContainerStarted","Data":"5b3cd1e0daef48d81935cd7bc562b6da84ffc698d2e974930126b45d40c10d7b"} Jul 28 12:37:53.132338 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:53.132304 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" event={"ID":"eb13db89-e0bd-4d63-86d6-4aef14a0ace4","Type":"ContainerStarted","Data":"f48a264c1527e2c3e6bd1f043c76837c808c9719f52fd6f76ac969e9c3563618"} Jul 28 12:37:53.132725 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:53.132363 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" event={"ID":"eb13db89-e0bd-4d63-86d6-4aef14a0ace4","Type":"ContainerStarted","Data":"b015388531923c798fb46ff82b4b1e2a40709bf4413dad43e0e77a4f100bc41c"} Jul 28 12:37:53.161004 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:53.160953 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7cb88fffbb-5bmdz" podStartSLOduration=1.479009204 podStartE2EDuration="4.160937487s" totalImagesPullingTime="2.681928283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:37:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:37:53.160037799 +0000 UTC m=+177.284273600" watchObservedRunningTime="2026-07-28 12:37:53.160937487 +0000 UTC m=+177.285173296" Jul 28 12:37:54.204073 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.204033 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77554cf578-k2xtk"] Jul 28 12:37:54.207676 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.207647 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.223642 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.223613 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77554cf578-k2xtk"] Jul 28 12:37:54.268483 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.268448 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-oauth-serving-cert\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.268483 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.268485 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pct5x\" (UniqueName: \"kubernetes.io/projected/121b1f46-e8b7-41da-9af2-c84ad8a59595-kube-api-access-pct5x\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.268721 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.268510 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-serving-cert\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.268721 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.268566 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-trusted-ca-bundle\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.268721 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.268588 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-service-ca\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.268721 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.268620 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-oauth-config\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.268888 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.268735 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-config\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.272883 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.272853 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:54.337661 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.337627 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:54.370109 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.370071 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-config\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.370295 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.370122 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-oauth-serving-cert\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.370295 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.370165 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pct5x\" (UniqueName: \"kubernetes.io/projected/121b1f46-e8b7-41da-9af2-c84ad8a59595-kube-api-access-pct5x\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.370295 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.370190 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-serving-cert\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.370295 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.370208 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-trusted-ca-bundle\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.370295 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.370227 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-service-ca\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.370295 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.370263 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-oauth-config\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.370945 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.370908 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-config\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.371044 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.371001 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-service-ca\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.371044 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.371021 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-oauth-serving-cert\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.371127 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.371108 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-trusted-ca-bundle\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.373215 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.373193 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-serving-cert\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.373303 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.373226 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-oauth-config\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.378819 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.378795 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pct5x\" (UniqueName: \"kubernetes.io/projected/121b1f46-e8b7-41da-9af2-c84ad8a59595-kube-api-access-pct5x\") pod \"console-77554cf578-k2xtk\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.518105 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.517999 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:37:54.652944 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:54.652909 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77554cf578-k2xtk"] Jul 28 12:37:54.655796 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:37:54.655766 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod121b1f46_e8b7_41da_9af2_c84ad8a59595.slice/crio-448a6a471e13ef58014002c5fea665cd0e940456fe9988eba373c7fb0bed21be WatchSource:0}: Error finding container 448a6a471e13ef58014002c5fea665cd0e940456fe9988eba373c7fb0bed21be: Status 404 returned error can't find the container with id 448a6a471e13ef58014002c5fea665cd0e940456fe9988eba373c7fb0bed21be Jul 28 12:37:55.144408 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:55.144370 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77554cf578-k2xtk" event={"ID":"121b1f46-e8b7-41da-9af2-c84ad8a59595","Type":"ContainerStarted","Data":"4836faf244d0b7fd65e97ff825443e1bb39bcf09d08f242f59c75a799936d6d1"} Jul 28 12:37:55.144587 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:55.144422 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77554cf578-k2xtk" event={"ID":"121b1f46-e8b7-41da-9af2-c84ad8a59595","Type":"ContainerStarted","Data":"448a6a471e13ef58014002c5fea665cd0e940456fe9988eba373c7fb0bed21be"} Jul 28 12:37:55.164699 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:55.164642 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77554cf578-k2xtk" podStartSLOduration=1.164625893 podStartE2EDuration="1.164625893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:37:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:37:55.16325199 +0000 UTC m=+179.287487790" watchObservedRunningTime="2026-07-28 12:37:55.164625893 +0000 UTC m=+179.288861692" Jul 28 12:37:59.658427 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:59.658377 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:37:59.712855 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:37:59.712817 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:00.677703 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.677644 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77554cf578-k2xtk"] Jul 28 12:38:00.710657 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.710621 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56559b9dcb-xvdst"] Jul 28 12:38:00.715370 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.715347 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.723580 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.723553 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56559b9dcb-xvdst"] Jul 28 12:38:00.817648 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.817616 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7febf83-4f46-4acd-a516-2898c3589b30-console-oauth-config\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.817835 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.817660 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7febf83-4f46-4acd-a516-2898c3589b30-console-serving-cert\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.817835 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.817689 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7febf83-4f46-4acd-a516-2898c3589b30-oauth-serving-cert\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.817835 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.817715 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s49x\" (UniqueName: \"kubernetes.io/projected/d7febf83-4f46-4acd-a516-2898c3589b30-kube-api-access-7s49x\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.817835 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.817747 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7febf83-4f46-4acd-a516-2898c3589b30-service-ca\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.817835 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.817822 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7febf83-4f46-4acd-a516-2898c3589b30-console-config\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.818033 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.817878 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7febf83-4f46-4acd-a516-2898c3589b30-trusted-ca-bundle\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.865851 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.865814 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:00.919125 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.919087 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7febf83-4f46-4acd-a516-2898c3589b30-trusted-ca-bundle\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.919348 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.919133 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7febf83-4f46-4acd-a516-2898c3589b30-console-oauth-config\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.919348 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.919183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7febf83-4f46-4acd-a516-2898c3589b30-console-serving-cert\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.919348 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.919202 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7febf83-4f46-4acd-a516-2898c3589b30-oauth-serving-cert\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.919348 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.919229 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s49x\" (UniqueName: \"kubernetes.io/projected/d7febf83-4f46-4acd-a516-2898c3589b30-kube-api-access-7s49x\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.919348 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.919253 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7febf83-4f46-4acd-a516-2898c3589b30-service-ca\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.919610 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.919403 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7febf83-4f46-4acd-a516-2898c3589b30-console-config\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.920105 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.920079 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7febf83-4f46-4acd-a516-2898c3589b30-oauth-serving-cert\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.920105 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.920094 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7febf83-4f46-4acd-a516-2898c3589b30-console-config\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.920315 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.920109 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7febf83-4f46-4acd-a516-2898c3589b30-trusted-ca-bundle\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.920315 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.920111 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7febf83-4f46-4acd-a516-2898c3589b30-service-ca\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.921868 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.921841 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7febf83-4f46-4acd-a516-2898c3589b30-console-oauth-config\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.921975 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.921956 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7febf83-4f46-4acd-a516-2898c3589b30-console-serving-cert\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.926930 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.926909 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s49x\" (UniqueName: \"kubernetes.io/projected/d7febf83-4f46-4acd-a516-2898c3589b30-kube-api-access-7s49x\") pod \"console-56559b9dcb-xvdst\" (UID: \"d7febf83-4f46-4acd-a516-2898c3589b30\") " pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:00.968528 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:00.968453 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:01.026480 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:01.026452 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:01.153956 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:01.153928 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56559b9dcb-xvdst"] Jul 28 12:38:01.156481 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:38:01.156448 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7febf83_4f46_4acd_a516_2898c3589b30.slice/crio-f0f99cc2369f9bd8fa7050d434dc5d231885adda8c66727486f0803654889543 WatchSource:0}: Error finding container f0f99cc2369f9bd8fa7050d434dc5d231885adda8c66727486f0803654889543: Status 404 returned error can't find the container with id f0f99cc2369f9bd8fa7050d434dc5d231885adda8c66727486f0803654889543 Jul 28 12:38:01.171169 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:01.171125 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56559b9dcb-xvdst" event={"ID":"d7febf83-4f46-4acd-a516-2898c3589b30","Type":"ContainerStarted","Data":"f0f99cc2369f9bd8fa7050d434dc5d231885adda8c66727486f0803654889543"} Jul 28 12:38:01.479341 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:01.479306 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:01.546826 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:01.546795 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:02.176529 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:02.176494 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56559b9dcb-xvdst" event={"ID":"d7febf83-4f46-4acd-a516-2898c3589b30","Type":"ContainerStarted","Data":"5e39c5ba72a855b8cf6a7b13c1040992838be07ccec29b458ec3c5b547f7dd86"} Jul 28 12:38:02.193923 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:02.193872 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56559b9dcb-xvdst" podStartSLOduration=2.193853435 podStartE2EDuration="2.193853435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:38:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:38:02.193037995 +0000 UTC m=+186.317273823" watchObservedRunningTime="2026-07-28 12:38:02.193853435 +0000 UTC m=+186.318089233" Jul 28 12:38:03.346793 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:03.346754 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:04.519056 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:04.519021 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:38:11.026916 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:11.026868 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:11.027430 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:11.026993 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:11.031742 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:11.031713 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:11.212120 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:11.212094 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56559b9dcb-xvdst" Jul 28 12:38:11.263643 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:11.263611 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6d688d68-fbhm7"] Jul 28 12:38:11.372970 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:11.372923 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:11.432584 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:11.432546 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:11.488935 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:11.488908 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:11.612264 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:11.612230 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:11.675184 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:11.675100 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:15.429403 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:15.429361 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:15.531804 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:15.531774 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:38:25.696954 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:25.696886 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77554cf578-k2xtk" podUID="121b1f46-e8b7-41da-9af2-c84ad8a59595" containerName="console" containerID="cri-o://4836faf244d0b7fd65e97ff825443e1bb39bcf09d08f242f59c75a799936d6d1" gracePeriod=15 Jul 28 12:38:25.939363 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:25.939340 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:38:26.024985 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.024916 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-serving-cert\") pod \"121b1f46-e8b7-41da-9af2-c84ad8a59595\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " Jul 28 12:38:26.024985 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.024966 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-oauth-serving-cert\") pod \"121b1f46-e8b7-41da-9af2-c84ad8a59595\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " Jul 28 12:38:26.025220 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.024996 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pct5x\" (UniqueName: \"kubernetes.io/projected/121b1f46-e8b7-41da-9af2-c84ad8a59595-kube-api-access-pct5x\") pod \"121b1f46-e8b7-41da-9af2-c84ad8a59595\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " Jul 28 12:38:26.025220 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.025029 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-service-ca\") pod \"121b1f46-e8b7-41da-9af2-c84ad8a59595\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " Jul 28 12:38:26.025220 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.025063 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-trusted-ca-bundle\") pod \"121b1f46-e8b7-41da-9af2-c84ad8a59595\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " Jul 28 12:38:26.025220 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.025106 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-oauth-config\") pod \"121b1f46-e8b7-41da-9af2-c84ad8a59595\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " Jul 28 12:38:26.025220 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.025133 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-config\") pod \"121b1f46-e8b7-41da-9af2-c84ad8a59595\" (UID: \"121b1f46-e8b7-41da-9af2-c84ad8a59595\") " Jul 28 12:38:26.025511 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.025485 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "121b1f46-e8b7-41da-9af2-c84ad8a59595" (UID: "121b1f46-e8b7-41da-9af2-c84ad8a59595"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:38:26.025714 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.025563 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-service-ca" (OuterVolumeSpecName: "service-ca") pod "121b1f46-e8b7-41da-9af2-c84ad8a59595" (UID: "121b1f46-e8b7-41da-9af2-c84ad8a59595"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:38:26.025782 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.025602 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "121b1f46-e8b7-41da-9af2-c84ad8a59595" (UID: "121b1f46-e8b7-41da-9af2-c84ad8a59595"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:38:26.025782 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.025654 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-config" (OuterVolumeSpecName: "console-config") pod "121b1f46-e8b7-41da-9af2-c84ad8a59595" (UID: "121b1f46-e8b7-41da-9af2-c84ad8a59595"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:38:26.027305 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.027281 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "121b1f46-e8b7-41da-9af2-c84ad8a59595" (UID: "121b1f46-e8b7-41da-9af2-c84ad8a59595"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:26.027598 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.027569 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "121b1f46-e8b7-41da-9af2-c84ad8a59595" (UID: "121b1f46-e8b7-41da-9af2-c84ad8a59595"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:26.027698 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.027576 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/121b1f46-e8b7-41da-9af2-c84ad8a59595-kube-api-access-pct5x" (OuterVolumeSpecName: "kube-api-access-pct5x") pod "121b1f46-e8b7-41da-9af2-c84ad8a59595" (UID: "121b1f46-e8b7-41da-9af2-c84ad8a59595"). InnerVolumeSpecName "kube-api-access-pct5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:38:26.126088 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.126058 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-serving-cert\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:38:26.126088 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.126084 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-oauth-serving-cert\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:38:26.126088 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.126093 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pct5x\" (UniqueName: \"kubernetes.io/projected/121b1f46-e8b7-41da-9af2-c84ad8a59595-kube-api-access-pct5x\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:38:26.126295 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.126103 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-service-ca\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:38:26.126295 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.126112 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-trusted-ca-bundle\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:38:26.126295 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.126122 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-oauth-config\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:38:26.126295 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.126131 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/121b1f46-e8b7-41da-9af2-c84ad8a59595-console-config\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:38:26.261548 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.261512 2557 generic.go:356] "Generic (PLEG): container finished" podID="121b1f46-e8b7-41da-9af2-c84ad8a59595" containerID="4836faf244d0b7fd65e97ff825443e1bb39bcf09d08f242f59c75a799936d6d1" exitCode=0 Jul 28 12:38:26.261714 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.261558 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77554cf578-k2xtk" Jul 28 12:38:26.261714 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.261595 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77554cf578-k2xtk" event={"ID":"121b1f46-e8b7-41da-9af2-c84ad8a59595","Type":"ContainerDied","Data":"4836faf244d0b7fd65e97ff825443e1bb39bcf09d08f242f59c75a799936d6d1"} Jul 28 12:38:26.261714 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.261655 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77554cf578-k2xtk" event={"ID":"121b1f46-e8b7-41da-9af2-c84ad8a59595","Type":"ContainerDied","Data":"448a6a471e13ef58014002c5fea665cd0e940456fe9988eba373c7fb0bed21be"} Jul 28 12:38:26.261714 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.261685 2557 scope.go:117] "RemoveContainer" containerID="4836faf244d0b7fd65e97ff825443e1bb39bcf09d08f242f59c75a799936d6d1" Jul 28 12:38:26.270601 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.270577 2557 scope.go:117] "RemoveContainer" containerID="4836faf244d0b7fd65e97ff825443e1bb39bcf09d08f242f59c75a799936d6d1" Jul 28 12:38:26.270878 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:38:26.270858 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4836faf244d0b7fd65e97ff825443e1bb39bcf09d08f242f59c75a799936d6d1\": container with ID starting with 4836faf244d0b7fd65e97ff825443e1bb39bcf09d08f242f59c75a799936d6d1 not found: ID does not exist" containerID="4836faf244d0b7fd65e97ff825443e1bb39bcf09d08f242f59c75a799936d6d1" Jul 28 12:38:26.270944 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.270888 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4836faf244d0b7fd65e97ff825443e1bb39bcf09d08f242f59c75a799936d6d1"} err="failed to get container status \"4836faf244d0b7fd65e97ff825443e1bb39bcf09d08f242f59c75a799936d6d1\": rpc error: code = NotFound desc = could not find container \"4836faf244d0b7fd65e97ff825443e1bb39bcf09d08f242f59c75a799936d6d1\": container with ID starting with 4836faf244d0b7fd65e97ff825443e1bb39bcf09d08f242f59c75a799936d6d1 not found: ID does not exist" Jul 28 12:38:26.289571 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.285863 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77554cf578-k2xtk"] Jul 28 12:38:26.291566 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.291541 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77554cf578-k2xtk"] Jul 28 12:38:26.379470 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:26.379439 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="121b1f46-e8b7-41da-9af2-c84ad8a59595" path="/var/lib/kubelet/pods/121b1f46-e8b7-41da-9af2-c84ad8a59595/volumes" Jul 28 12:38:36.284483 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.284420 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d6d688d68-fbhm7" podUID="82b08979-2a9d-4f70-8d00-bd2164e4aefb" containerName="console" containerID="cri-o://e70089f679ccb36700ff77594b1edb9df2ad6c659f7837737581c4139be42c08" gracePeriod=15 Jul 28 12:38:36.541708 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.541654 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:38:36.712996 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.712959 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-service-ca\") pod \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " Jul 28 12:38:36.713192 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.713018 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-oauth-config\") pod \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " Jul 28 12:38:36.713192 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.713058 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fngqq\" (UniqueName: \"kubernetes.io/projected/82b08979-2a9d-4f70-8d00-bd2164e4aefb-kube-api-access-fngqq\") pod \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " Jul 28 12:38:36.713192 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.713097 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-oauth-serving-cert\") pod \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " Jul 28 12:38:36.713353 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.713191 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-serving-cert\") pod \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " Jul 28 12:38:36.713353 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.713217 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-trusted-ca-bundle\") pod \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " Jul 28 12:38:36.713353 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.713240 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-config\") pod \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\" (UID: \"82b08979-2a9d-4f70-8d00-bd2164e4aefb\") " Jul 28 12:38:36.713549 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.713520 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-service-ca" (OuterVolumeSpecName: "service-ca") pod "82b08979-2a9d-4f70-8d00-bd2164e4aefb" (UID: "82b08979-2a9d-4f70-8d00-bd2164e4aefb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:38:36.713621 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.713587 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "82b08979-2a9d-4f70-8d00-bd2164e4aefb" (UID: "82b08979-2a9d-4f70-8d00-bd2164e4aefb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:38:36.713677 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.713655 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "82b08979-2a9d-4f70-8d00-bd2164e4aefb" (UID: "82b08979-2a9d-4f70-8d00-bd2164e4aefb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:38:36.713740 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.713719 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-config" (OuterVolumeSpecName: "console-config") pod "82b08979-2a9d-4f70-8d00-bd2164e4aefb" (UID: "82b08979-2a9d-4f70-8d00-bd2164e4aefb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:38:36.715244 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.715215 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "82b08979-2a9d-4f70-8d00-bd2164e4aefb" (UID: "82b08979-2a9d-4f70-8d00-bd2164e4aefb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:36.715354 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.715274 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b08979-2a9d-4f70-8d00-bd2164e4aefb-kube-api-access-fngqq" (OuterVolumeSpecName: "kube-api-access-fngqq") pod "82b08979-2a9d-4f70-8d00-bd2164e4aefb" (UID: "82b08979-2a9d-4f70-8d00-bd2164e4aefb"). InnerVolumeSpecName "kube-api-access-fngqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:38:36.715354 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.715283 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "82b08979-2a9d-4f70-8d00-bd2164e4aefb" (UID: "82b08979-2a9d-4f70-8d00-bd2164e4aefb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:36.813766 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.813695 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-oauth-config\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:38:36.813766 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.813718 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fngqq\" (UniqueName: \"kubernetes.io/projected/82b08979-2a9d-4f70-8d00-bd2164e4aefb-kube-api-access-fngqq\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:38:36.813766 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.813729 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-oauth-serving-cert\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:38:36.813766 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.813737 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-serving-cert\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:38:36.813766 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.813746 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-trusted-ca-bundle\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:38:36.813766 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.813754 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-console-config\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:38:36.813766 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:36.813762 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/82b08979-2a9d-4f70-8d00-bd2164e4aefb-service-ca\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:38:37.301626 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:37.301595 2557 generic.go:356] "Generic (PLEG): container finished" podID="82b08979-2a9d-4f70-8d00-bd2164e4aefb" containerID="e70089f679ccb36700ff77594b1edb9df2ad6c659f7837737581c4139be42c08" exitCode=0 Jul 28 12:38:37.302054 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:37.301636 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6d688d68-fbhm7" Jul 28 12:38:37.302054 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:37.301641 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6d688d68-fbhm7" event={"ID":"82b08979-2a9d-4f70-8d00-bd2164e4aefb","Type":"ContainerDied","Data":"e70089f679ccb36700ff77594b1edb9df2ad6c659f7837737581c4139be42c08"} Jul 28 12:38:37.302054 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:37.301680 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6d688d68-fbhm7" event={"ID":"82b08979-2a9d-4f70-8d00-bd2164e4aefb","Type":"ContainerDied","Data":"ed0a897800460db0239308758fe573b6a14a2358aba0409c5407286b6cc4d4d3"} Jul 28 12:38:37.302054 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:37.301700 2557 scope.go:117] "RemoveContainer" containerID="e70089f679ccb36700ff77594b1edb9df2ad6c659f7837737581c4139be42c08" Jul 28 12:38:37.310003 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:37.309986 2557 scope.go:117] "RemoveContainer" containerID="e70089f679ccb36700ff77594b1edb9df2ad6c659f7837737581c4139be42c08" Jul 28 12:38:37.310281 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:38:37.310262 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e70089f679ccb36700ff77594b1edb9df2ad6c659f7837737581c4139be42c08\": container with ID starting with e70089f679ccb36700ff77594b1edb9df2ad6c659f7837737581c4139be42c08 not found: ID does not exist" containerID="e70089f679ccb36700ff77594b1edb9df2ad6c659f7837737581c4139be42c08" Jul 28 12:38:37.310327 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:37.310291 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e70089f679ccb36700ff77594b1edb9df2ad6c659f7837737581c4139be42c08"} err="failed to get container status \"e70089f679ccb36700ff77594b1edb9df2ad6c659f7837737581c4139be42c08\": rpc error: code = NotFound desc = could not find container \"e70089f679ccb36700ff77594b1edb9df2ad6c659f7837737581c4139be42c08\": container with ID starting with e70089f679ccb36700ff77594b1edb9df2ad6c659f7837737581c4139be42c08 not found: ID does not exist" Jul 28 12:38:37.321418 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:37.321396 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6d688d68-fbhm7"] Jul 28 12:38:37.324698 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:37.324677 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d6d688d68-fbhm7"] Jul 28 12:38:38.378762 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:38.378725 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82b08979-2a9d-4f70-8d00-bd2164e4aefb" path="/var/lib/kubelet/pods/82b08979-2a9d-4f70-8d00-bd2164e4aefb/volumes" Jul 28 12:38:39.190427 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:38:39.190389 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:39:31.646987 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:39:31.646897 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:39:31.749361 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:39:31.749331 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:39:32.033372 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:39:32.033286 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:39:32.140879 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:39:32.140843 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:39:32.234539 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:39:32.234504 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:39:54.122108 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:39:54.122071 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:39:54.246982 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:39:54.246942 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:39:56.224808 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:39:56.224778 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-br7dg_849f14b1-2639-4b88-ad46-49fcb4b0aa04/console-operator/1.log" Jul 28 12:39:56.225398 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:39:56.225379 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-br7dg_849f14b1-2639-4b88-ad46-49fcb4b0aa04/console-operator/1.log" Jul 28 12:39:56.240840 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:39:56.240817 2557 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 12:39:59.942180 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:39:59.942126 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:40:00.297389 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.297303 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:40:00.541183 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.541155 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-qjznv"] Jul 28 12:40:00.541456 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.541444 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82b08979-2a9d-4f70-8d00-bd2164e4aefb" containerName="console" Jul 28 12:40:00.541497 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.541460 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="82b08979-2a9d-4f70-8d00-bd2164e4aefb" containerName="console" Jul 28 12:40:00.541497 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.541472 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="121b1f46-e8b7-41da-9af2-c84ad8a59595" containerName="console" Jul 28 12:40:00.541497 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.541479 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="121b1f46-e8b7-41da-9af2-c84ad8a59595" containerName="console" Jul 28 12:40:00.541589 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.541526 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="82b08979-2a9d-4f70-8d00-bd2164e4aefb" containerName="console" Jul 28 12:40:00.541589 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.541533 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="121b1f46-e8b7-41da-9af2-c84ad8a59595" containerName="console" Jul 28 12:40:00.544352 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.544330 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qjznv" Jul 28 12:40:00.544874 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.544850 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:40:00.549705 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.549662 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 28 12:40:00.549705 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.549665 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 28 12:40:00.550080 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.550062 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-6cp5z\"" Jul 28 12:40:00.550122 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.550106 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 28 12:40:00.550427 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.550411 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 28 12:40:00.550807 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.550581 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 28 12:40:00.556013 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.555990 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-qjznv"] Jul 28 12:40:00.638561 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.638525 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc58d\" (UniqueName: \"kubernetes.io/projected/6bcafe5f-726a-4c87-b8bf-ccd64b89c405-kube-api-access-qc58d\") pod \"keda-metrics-apiserver-55557df8c-qjznv\" (UID: \"6bcafe5f-726a-4c87-b8bf-ccd64b89c405\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qjznv" Jul 28 12:40:00.638561 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.638566 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6bcafe5f-726a-4c87-b8bf-ccd64b89c405-certificates\") pod \"keda-metrics-apiserver-55557df8c-qjznv\" (UID: \"6bcafe5f-726a-4c87-b8bf-ccd64b89c405\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qjznv" Jul 28 12:40:00.638761 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.638587 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/6bcafe5f-726a-4c87-b8bf-ccd64b89c405-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-qjznv\" (UID: \"6bcafe5f-726a-4c87-b8bf-ccd64b89c405\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qjznv" Jul 28 12:40:00.685555 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.685506 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:40:00.739335 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.739304 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc58d\" (UniqueName: \"kubernetes.io/projected/6bcafe5f-726a-4c87-b8bf-ccd64b89c405-kube-api-access-qc58d\") pod \"keda-metrics-apiserver-55557df8c-qjznv\" (UID: \"6bcafe5f-726a-4c87-b8bf-ccd64b89c405\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qjznv" Jul 28 12:40:00.739447 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.739346 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6bcafe5f-726a-4c87-b8bf-ccd64b89c405-certificates\") pod \"keda-metrics-apiserver-55557df8c-qjznv\" (UID: \"6bcafe5f-726a-4c87-b8bf-ccd64b89c405\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qjznv" Jul 28 12:40:00.739447 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.739368 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/6bcafe5f-726a-4c87-b8bf-ccd64b89c405-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-qjznv\" (UID: \"6bcafe5f-726a-4c87-b8bf-ccd64b89c405\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qjznv" Jul 28 12:40:00.739742 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.739726 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/6bcafe5f-726a-4c87-b8bf-ccd64b89c405-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-qjznv\" (UID: \"6bcafe5f-726a-4c87-b8bf-ccd64b89c405\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qjznv" Jul 28 12:40:00.741848 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.741825 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6bcafe5f-726a-4c87-b8bf-ccd64b89c405-certificates\") pod \"keda-metrics-apiserver-55557df8c-qjznv\" (UID: \"6bcafe5f-726a-4c87-b8bf-ccd64b89c405\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qjznv" Jul 28 12:40:00.748838 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.748814 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc58d\" (UniqueName: \"kubernetes.io/projected/6bcafe5f-726a-4c87-b8bf-ccd64b89c405-kube-api-access-qc58d\") pod \"keda-metrics-apiserver-55557df8c-qjznv\" (UID: \"6bcafe5f-726a-4c87-b8bf-ccd64b89c405\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qjznv" Jul 28 12:40:00.812800 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.812727 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-dtz7n"] Jul 28 12:40:00.815927 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.815909 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-dtz7n" Jul 28 12:40:00.817774 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.817757 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 28 12:40:00.827106 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.826299 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-dtz7n"] Jul 28 12:40:00.839944 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.839909 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9699\" (UniqueName: \"kubernetes.io/projected/493171f4-5bb6-4d2f-be26-11b20236128b-kube-api-access-n9699\") pod \"keda-admission-56f9798bb4-dtz7n\" (UID: \"493171f4-5bb6-4d2f-be26-11b20236128b\") " pod="openshift-keda/keda-admission-56f9798bb4-dtz7n" Jul 28 12:40:00.840068 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.839975 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/493171f4-5bb6-4d2f-be26-11b20236128b-certificates\") pod \"keda-admission-56f9798bb4-dtz7n\" (UID: \"493171f4-5bb6-4d2f-be26-11b20236128b\") " pod="openshift-keda/keda-admission-56f9798bb4-dtz7n" Jul 28 12:40:00.854959 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.854928 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qjznv" Jul 28 12:40:00.941089 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.941054 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9699\" (UniqueName: \"kubernetes.io/projected/493171f4-5bb6-4d2f-be26-11b20236128b-kube-api-access-n9699\") pod \"keda-admission-56f9798bb4-dtz7n\" (UID: \"493171f4-5bb6-4d2f-be26-11b20236128b\") " pod="openshift-keda/keda-admission-56f9798bb4-dtz7n" Jul 28 12:40:00.941265 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.941155 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/493171f4-5bb6-4d2f-be26-11b20236128b-certificates\") pod \"keda-admission-56f9798bb4-dtz7n\" (UID: \"493171f4-5bb6-4d2f-be26-11b20236128b\") " pod="openshift-keda/keda-admission-56f9798bb4-dtz7n" Jul 28 12:40:00.941320 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:40:00.941278 2557 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Jul 28 12:40:00.941320 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:40:00.941307 2557 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-56f9798bb4-dtz7n: secret "keda-admission-webhooks-certs" not found Jul 28 12:40:00.941396 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:40:00.941371 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/493171f4-5bb6-4d2f-be26-11b20236128b-certificates podName:493171f4-5bb6-4d2f-be26-11b20236128b nodeName:}" failed. No retries permitted until 2026-07-28 12:40:01.441351288 +0000 UTC m=+305.565587080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/493171f4-5bb6-4d2f-be26-11b20236128b-certificates") pod "keda-admission-56f9798bb4-dtz7n" (UID: "493171f4-5bb6-4d2f-be26-11b20236128b") : secret "keda-admission-webhooks-certs" not found Jul 28 12:40:00.956534 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:00.956505 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9699\" (UniqueName: \"kubernetes.io/projected/493171f4-5bb6-4d2f-be26-11b20236128b-kube-api-access-n9699\") pod \"keda-admission-56f9798bb4-dtz7n\" (UID: \"493171f4-5bb6-4d2f-be26-11b20236128b\") " pod="openshift-keda/keda-admission-56f9798bb4-dtz7n" Jul 28 12:40:01.006536 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:01.006504 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-qjznv"] Jul 28 12:40:01.010130 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:40:01.010102 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bcafe5f_726a_4c87_b8bf_ccd64b89c405.slice/crio-13d5ea1438066628be1f71a525c177bd71944c91890619e3cadca0678fa2496b WatchSource:0}: Error finding container 13d5ea1438066628be1f71a525c177bd71944c91890619e3cadca0678fa2496b: Status 404 returned error can't find the container with id 13d5ea1438066628be1f71a525c177bd71944c91890619e3cadca0678fa2496b Jul 28 12:40:01.011400 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:01.011384 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 12:40:01.445262 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:01.445220 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/493171f4-5bb6-4d2f-be26-11b20236128b-certificates\") pod \"keda-admission-56f9798bb4-dtz7n\" (UID: \"493171f4-5bb6-4d2f-be26-11b20236128b\") " pod="openshift-keda/keda-admission-56f9798bb4-dtz7n" Jul 28 12:40:01.447556 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:01.447534 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/493171f4-5bb6-4d2f-be26-11b20236128b-certificates\") pod \"keda-admission-56f9798bb4-dtz7n\" (UID: \"493171f4-5bb6-4d2f-be26-11b20236128b\") " pod="openshift-keda/keda-admission-56f9798bb4-dtz7n" Jul 28 12:40:01.594160 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:01.594110 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qjznv" event={"ID":"6bcafe5f-726a-4c87-b8bf-ccd64b89c405","Type":"ContainerStarted","Data":"13d5ea1438066628be1f71a525c177bd71944c91890619e3cadca0678fa2496b"} Jul 28 12:40:01.726766 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:01.726683 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-dtz7n" Jul 28 12:40:01.858263 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:01.858229 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-dtz7n"] Jul 28 12:40:01.861403 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:40:01.861375 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493171f4_5bb6_4d2f_be26_11b20236128b.slice/crio-d5cf8822542bc6dd2b13e90e14212d7530c7d89aac5c26ac36b67ad36e73f472 WatchSource:0}: Error finding container d5cf8822542bc6dd2b13e90e14212d7530c7d89aac5c26ac36b67ad36e73f472: Status 404 returned error can't find the container with id d5cf8822542bc6dd2b13e90e14212d7530c7d89aac5c26ac36b67ad36e73f472 Jul 28 12:40:02.598497 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:02.598464 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-dtz7n" event={"ID":"493171f4-5bb6-4d2f-be26-11b20236128b","Type":"ContainerStarted","Data":"d5cf8822542bc6dd2b13e90e14212d7530c7d89aac5c26ac36b67ad36e73f472"} Jul 28 12:40:02.997673 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:02.997577 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:40:05.613057 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:05.613020 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qjznv" event={"ID":"6bcafe5f-726a-4c87-b8bf-ccd64b89c405","Type":"ContainerStarted","Data":"17e78163d6b46d91069b50b85dbb52337473685ffcace0660e2623e4bbe3c12f"} Jul 28 12:40:05.613467 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:05.613265 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qjznv" Jul 28 12:40:05.630552 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:05.630504 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qjznv" podStartSLOduration=1.416628431 podStartE2EDuration="5.630488901s" totalImagesPullingTime="4.21386047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:40:05.629622824 +0000 UTC m=+309.753858623" watchObservedRunningTime="2026-07-28 12:40:05.630488901 +0000 UTC m=+309.754724699" Jul 28 12:40:12.513708 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:12.513670 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:40:12.590559 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:12.590524 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:40:12.641987 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:12.641958 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-dtz7n" event={"ID":"493171f4-5bb6-4d2f-be26-11b20236128b","Type":"ContainerStarted","Data":"b25bc7a49da0053134773fb91a73052194ac92293fcc921319cf438deb305b74"} Jul 28 12:40:12.642179 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:12.642062 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-dtz7n" Jul 28 12:40:12.663265 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:12.663221 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-dtz7n" podStartSLOduration=2.496704912 podStartE2EDuration="12.663207611s" totalImagesPullingTime="10.166502699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:40:12.661918862 +0000 UTC m=+316.786154663" watchObservedRunningTime="2026-07-28 12:40:12.663207611 +0000 UTC m=+316.787443409" Jul 28 12:40:16.620751 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:16.620723 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qjznv" Jul 28 12:40:33.648050 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:33.648017 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-dtz7n" Jul 28 12:40:56.302242 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:56.302170 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:40:56.380293 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:40:56.380261 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:20.608394 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:20.608352 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:20.666933 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:20.666900 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-zsc9b"] Jul 28 12:41:20.670307 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:20.670284 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-zsc9b" Jul 28 12:41:20.674232 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:20.672698 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3b840bd8-1945-448f-bd75-85f60c2a825c-data\") pod \"seaweedfs-64568bcd49-zsc9b\" (UID: \"3b840bd8-1945-448f-bd75-85f60c2a825c\") " pod="kserve/seaweedfs-64568bcd49-zsc9b" Jul 28 12:41:20.674232 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:20.672791 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgqds\" (UniqueName: \"kubernetes.io/projected/3b840bd8-1945-448f-bd75-85f60c2a825c-kube-api-access-jgqds\") pod \"seaweedfs-64568bcd49-zsc9b\" (UID: \"3b840bd8-1945-448f-bd75-85f60c2a825c\") " pod="kserve/seaweedfs-64568bcd49-zsc9b" Jul 28 12:41:20.674232 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:41:20.673008 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-rltvg\" is forbidden: User \"system:node:ip-10-0-137-166.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-137-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve\"/\"default-dockercfg-rltvg\"" type="*v1.Secret" Jul 28 12:41:20.674232 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:41:20.673319 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-166.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-137-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 28 12:41:20.674232 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:41:20.673348 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"seaweedfs-64568bcd49-zsc9b\" is forbidden: User \"system:node:ip-10-0-137-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-137-166.ec2.internal' and this object" podUID="3b840bd8-1945-448f-bd75-85f60c2a825c" pod="kserve/seaweedfs-64568bcd49-zsc9b" Jul 28 12:41:20.674232 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:41:20.673391 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"mlpipeline-s3-artifact\" is forbidden: User \"system:node:ip-10-0-137-166.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-137-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" type="*v1.Secret" Jul 28 12:41:20.674232 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:41:20.673776 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-166.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve\": no relationship found between node 'ip-10-0-137-166.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 28 12:41:20.691126 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:20.691101 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-zsc9b"] Jul 28 12:41:20.723921 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:20.723879 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:20.774188 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:20.774122 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3b840bd8-1945-448f-bd75-85f60c2a825c-data\") pod \"seaweedfs-64568bcd49-zsc9b\" (UID: \"3b840bd8-1945-448f-bd75-85f60c2a825c\") " pod="kserve/seaweedfs-64568bcd49-zsc9b" Jul 28 12:41:20.774339 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:20.774224 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgqds\" (UniqueName: \"kubernetes.io/projected/3b840bd8-1945-448f-bd75-85f60c2a825c-kube-api-access-jgqds\") pod \"seaweedfs-64568bcd49-zsc9b\" (UID: \"3b840bd8-1945-448f-bd75-85f60c2a825c\") " pod="kserve/seaweedfs-64568bcd49-zsc9b" Jul 28 12:41:20.774475 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:20.774455 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3b840bd8-1945-448f-bd75-85f60c2a825c-data\") pod \"seaweedfs-64568bcd49-zsc9b\" (UID: \"3b840bd8-1945-448f-bd75-85f60c2a825c\") " pod="kserve/seaweedfs-64568bcd49-zsc9b" Jul 28 12:41:20.832494 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:20.832459 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:20.927242 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:20.927133 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:21.277134 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:21.277038 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:21.377371 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:21.377338 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:21.434531 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:21.434499 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:21.704900 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:21.704868 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 28 12:41:21.782677 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:41:21.782629 2557 projected.go:291] Couldn't get configMap kserve/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jul 28 12:41:21.880812 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:21.880780 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-rltvg\"" Jul 28 12:41:22.234350 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:22.234323 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 28 12:41:22.234792 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:22.234773 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 28 12:41:22.243427 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:41:22.243399 2557 projected.go:196] Error preparing data for projected volume kube-api-access-jgqds for pod kserve/seaweedfs-64568bcd49-zsc9b: failed to sync configmap cache: timed out waiting for the condition Jul 28 12:41:22.243543 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:41:22.243475 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b840bd8-1945-448f-bd75-85f60c2a825c-kube-api-access-jgqds podName:3b840bd8-1945-448f-bd75-85f60c2a825c nodeName:}" failed. No retries permitted until 2026-07-28 12:41:22.743457111 +0000 UTC m=+386.867692908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jgqds" (UniqueName: "kubernetes.io/projected/3b840bd8-1945-448f-bd75-85f60c2a825c-kube-api-access-jgqds") pod "seaweedfs-64568bcd49-zsc9b" (UID: "3b840bd8-1945-448f-bd75-85f60c2a825c") : failed to sync configmap cache: timed out waiting for the condition Jul 28 12:41:22.791492 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:22.791461 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgqds\" (UniqueName: \"kubernetes.io/projected/3b840bd8-1945-448f-bd75-85f60c2a825c-kube-api-access-jgqds\") pod \"seaweedfs-64568bcd49-zsc9b\" (UID: \"3b840bd8-1945-448f-bd75-85f60c2a825c\") " pod="kserve/seaweedfs-64568bcd49-zsc9b" Jul 28 12:41:22.793939 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:22.793917 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgqds\" (UniqueName: \"kubernetes.io/projected/3b840bd8-1945-448f-bd75-85f60c2a825c-kube-api-access-jgqds\") pod \"seaweedfs-64568bcd49-zsc9b\" (UID: \"3b840bd8-1945-448f-bd75-85f60c2a825c\") " pod="kserve/seaweedfs-64568bcd49-zsc9b" Jul 28 12:41:23.082897 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:23.082862 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-zsc9b" Jul 28 12:41:23.232710 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:23.232681 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-zsc9b"] Jul 28 12:41:23.236979 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:41:23.236952 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b840bd8_1945_448f_bd75_85f60c2a825c.slice/crio-10babd26753e40d7084e1bec2c86aed3b53e3bff0bf64c2981b7556e7d561545 WatchSource:0}: Error finding container 10babd26753e40d7084e1bec2c86aed3b53e3bff0bf64c2981b7556e7d561545: Status 404 returned error can't find the container with id 10babd26753e40d7084e1bec2c86aed3b53e3bff0bf64c2981b7556e7d561545 Jul 28 12:41:23.909077 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:23.909041 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-zsc9b" event={"ID":"3b840bd8-1945-448f-bd75-85f60c2a825c","Type":"ContainerStarted","Data":"10babd26753e40d7084e1bec2c86aed3b53e3bff0bf64c2981b7556e7d561545"} Jul 28 12:41:24.161584 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:24.161498 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:41:27.927209 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:27.927174 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-zsc9b" event={"ID":"3b840bd8-1945-448f-bd75-85f60c2a825c","Type":"ContainerStarted","Data":"4ff111dc905898afb94917c8b23c6836e1e5334cc959455b193fe12725cfe162"} Jul 28 12:41:27.927603 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:27.927315 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-zsc9b" Jul 28 12:41:27.944391 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:27.944343 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-zsc9b" podStartSLOduration=4.282000782 podStartE2EDuration="7.944322428s" totalImagesPullingTime="3.662321646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:41:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:41:27.943940203 +0000 UTC m=+392.068176002" watchObservedRunningTime="2026-07-28 12:41:27.944322428 +0000 UTC m=+392.068558226" Jul 28 12:41:33.932483 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:41:33.932451 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-zsc9b" Jul 28 12:42:05.115408 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:05.115372 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:05.217726 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:05.217690 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:16.269072 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:16.269036 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:16.574072 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:16.573991 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:16.681721 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:16.681684 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:17.001993 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:17.001961 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:18.282293 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:18.282208 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-mgldg"] Jul 28 12:42:18.286631 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:18.286613 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-mgldg" Jul 28 12:42:18.288720 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:18.288698 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 28 12:42:18.288854 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:18.288831 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8zsg2\"" Jul 28 12:42:18.289124 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:18.289107 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 28 12:42:18.305631 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:18.305604 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-mgldg"] Jul 28 12:42:18.451453 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:18.451416 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nzxf\" (UniqueName: \"kubernetes.io/projected/cb2ed65a-448b-4922-96b2-9dc63a5e251e-kube-api-access-6nzxf\") pod \"cert-manager-operator-controller-manager-684f79c9b9-mgldg\" (UID: \"cb2ed65a-448b-4922-96b2-9dc63a5e251e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-mgldg" Jul 28 12:42:18.451622 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:18.451474 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb2ed65a-448b-4922-96b2-9dc63a5e251e-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-mgldg\" (UID: \"cb2ed65a-448b-4922-96b2-9dc63a5e251e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-mgldg" Jul 28 12:42:18.552897 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:18.552815 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nzxf\" (UniqueName: \"kubernetes.io/projected/cb2ed65a-448b-4922-96b2-9dc63a5e251e-kube-api-access-6nzxf\") pod \"cert-manager-operator-controller-manager-684f79c9b9-mgldg\" (UID: \"cb2ed65a-448b-4922-96b2-9dc63a5e251e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-mgldg" Jul 28 12:42:18.552897 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:18.552872 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb2ed65a-448b-4922-96b2-9dc63a5e251e-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-mgldg\" (UID: \"cb2ed65a-448b-4922-96b2-9dc63a5e251e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-mgldg" Jul 28 12:42:18.553261 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:18.553244 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb2ed65a-448b-4922-96b2-9dc63a5e251e-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-mgldg\" (UID: \"cb2ed65a-448b-4922-96b2-9dc63a5e251e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-mgldg" Jul 28 12:42:18.561759 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:18.561738 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nzxf\" (UniqueName: \"kubernetes.io/projected/cb2ed65a-448b-4922-96b2-9dc63a5e251e-kube-api-access-6nzxf\") pod \"cert-manager-operator-controller-manager-684f79c9b9-mgldg\" (UID: \"cb2ed65a-448b-4922-96b2-9dc63a5e251e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-mgldg" Jul 28 12:42:18.595765 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:18.595733 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-mgldg" Jul 28 12:42:18.747426 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:18.747403 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-mgldg"] Jul 28 12:42:18.750465 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:42:18.750420 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2ed65a_448b_4922_96b2_9dc63a5e251e.slice/crio-8c00911fdc3b33389f2b674f440a9d8684b43d6da6325549772292b795aba54d WatchSource:0}: Error finding container 8c00911fdc3b33389f2b674f440a9d8684b43d6da6325549772292b795aba54d: Status 404 returned error can't find the container with id 8c00911fdc3b33389f2b674f440a9d8684b43d6da6325549772292b795aba54d Jul 28 12:42:19.116155 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:19.116107 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-mgldg" event={"ID":"cb2ed65a-448b-4922-96b2-9dc63a5e251e","Type":"ContainerStarted","Data":"8c00911fdc3b33389f2b674f440a9d8684b43d6da6325549772292b795aba54d"} Jul 28 12:42:19.917966 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:19.917922 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:20.014531 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:20.014464 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:21.818779 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:21.818751 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:21.917456 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:21.917410 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:22.130321 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:22.130284 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-mgldg" event={"ID":"cb2ed65a-448b-4922-96b2-9dc63a5e251e","Type":"ContainerStarted","Data":"d84147d09552f91c1d6331173dc709e0d0b4e3f92f38393c932f560cb8a188ab"} Jul 28 12:42:22.150378 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:22.150325 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-mgldg" podStartSLOduration=1.6700411389999998 podStartE2EDuration="4.150309546s" totalImagesPullingTime="2.480268407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:42:22.149257993 +0000 UTC m=+446.273493811" watchObservedRunningTime="2026-07-28 12:42:22.150309546 +0000 UTC m=+446.274545346" Jul 28 12:42:23.864565 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:23.864530 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:24.227682 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:24.227591 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:24.594917 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:24.594878 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6hv8n"] Jul 28 12:42:24.598278 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:24.598254 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6hv8n" Jul 28 12:42:24.600414 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:24.600390 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 28 12:42:24.600537 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:24.600397 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 28 12:42:24.600907 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:24.600891 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-scmmw\"" Jul 28 12:42:24.607983 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:24.607957 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6hv8n"] Jul 28 12:42:24.698665 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:24.698619 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqzx8\" (UniqueName: \"kubernetes.io/projected/ebfa1758-ab98-42d5-9fe3-c4c0e0e0db32-kube-api-access-fqzx8\") pod \"cert-manager-cainjector-559cdd8c87-6hv8n\" (UID: \"ebfa1758-ab98-42d5-9fe3-c4c0e0e0db32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6hv8n" Jul 28 12:42:24.698845 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:24.698716 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebfa1758-ab98-42d5-9fe3-c4c0e0e0db32-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6hv8n\" (UID: \"ebfa1758-ab98-42d5-9fe3-c4c0e0e0db32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6hv8n" Jul 28 12:42:24.799537 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:24.799496 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebfa1758-ab98-42d5-9fe3-c4c0e0e0db32-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6hv8n\" (UID: \"ebfa1758-ab98-42d5-9fe3-c4c0e0e0db32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6hv8n" Jul 28 12:42:24.799724 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:24.799558 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqzx8\" (UniqueName: \"kubernetes.io/projected/ebfa1758-ab98-42d5-9fe3-c4c0e0e0db32-kube-api-access-fqzx8\") pod \"cert-manager-cainjector-559cdd8c87-6hv8n\" (UID: \"ebfa1758-ab98-42d5-9fe3-c4c0e0e0db32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6hv8n" Jul 28 12:42:24.811951 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:24.809123 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebfa1758-ab98-42d5-9fe3-c4c0e0e0db32-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6hv8n\" (UID: \"ebfa1758-ab98-42d5-9fe3-c4c0e0e0db32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6hv8n" Jul 28 12:42:24.811951 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:24.809412 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqzx8\" (UniqueName: \"kubernetes.io/projected/ebfa1758-ab98-42d5-9fe3-c4c0e0e0db32-kube-api-access-fqzx8\") pod \"cert-manager-cainjector-559cdd8c87-6hv8n\" (UID: \"ebfa1758-ab98-42d5-9fe3-c4c0e0e0db32\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6hv8n" Jul 28 12:42:24.885307 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:24.885220 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:24.915255 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:24.915223 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6hv8n" Jul 28 12:42:24.996509 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:24.996477 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:25.042984 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:25.042951 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6hv8n"] Jul 28 12:42:25.045663 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:42:25.045626 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebfa1758_ab98_42d5_9fe3_c4c0e0e0db32.slice/crio-3720731248f42d1792de159d2b5f1705d6edda8802d4e63ff4224af59b776256 WatchSource:0}: Error finding container 3720731248f42d1792de159d2b5f1705d6edda8802d4e63ff4224af59b776256: Status 404 returned error can't find the container with id 3720731248f42d1792de159d2b5f1705d6edda8802d4e63ff4224af59b776256 Jul 28 12:42:25.144078 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:25.143996 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6hv8n" event={"ID":"ebfa1758-ab98-42d5-9fe3-c4c0e0e0db32","Type":"ContainerStarted","Data":"3720731248f42d1792de159d2b5f1705d6edda8802d4e63ff4224af59b776256"} Jul 28 12:42:26.838415 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:26.838367 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:26.944825 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:26.944773 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:27.039477 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:27.039445 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:28.159809 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:28.159710 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6hv8n" event={"ID":"ebfa1758-ab98-42d5-9fe3-c4c0e0e0db32","Type":"ContainerStarted","Data":"b47365a9079ec02897905be42416073cec79bd09e0b86a68eb0463af67abc8ad"} Jul 28 12:42:28.178593 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:28.178536 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6hv8n" podStartSLOduration=1.331940823 podStartE2EDuration="4.178514934s" totalImagesPullingTime="2.846574111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:42:28.17696278 +0000 UTC m=+452.301198575" watchObservedRunningTime="2026-07-28 12:42:28.178514934 +0000 UTC m=+452.302750735" Jul 28 12:42:30.393384 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:30.393348 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-s4rrh"] Jul 28 12:42:30.396735 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:30.396711 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-s4rrh" Jul 28 12:42:30.398798 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:30.398771 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-k8gt4\"" Jul 28 12:42:30.404819 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:30.404794 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-s4rrh"] Jul 28 12:42:30.445076 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:30.445036 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkd2w\" (UniqueName: \"kubernetes.io/projected/830dc949-79ef-4000-8c4a-290b9019bfd4-kube-api-access-mkd2w\") pod \"cert-manager-webhook-6486ffd997-s4rrh\" (UID: \"830dc949-79ef-4000-8c4a-290b9019bfd4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-s4rrh" Jul 28 12:42:30.445259 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:30.445101 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/830dc949-79ef-4000-8c4a-290b9019bfd4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-s4rrh\" (UID: \"830dc949-79ef-4000-8c4a-290b9019bfd4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-s4rrh" Jul 28 12:42:30.546067 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:30.546028 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/830dc949-79ef-4000-8c4a-290b9019bfd4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-s4rrh\" (UID: \"830dc949-79ef-4000-8c4a-290b9019bfd4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-s4rrh" Jul 28 12:42:30.546259 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:30.546079 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkd2w\" (UniqueName: \"kubernetes.io/projected/830dc949-79ef-4000-8c4a-290b9019bfd4-kube-api-access-mkd2w\") pod \"cert-manager-webhook-6486ffd997-s4rrh\" (UID: \"830dc949-79ef-4000-8c4a-290b9019bfd4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-s4rrh" Jul 28 12:42:30.554091 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:30.554066 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/830dc949-79ef-4000-8c4a-290b9019bfd4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-s4rrh\" (UID: \"830dc949-79ef-4000-8c4a-290b9019bfd4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-s4rrh" Jul 28 12:42:30.554190 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:30.554154 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkd2w\" (UniqueName: \"kubernetes.io/projected/830dc949-79ef-4000-8c4a-290b9019bfd4-kube-api-access-mkd2w\") pod \"cert-manager-webhook-6486ffd997-s4rrh\" (UID: \"830dc949-79ef-4000-8c4a-290b9019bfd4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-s4rrh" Jul 28 12:42:30.706800 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:30.706707 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-s4rrh" Jul 28 12:42:30.836906 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:30.836873 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-s4rrh"] Jul 28 12:42:30.840371 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:42:30.840342 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod830dc949_79ef_4000_8c4a_290b9019bfd4.slice/crio-58ed2ecdb87bd5c53d3117615bde88eeece4266060d3af80efd56c5c7b7fbe64 WatchSource:0}: Error finding container 58ed2ecdb87bd5c53d3117615bde88eeece4266060d3af80efd56c5c7b7fbe64: Status 404 returned error can't find the container with id 58ed2ecdb87bd5c53d3117615bde88eeece4266060d3af80efd56c5c7b7fbe64 Jul 28 12:42:31.100556 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:31.100522 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:31.173670 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:31.173636 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-s4rrh" event={"ID":"830dc949-79ef-4000-8c4a-290b9019bfd4","Type":"ContainerStarted","Data":"2b301f2eec96c429e9bd2410e4d02157581bb4fd5acd959b58d494f4bb1dc532"} Jul 28 12:42:31.173670 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:31.173675 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-s4rrh" event={"ID":"830dc949-79ef-4000-8c4a-290b9019bfd4","Type":"ContainerStarted","Data":"58ed2ecdb87bd5c53d3117615bde88eeece4266060d3af80efd56c5c7b7fbe64"} Jul 28 12:42:31.173890 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:31.173740 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-s4rrh" Jul 28 12:42:31.190466 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:31.190399 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-s4rrh" podStartSLOduration=1.190377679 podStartE2EDuration="1.190377679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:42:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:42:31.18894307 +0000 UTC m=+455.313178874" watchObservedRunningTime="2026-07-28 12:42:31.190377679 +0000 UTC m=+455.314613478" Jul 28 12:42:31.194691 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:31.194655 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:32.424876 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:32.424829 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:35.473301 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:35.473259 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:35.586993 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:35.586964 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:37.181237 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:37.181198 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-s4rrh" Jul 28 12:42:45.553844 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:45.553808 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:50.925699 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:50.925660 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:50.992179 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:50.992129 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:52.007505 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:52.007460 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:55.398434 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:55.398400 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:55.490987 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:55.490955 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:59.458808 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.458775 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2"] Jul 28 12:42:59.464963 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.464937 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.467911 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.467883 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-default-dockercfg-mlbvs\"" Jul 28 12:42:59.468073 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.468055 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 28 12:42:59.482819 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.482791 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2"] Jul 28 12:42:59.516027 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.515979 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:59.594538 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.594503 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0bf6b47-295a-4d23-aa00-76d0394fad73-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.594699 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.594550 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0bf6b47-295a-4d23-aa00-76d0394fad73-workload-socket\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.594699 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.594570 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0bf6b47-295a-4d23-aa00-76d0394fad73-istio-envoy\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.594699 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.594643 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0bf6b47-295a-4d23-aa00-76d0394fad73-istio-data\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.594699 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.594669 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0bf6b47-295a-4d23-aa00-76d0394fad73-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.594699 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.594698 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkqpw\" (UniqueName: \"kubernetes.io/projected/e0bf6b47-295a-4d23-aa00-76d0394fad73-kube-api-access-dkqpw\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.594905 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.594728 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0bf6b47-295a-4d23-aa00-76d0394fad73-istio-token\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.594905 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.594763 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0bf6b47-295a-4d23-aa00-76d0394fad73-credential-socket\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.594905 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.594785 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0bf6b47-295a-4d23-aa00-76d0394fad73-workload-certs\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.618544 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.618504 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:42:59.695716 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.695677 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0bf6b47-295a-4d23-aa00-76d0394fad73-workload-socket\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.695716 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.695712 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0bf6b47-295a-4d23-aa00-76d0394fad73-istio-envoy\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.695939 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.695746 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0bf6b47-295a-4d23-aa00-76d0394fad73-istio-data\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.695939 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.695770 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0bf6b47-295a-4d23-aa00-76d0394fad73-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.695939 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.695819 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqpw\" (UniqueName: \"kubernetes.io/projected/e0bf6b47-295a-4d23-aa00-76d0394fad73-kube-api-access-dkqpw\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.695939 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.695864 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0bf6b47-295a-4d23-aa00-76d0394fad73-istio-token\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.695939 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.695904 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0bf6b47-295a-4d23-aa00-76d0394fad73-credential-socket\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.696167 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.695939 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0bf6b47-295a-4d23-aa00-76d0394fad73-workload-certs\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.696167 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.695971 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0bf6b47-295a-4d23-aa00-76d0394fad73-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.696275 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.696256 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0bf6b47-295a-4d23-aa00-76d0394fad73-istio-data\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.696334 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.696274 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0bf6b47-295a-4d23-aa00-76d0394fad73-workload-socket\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.696530 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.696503 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0bf6b47-295a-4d23-aa00-76d0394fad73-credential-socket\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.696615 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.696591 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0bf6b47-295a-4d23-aa00-76d0394fad73-workload-certs\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.696731 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.696710 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0bf6b47-295a-4d23-aa00-76d0394fad73-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.698584 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.698551 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0bf6b47-295a-4d23-aa00-76d0394fad73-istio-envoy\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.698914 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.698895 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0bf6b47-295a-4d23-aa00-76d0394fad73-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.704796 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.704768 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0bf6b47-295a-4d23-aa00-76d0394fad73-istio-token\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.705252 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.705231 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkqpw\" (UniqueName: \"kubernetes.io/projected/e0bf6b47-295a-4d23-aa00-76d0394fad73-kube-api-access-dkqpw\") pod \"openshift-ai-inference-openshift-default-8699b59bbc-httr2\" (UID: \"e0bf6b47-295a-4d23-aa00-76d0394fad73\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.776904 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.776818 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:42:59.909974 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:42:59.909938 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2"] Jul 28 12:42:59.912912 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:42:59.912872 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0bf6b47_295a_4d23_aa00_76d0394fad73.slice/crio-fb63fa574e9a881154c9138c05ae886a6622d99bc70da2cfb4dfca314f6a29d2 WatchSource:0}: Error finding container fb63fa574e9a881154c9138c05ae886a6622d99bc70da2cfb4dfca314f6a29d2: Status 404 returned error can't find the container with id fb63fa574e9a881154c9138c05ae886a6622d99bc70da2cfb4dfca314f6a29d2 Jul 28 12:43:00.292656 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:00.292618 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" event={"ID":"e0bf6b47-295a-4d23-aa00-76d0394fad73","Type":"ContainerStarted","Data":"fb63fa574e9a881154c9138c05ae886a6622d99bc70da2cfb4dfca314f6a29d2"} Jul 28 12:43:02.715852 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:02.715804 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 28 12:43:02.716238 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:02.715901 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 28 12:43:02.716238 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:02.715985 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 28 12:43:02.729203 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:02.729105 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:03.308189 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:03.308119 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" event={"ID":"e0bf6b47-295a-4d23-aa00-76d0394fad73","Type":"ContainerStarted","Data":"86fc69ba8d6bfa0434840e3d92d7a6cf591d410e4b8532e60e87fc43d4850256"} Jul 28 12:43:03.331203 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:03.331126 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" podStartSLOduration=1.530669093 podStartE2EDuration="4.331106214s" totalImagesPullingTime="2.800437121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:43:03.329600818 +0000 UTC m=+487.453836628" watchObservedRunningTime="2026-07-28 12:43:03.331106214 +0000 UTC m=+487.455342040" Jul 28 12:43:03.777332 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:03.777289 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:43:03.782019 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:03.781994 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:43:04.313575 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.313543 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:43:04.314492 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.314472 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-8699b59bbc-httr2" Jul 28 12:43:04.761251 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.761221 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:04.781199 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.781169 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv"] Jul 28 12:43:04.784558 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.784538 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" Jul 28 12:43:04.786986 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.786968 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 28 12:43:04.787414 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.787397 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-t6gpr\"" Jul 28 12:43:04.787799 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.787783 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 28 12:43:04.787889 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.787863 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 28 12:43:04.787961 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.787899 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 28 12:43:04.788054 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.788032 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 28 12:43:04.800043 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.800018 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv"] Jul 28 12:43:04.841836 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.841799 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:04.940781 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.940741 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q82xc\" (UniqueName: \"kubernetes.io/projected/813040be-5fe9-466b-8e90-238cc39f1e06-kube-api-access-q82xc\") pod \"lws-controller-manager-7d9f9f6c89-v7ssv\" (UID: \"813040be-5fe9-466b-8e90-238cc39f1e06\") " pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" Jul 28 12:43:04.940945 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.940799 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/813040be-5fe9-466b-8e90-238cc39f1e06-manager-config\") pod \"lws-controller-manager-7d9f9f6c89-v7ssv\" (UID: \"813040be-5fe9-466b-8e90-238cc39f1e06\") " pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" Jul 28 12:43:04.940945 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.940853 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/813040be-5fe9-466b-8e90-238cc39f1e06-cert\") pod \"lws-controller-manager-7d9f9f6c89-v7ssv\" (UID: \"813040be-5fe9-466b-8e90-238cc39f1e06\") " pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" Jul 28 12:43:04.940945 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:04.940883 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/813040be-5fe9-466b-8e90-238cc39f1e06-metrics-cert\") pod \"lws-controller-manager-7d9f9f6c89-v7ssv\" (UID: \"813040be-5fe9-466b-8e90-238cc39f1e06\") " pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" Jul 28 12:43:05.041561 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:05.041468 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/813040be-5fe9-466b-8e90-238cc39f1e06-manager-config\") pod \"lws-controller-manager-7d9f9f6c89-v7ssv\" (UID: \"813040be-5fe9-466b-8e90-238cc39f1e06\") " pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" Jul 28 12:43:05.041561 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:05.041511 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/813040be-5fe9-466b-8e90-238cc39f1e06-cert\") pod \"lws-controller-manager-7d9f9f6c89-v7ssv\" (UID: \"813040be-5fe9-466b-8e90-238cc39f1e06\") " pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" Jul 28 12:43:05.041561 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:05.041534 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/813040be-5fe9-466b-8e90-238cc39f1e06-metrics-cert\") pod \"lws-controller-manager-7d9f9f6c89-v7ssv\" (UID: \"813040be-5fe9-466b-8e90-238cc39f1e06\") " pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" Jul 28 12:43:05.041835 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:05.041588 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q82xc\" (UniqueName: \"kubernetes.io/projected/813040be-5fe9-466b-8e90-238cc39f1e06-kube-api-access-q82xc\") pod \"lws-controller-manager-7d9f9f6c89-v7ssv\" (UID: \"813040be-5fe9-466b-8e90-238cc39f1e06\") " pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" Jul 28 12:43:05.042286 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:05.042264 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/813040be-5fe9-466b-8e90-238cc39f1e06-manager-config\") pod \"lws-controller-manager-7d9f9f6c89-v7ssv\" (UID: \"813040be-5fe9-466b-8e90-238cc39f1e06\") " pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" Jul 28 12:43:05.044381 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:05.044347 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/813040be-5fe9-466b-8e90-238cc39f1e06-cert\") pod \"lws-controller-manager-7d9f9f6c89-v7ssv\" (UID: \"813040be-5fe9-466b-8e90-238cc39f1e06\") " pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" Jul 28 12:43:05.044497 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:05.044407 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/813040be-5fe9-466b-8e90-238cc39f1e06-metrics-cert\") pod \"lws-controller-manager-7d9f9f6c89-v7ssv\" (UID: \"813040be-5fe9-466b-8e90-238cc39f1e06\") " pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" Jul 28 12:43:05.057238 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:05.057199 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q82xc\" (UniqueName: \"kubernetes.io/projected/813040be-5fe9-466b-8e90-238cc39f1e06-kube-api-access-q82xc\") pod \"lws-controller-manager-7d9f9f6c89-v7ssv\" (UID: \"813040be-5fe9-466b-8e90-238cc39f1e06\") " pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" Jul 28 12:43:05.094023 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:05.093981 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" Jul 28 12:43:05.113583 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:05.113533 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:05.220702 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:05.220663 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:05.256897 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:05.256766 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv"] Jul 28 12:43:05.259044 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:43:05.259016 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod813040be_5fe9_466b_8e90_238cc39f1e06.slice/crio-9c406292c19fc8ff40f78e0c6b271f152c805f5c5d48adf80138e1e3375aeafd WatchSource:0}: Error finding container 9c406292c19fc8ff40f78e0c6b271f152c805f5c5d48adf80138e1e3375aeafd: Status 404 returned error can't find the container with id 9c406292c19fc8ff40f78e0c6b271f152c805f5c5d48adf80138e1e3375aeafd Jul 28 12:43:05.318931 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:05.318846 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" event={"ID":"813040be-5fe9-466b-8e90-238cc39f1e06","Type":"ContainerStarted","Data":"9c406292c19fc8ff40f78e0c6b271f152c805f5c5d48adf80138e1e3375aeafd"} Jul 28 12:43:08.334816 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:08.334781 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" event={"ID":"813040be-5fe9-466b-8e90-238cc39f1e06","Type":"ContainerStarted","Data":"ae5b473abf51805808ed1a14a955c11684651a389f4eed143626eb88563b147a"} Jul 28 12:43:08.335209 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:08.334878 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" Jul 28 12:43:08.351837 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:08.351779 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" podStartSLOduration=1.630468662 podStartE2EDuration="4.351760192s" totalImagesPullingTime="2.72129153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:43:08.3496648 +0000 UTC m=+492.473900601" watchObservedRunningTime="2026-07-28 12:43:08.351760192 +0000 UTC m=+492.475995992" Jul 28 12:43:19.341056 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:19.341023 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d9f9f6c89-v7ssv" Jul 28 12:43:20.063571 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:20.063544 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:20.876618 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:20.876581 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:21.657828 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:21.657796 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:23.951498 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:23.951461 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:24.052652 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:24.052616 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:25.307364 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:25.307327 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:26.347686 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:26.347652 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:27.068852 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:27.068823 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:27.466065 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:27.466026 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:29.346860 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:29.346821 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:30.069718 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:30.069681 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:31.119718 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:31.119684 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:32.332716 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.332644 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:32.347094 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.347060 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm"] Jul 28 12:43:32.352931 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.352914 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm" Jul 28 12:43:32.354888 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.354870 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 28 12:43:32.354991 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.354965 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 28 12:43:32.355446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.355429 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-r4nkl\"" Jul 28 12:43:32.355499 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.355486 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 28 12:43:32.355545 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.355492 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 28 12:43:32.359078 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.359056 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm"] Jul 28 12:43:32.460484 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.460449 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qsrt\" (UniqueName: \"kubernetes.io/projected/11a9483e-c7d7-496c-b3b5-488015850670-kube-api-access-7qsrt\") pod \"kuadrant-console-plugin-598f86468b-jqngm\" (UID: \"11a9483e-c7d7-496c-b3b5-488015850670\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm" Jul 28 12:43:32.460662 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.460523 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/11a9483e-c7d7-496c-b3b5-488015850670-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-jqngm\" (UID: \"11a9483e-c7d7-496c-b3b5-488015850670\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm" Jul 28 12:43:32.460662 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.460612 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/11a9483e-c7d7-496c-b3b5-488015850670-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-jqngm\" (UID: \"11a9483e-c7d7-496c-b3b5-488015850670\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm" Jul 28 12:43:32.479400 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.479346 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:32.561724 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.561687 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qsrt\" (UniqueName: \"kubernetes.io/projected/11a9483e-c7d7-496c-b3b5-488015850670-kube-api-access-7qsrt\") pod \"kuadrant-console-plugin-598f86468b-jqngm\" (UID: \"11a9483e-c7d7-496c-b3b5-488015850670\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm" Jul 28 12:43:32.561921 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.561746 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/11a9483e-c7d7-496c-b3b5-488015850670-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-jqngm\" (UID: \"11a9483e-c7d7-496c-b3b5-488015850670\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm" Jul 28 12:43:32.561921 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.561776 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/11a9483e-c7d7-496c-b3b5-488015850670-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-jqngm\" (UID: \"11a9483e-c7d7-496c-b3b5-488015850670\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm" Jul 28 12:43:32.562381 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.562360 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/11a9483e-c7d7-496c-b3b5-488015850670-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-jqngm\" (UID: \"11a9483e-c7d7-496c-b3b5-488015850670\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm" Jul 28 12:43:32.564266 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.564248 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/11a9483e-c7d7-496c-b3b5-488015850670-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-jqngm\" (UID: \"11a9483e-c7d7-496c-b3b5-488015850670\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm" Jul 28 12:43:32.574986 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.574958 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qsrt\" (UniqueName: \"kubernetes.io/projected/11a9483e-c7d7-496c-b3b5-488015850670-kube-api-access-7qsrt\") pod \"kuadrant-console-plugin-598f86468b-jqngm\" (UID: \"11a9483e-c7d7-496c-b3b5-488015850670\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm" Jul 28 12:43:32.662662 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.662571 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm" Jul 28 12:43:32.794179 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:32.794126 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm"] Jul 28 12:43:32.796743 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:43:32.796715 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11a9483e_c7d7_496c_b3b5_488015850670.slice/crio-7a92694afe31f1ac2e0d0499bc9e4b101417b808a2eabceb806b1dea357824cd WatchSource:0}: Error finding container 7a92694afe31f1ac2e0d0499bc9e4b101417b808a2eabceb806b1dea357824cd: Status 404 returned error can't find the container with id 7a92694afe31f1ac2e0d0499bc9e4b101417b808a2eabceb806b1dea357824cd Jul 28 12:43:33.408866 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:33.408822 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:33.451552 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:33.451514 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm" event={"ID":"11a9483e-c7d7-496c-b3b5-488015850670","Type":"ContainerStarted","Data":"7a92694afe31f1ac2e0d0499bc9e4b101417b808a2eabceb806b1dea357824cd"} Jul 28 12:43:35.078876 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:35.078841 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:35.187335 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:35.187301 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:35.464090 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:35.464012 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:35.564382 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:35.564348 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:35.864976 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:35.864942 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:35.926261 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:35.926228 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:38.475153 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:38.475109 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm" event={"ID":"11a9483e-c7d7-496c-b3b5-488015850670","Type":"ContainerStarted","Data":"c529a1c3902afeb48258069fa4049261d9e822bfa899b444317c36ecf46170db"} Jul 28 12:43:38.493624 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:38.493577 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-jqngm" podStartSLOduration=1.82944288 podStartE2EDuration="6.493562153s" totalImagesPullingTime="4.664119273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:43:38.492233404 +0000 UTC m=+522.616469223" watchObservedRunningTime="2026-07-28 12:43:38.493562153 +0000 UTC m=+522.617797951" Jul 28 12:43:41.552341 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:41.552305 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:41.653176 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:41.653130 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:48.116150 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:48.116091 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:48.216864 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:48.216797 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:48.313438 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:48.313384 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:51.100668 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:51.100635 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:51.202575 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:51.202542 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:56.328475 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:56.328443 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:56.488238 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:56.488199 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:56.700768 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:56.700654 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:56.796880 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:56.796846 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:56.897039 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:56.897001 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:43:56.969995 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:43:56.969918 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:00.475497 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:00.475463 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:00.567494 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:00.567454 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:03.367486 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:03.367456 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:03.470027 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:03.469985 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:09.901459 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:09.901420 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:10.000653 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:10.000621 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:12.899304 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:12.899269 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:13.012946 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:13.012912 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:13.197067 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:13.196953 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:13.297373 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:13.297342 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:13.936156 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:13.936115 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-bfzhn"] Jul 28 12:44:13.958601 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:13.958571 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bfzhn"] Jul 28 12:44:13.958745 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:13.958675 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-bfzhn" Jul 28 12:44:13.960855 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:13.960835 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-58whz\"" Jul 28 12:44:13.977090 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:13.977065 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:14.026382 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:14.026357 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtlnx\" (UniqueName: \"kubernetes.io/projected/1732de76-afd8-49cc-bf36-be411fef16df-kube-api-access-wtlnx\") pod \"authorino-b54df94b4-bfzhn\" (UID: \"1732de76-afd8-49cc-bf36-be411fef16df\") " pod="kuadrant-system/authorino-b54df94b4-bfzhn" Jul 28 12:44:14.127650 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:14.127617 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtlnx\" (UniqueName: \"kubernetes.io/projected/1732de76-afd8-49cc-bf36-be411fef16df-kube-api-access-wtlnx\") pod \"authorino-b54df94b4-bfzhn\" (UID: \"1732de76-afd8-49cc-bf36-be411fef16df\") " pod="kuadrant-system/authorino-b54df94b4-bfzhn" Jul 28 12:44:14.136569 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:14.136544 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtlnx\" (UniqueName: \"kubernetes.io/projected/1732de76-afd8-49cc-bf36-be411fef16df-kube-api-access-wtlnx\") pod \"authorino-b54df94b4-bfzhn\" (UID: \"1732de76-afd8-49cc-bf36-be411fef16df\") " pod="kuadrant-system/authorino-b54df94b4-bfzhn" Jul 28 12:44:14.267486 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:14.267406 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-bfzhn" Jul 28 12:44:14.280560 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:14.280508 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:44:14.395611 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:14.395588 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bfzhn"] Jul 28 12:44:14.398166 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:44:14.398111 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1732de76_afd8_49cc_bf36_be411fef16df.slice/crio-3dd37c967f81b7306f13ca033993a301321756a7547eeb00153f13cb1346f186 WatchSource:0}: Error finding container 3dd37c967f81b7306f13ca033993a301321756a7547eeb00153f13cb1346f186: Status 404 returned error can't find the container with id 3dd37c967f81b7306f13ca033993a301321756a7547eeb00153f13cb1346f186 Jul 28 12:44:14.628167 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:14.628117 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-bfzhn" event={"ID":"1732de76-afd8-49cc-bf36-be411fef16df","Type":"ContainerStarted","Data":"3dd37c967f81b7306f13ca033993a301321756a7547eeb00153f13cb1346f186"} Jul 28 12:44:17.645256 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:17.645218 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-bfzhn" event={"ID":"1732de76-afd8-49cc-bf36-be411fef16df","Type":"ContainerStarted","Data":"50c00403d48c50542a92444ac8344df397beeef4f2f6bfda72045be60b3a9b7c"} Jul 28 12:44:17.659742 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:17.659693 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-bfzhn" podStartSLOduration=2.208271587 podStartE2EDuration="4.659679229s" totalImagesPullingTime="2.451407642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:44:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:44:17.658532231 +0000 UTC m=+561.782768050" watchObservedRunningTime="2026-07-28 12:44:17.659679229 +0000 UTC m=+561.783915054" Jul 28 12:44:56.262126 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:56.262093 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-br7dg_849f14b1-2639-4b88-ad46-49fcb4b0aa04/console-operator/1.log" Jul 28 12:44:56.263198 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:44:56.263178 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-br7dg_849f14b1-2639-4b88-ad46-49fcb4b0aa04/console-operator/1.log" Jul 28 12:45:15.912774 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:45:15.912720 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:46:01.759579 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:46:01.759547 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:49:03.320916 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:03.320883 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:49:03.391721 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:03.391660 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:49:13.305080 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:13.305040 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bfzhn"] Jul 28 12:49:13.305848 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:13.305796 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-bfzhn" podUID="1732de76-afd8-49cc-bf36-be411fef16df" containerName="authorino" containerID="cri-o://50c00403d48c50542a92444ac8344df397beeef4f2f6bfda72045be60b3a9b7c" gracePeriod=30 Jul 28 12:49:13.317472 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:13.317448 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:49:13.556190 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:13.556109 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-bfzhn" Jul 28 12:49:13.659060 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:13.659031 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtlnx\" (UniqueName: \"kubernetes.io/projected/1732de76-afd8-49cc-bf36-be411fef16df-kube-api-access-wtlnx\") pod \"1732de76-afd8-49cc-bf36-be411fef16df\" (UID: \"1732de76-afd8-49cc-bf36-be411fef16df\") " Jul 28 12:49:13.661159 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:13.661122 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1732de76-afd8-49cc-bf36-be411fef16df-kube-api-access-wtlnx" (OuterVolumeSpecName: "kube-api-access-wtlnx") pod "1732de76-afd8-49cc-bf36-be411fef16df" (UID: "1732de76-afd8-49cc-bf36-be411fef16df"). InnerVolumeSpecName "kube-api-access-wtlnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:49:13.760193 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:13.760159 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtlnx\" (UniqueName: \"kubernetes.io/projected/1732de76-afd8-49cc-bf36-be411fef16df-kube-api-access-wtlnx\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Jul 28 12:49:13.914848 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:13.914811 2557 generic.go:356] "Generic (PLEG): container finished" podID="1732de76-afd8-49cc-bf36-be411fef16df" containerID="50c00403d48c50542a92444ac8344df397beeef4f2f6bfda72045be60b3a9b7c" exitCode=0 Jul 28 12:49:13.914848 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:13.914848 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-bfzhn" Jul 28 12:49:13.915056 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:13.914853 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-bfzhn" event={"ID":"1732de76-afd8-49cc-bf36-be411fef16df","Type":"ContainerDied","Data":"50c00403d48c50542a92444ac8344df397beeef4f2f6bfda72045be60b3a9b7c"} Jul 28 12:49:13.915056 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:13.914979 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-bfzhn" event={"ID":"1732de76-afd8-49cc-bf36-be411fef16df","Type":"ContainerDied","Data":"3dd37c967f81b7306f13ca033993a301321756a7547eeb00153f13cb1346f186"} Jul 28 12:49:13.915056 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:13.914998 2557 scope.go:117] "RemoveContainer" containerID="50c00403d48c50542a92444ac8344df397beeef4f2f6bfda72045be60b3a9b7c" Jul 28 12:49:13.923781 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:13.923761 2557 scope.go:117] "RemoveContainer" containerID="50c00403d48c50542a92444ac8344df397beeef4f2f6bfda72045be60b3a9b7c" Jul 28 12:49:13.924039 ip-10-0-137-166 kubenswrapper[2557]: E0728 12:49:13.924015 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50c00403d48c50542a92444ac8344df397beeef4f2f6bfda72045be60b3a9b7c\": container with ID starting with 50c00403d48c50542a92444ac8344df397beeef4f2f6bfda72045be60b3a9b7c not found: ID does not exist" containerID="50c00403d48c50542a92444ac8344df397beeef4f2f6bfda72045be60b3a9b7c" Jul 28 12:49:13.924092 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:13.924050 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c00403d48c50542a92444ac8344df397beeef4f2f6bfda72045be60b3a9b7c"} err="failed to get container status \"50c00403d48c50542a92444ac8344df397beeef4f2f6bfda72045be60b3a9b7c\": rpc error: code = NotFound desc = could not find container \"50c00403d48c50542a92444ac8344df397beeef4f2f6bfda72045be60b3a9b7c\": container with ID starting with 50c00403d48c50542a92444ac8344df397beeef4f2f6bfda72045be60b3a9b7c not found: ID does not exist" Jul 28 12:49:13.934826 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:13.934795 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bfzhn"] Jul 28 12:49:13.936809 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:13.936786 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bfzhn"] Jul 28 12:49:14.379694 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:14.379664 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1732de76-afd8-49cc-bf36-be411fef16df" path="/var/lib/kubelet/pods/1732de76-afd8-49cc-bf36-be411fef16df/volumes" Jul 28 12:49:28.544537 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:28.544501 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:49:28.644153 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:28.644116 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:49:28.740989 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:28.740955 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-h8sq5"] Jul 28 12:49:28.741297 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:28.741284 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1732de76-afd8-49cc-bf36-be411fef16df" containerName="authorino" Jul 28 12:49:28.741344 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:28.741299 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1732de76-afd8-49cc-bf36-be411fef16df" containerName="authorino" Jul 28 12:49:28.741378 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:28.741349 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1732de76-afd8-49cc-bf36-be411fef16df" containerName="authorino" Jul 28 12:49:28.743005 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:28.742982 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-h8sq5" Jul 28 12:49:28.745011 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:28.744992 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jlmd9\"" Jul 28 12:49:28.754198 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:28.754175 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-h8sq5"] Jul 28 12:49:28.772621 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:28.772595 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:49:28.875267 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:28.875241 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:49:28.886445 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:28.886419 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5szb\" (UniqueName: \"kubernetes.io/projected/43e82319-18d9-4123-85a7-66590ba6ece7-kube-api-access-v5szb\") pod \"authorino-b54df94b4-h8sq5\" (UID: \"43e82319-18d9-4123-85a7-66590ba6ece7\") " pod="kuadrant-system/authorino-b54df94b4-h8sq5" Jul 28 12:49:28.987448 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:28.987422 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5szb\" (UniqueName: \"kubernetes.io/projected/43e82319-18d9-4123-85a7-66590ba6ece7-kube-api-access-v5szb\") pod \"authorino-b54df94b4-h8sq5\" (UID: \"43e82319-18d9-4123-85a7-66590ba6ece7\") " pod="kuadrant-system/authorino-b54df94b4-h8sq5" Jul 28 12:49:28.994994 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:28.994965 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5szb\" (UniqueName: \"kubernetes.io/projected/43e82319-18d9-4123-85a7-66590ba6ece7-kube-api-access-v5szb\") pod \"authorino-b54df94b4-h8sq5\" (UID: \"43e82319-18d9-4123-85a7-66590ba6ece7\") " pod="kuadrant-system/authorino-b54df94b4-h8sq5" Jul 28 12:49:29.051532 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:29.051507 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-h8sq5" Jul 28 12:49:29.178508 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:29.178482 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-h8sq5"] Jul 28 12:49:29.180962 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:49:29.180933 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43e82319_18d9_4123_85a7_66590ba6ece7.slice/crio-6b7184f7aa6336ffa14af9dbbf6719feb2a46b7b1517379b307e70a012437cef WatchSource:0}: Error finding container 6b7184f7aa6336ffa14af9dbbf6719feb2a46b7b1517379b307e70a012437cef: Status 404 returned error can't find the container with id 6b7184f7aa6336ffa14af9dbbf6719feb2a46b7b1517379b307e70a012437cef Jul 28 12:49:29.182282 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:29.182266 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 12:49:29.984553 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:29.984520 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-h8sq5" event={"ID":"43e82319-18d9-4123-85a7-66590ba6ece7","Type":"ContainerStarted","Data":"835c0fe5eab7dc395ed101b021a7bb5a083303cb016a6993fc36e06af1f0c218"} Jul 28 12:49:29.984553 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:29.984561 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-h8sq5" event={"ID":"43e82319-18d9-4123-85a7-66590ba6ece7","Type":"ContainerStarted","Data":"6b7184f7aa6336ffa14af9dbbf6719feb2a46b7b1517379b307e70a012437cef"} Jul 28 12:49:30.000203 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:30.000133 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-h8sq5" podStartSLOduration=1.35499595 podStartE2EDuration="2.000117307s" totalImagesPullingTime="645.121357ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:49:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:49:29.999503939 +0000 UTC m=+874.123739739" watchObservedRunningTime="2026-07-28 12:49:30.000117307 +0000 UTC m=+874.124353107" Jul 28 12:49:38.977431 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:38.977393 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:49:56.289480 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:56.289397 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-br7dg_849f14b1-2639-4b88-ad46-49fcb4b0aa04/console-operator/1.log" Jul 28 12:49:56.292039 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:49:56.292013 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-br7dg_849f14b1-2639-4b88-ad46-49fcb4b0aa04/console-operator/1.log" Jul 28 12:50:39.031944 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:50:39.031905 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:51:20.436667 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:51:20.436588 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:52:46.395473 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:52:46.395439 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:54:36.206300 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:54:36.206227 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:54:36.283879 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:54:36.283849 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:54:53.076861 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:54:53.076827 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:54:54.299435 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:54:54.299407 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-8699b59bbc-httr2_e0bf6b47-295a-4d23-aa00-76d0394fad73/istio-proxy/0.log" Jul 28 12:54:54.330203 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:54:54.330176 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56478d6f5-lmml8_54e64e8c-6beb-4e4a-8da8-b7095e0950b4/router/0.log" Jul 28 12:54:55.000172 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:54:55.000133 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b54df94b4-h8sq5_43e82319-18d9-4123-85a7-66590ba6ece7/authorino/0.log" Jul 28 12:54:55.059858 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:54:55.059834 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-jqngm_11a9483e-c7d7-496c-b3b5-488015850670/kuadrant-console-plugin/0.log" Jul 28 12:54:56.317227 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:54:56.317200 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-br7dg_849f14b1-2639-4b88-ad46-49fcb4b0aa04/console-operator/1.log" Jul 28 12:54:56.320349 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:54:56.320325 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-br7dg_849f14b1-2639-4b88-ad46-49fcb4b0aa04/console-operator/1.log" Jul 28 12:55:01.111067 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.111035 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:55:01.287958 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.287925 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5mqzp/must-gather-6769n"] Jul 28 12:55:01.291403 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.291381 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5mqzp/must-gather-6769n" Jul 28 12:55:01.294024 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.294001 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5mqzp\"/\"openshift-service-ca.crt\"" Jul 28 12:55:01.294424 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.294399 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5mqzp\"/\"kube-root-ca.crt\"" Jul 28 12:55:01.294736 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.294710 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b26d35a-b5b5-4928-add9-d5085ab2389e-must-gather-output\") pod \"must-gather-6769n\" (UID: \"1b26d35a-b5b5-4928-add9-d5085ab2389e\") " pod="openshift-must-gather-5mqzp/must-gather-6769n" Jul 28 12:55:01.294845 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.294755 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5mqzp\"/\"default-dockercfg-xrff4\"" Jul 28 12:55:01.294845 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.294787 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd2b9\" (UniqueName: \"kubernetes.io/projected/1b26d35a-b5b5-4928-add9-d5085ab2389e-kube-api-access-fd2b9\") pod \"must-gather-6769n\" (UID: \"1b26d35a-b5b5-4928-add9-d5085ab2389e\") " pod="openshift-must-gather-5mqzp/must-gather-6769n" Jul 28 12:55:01.306240 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.306219 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5mqzp/must-gather-6769n"] Jul 28 12:55:01.320414 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.320383 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:55:01.395490 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.395419 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b26d35a-b5b5-4928-add9-d5085ab2389e-must-gather-output\") pod \"must-gather-6769n\" (UID: \"1b26d35a-b5b5-4928-add9-d5085ab2389e\") " pod="openshift-must-gather-5mqzp/must-gather-6769n" Jul 28 12:55:01.395490 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.395483 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd2b9\" (UniqueName: \"kubernetes.io/projected/1b26d35a-b5b5-4928-add9-d5085ab2389e-kube-api-access-fd2b9\") pod \"must-gather-6769n\" (UID: \"1b26d35a-b5b5-4928-add9-d5085ab2389e\") " pod="openshift-must-gather-5mqzp/must-gather-6769n" Jul 28 12:55:01.395756 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.395736 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b26d35a-b5b5-4928-add9-d5085ab2389e-must-gather-output\") pod \"must-gather-6769n\" (UID: \"1b26d35a-b5b5-4928-add9-d5085ab2389e\") " pod="openshift-must-gather-5mqzp/must-gather-6769n" Jul 28 12:55:01.415966 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.415938 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:55:01.435682 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.435656 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd2b9\" (UniqueName: \"kubernetes.io/projected/1b26d35a-b5b5-4928-add9-d5085ab2389e-kube-api-access-fd2b9\") pod \"must-gather-6769n\" (UID: \"1b26d35a-b5b5-4928-add9-d5085ab2389e\") " pod="openshift-must-gather-5mqzp/must-gather-6769n" Jul 28 12:55:01.600741 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.600707 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5mqzp/must-gather-6769n" Jul 28 12:55:01.727933 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.727903 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5mqzp/must-gather-6769n"] Jul 28 12:55:01.730891 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:55:01.730866 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b26d35a_b5b5_4928_add9_d5085ab2389e.slice/crio-2bb74589f15ee76a0aad131bbf38262a10fcee26af384872754338669d58dd47 WatchSource:0}: Error finding container 2bb74589f15ee76a0aad131bbf38262a10fcee26af384872754338669d58dd47: Status 404 returned error can't find the container with id 2bb74589f15ee76a0aad131bbf38262a10fcee26af384872754338669d58dd47 Jul 28 12:55:01.732687 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:01.732671 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 12:55:02.445714 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:02.445676 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mqzp/must-gather-6769n" event={"ID":"1b26d35a-b5b5-4928-add9-d5085ab2389e","Type":"ContainerStarted","Data":"2bb74589f15ee76a0aad131bbf38262a10fcee26af384872754338669d58dd47"} Jul 28 12:55:03.454382 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:03.454338 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mqzp/must-gather-6769n" event={"ID":"1b26d35a-b5b5-4928-add9-d5085ab2389e","Type":"ContainerStarted","Data":"c30840f84787855e5031c1591a866266e85a95a54a49cd365a7e97b5d96a1f6f"} Jul 28 12:55:03.454856 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:03.454401 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mqzp/must-gather-6769n" event={"ID":"1b26d35a-b5b5-4928-add9-d5085ab2389e","Type":"ContainerStarted","Data":"38d22a9823a868b66d15a1747dfb8e120e382f464867a3e911583f2d7622bb6e"} Jul 28 12:55:03.473660 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:03.473612 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5mqzp/must-gather-6769n" podStartSLOduration=1.360657959 podStartE2EDuration="2.473594852s" totalImagesPullingTime="1.112936893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:55:03.472682597 +0000 UTC m=+1207.596918418" watchObservedRunningTime="2026-07-28 12:55:03.473594852 +0000 UTC m=+1207.597830652" Jul 28 12:55:04.399743 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:04.399702 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8mckt_dfcf362b-2f70-4960-9560-109a7b677692/global-pull-secret-syncer/0.log" Jul 28 12:55:04.503773 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:04.503747 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" Jul 28 12:55:04.610709 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:04.610681 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-166.ec2.internal_3a383476bc9f7e9ae2f5ba60fa098087/haproxy/0.log" Jul 28 12:55:07.060679 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:07.060641 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:55:07.142864 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:07.142824 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:55:07.818085 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:07.818032 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:55:08.982041 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:08.982016 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b54df94b4-h8sq5_43e82319-18d9-4123-85a7-66590ba6ece7/authorino/0.log" Jul 28 12:55:09.112769 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:09.112736 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-jqngm_11a9483e-c7d7-496c-b3b5-488015850670/kuadrant-console-plugin/0.log" Jul 28 12:55:10.745114 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:10.744994 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-8jn6l_4f4d5e6a-4f3e-4a58-9217-80d2b71cf7ab/cluster-monitoring-operator/0.log" Jul 28 12:55:10.774966 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:10.774934 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-9ws6t_ab5d40e6-3c8b-4962-ba56-844204bac934/kube-state-metrics/0.log" Jul 28 12:55:10.808154 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:10.808111 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-9ws6t_ab5d40e6-3c8b-4962-ba56-844204bac934/kube-rbac-proxy-main/0.log" Jul 28 12:55:10.836918 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:10.836855 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-9ws6t_ab5d40e6-3c8b-4962-ba56-844204bac934/kube-rbac-proxy-self/0.log" Jul 28 12:55:11.042406 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:11.042331 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7ngqn_6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a/node-exporter/0.log" Jul 28 12:55:11.086500 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:11.086467 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7ngqn_6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a/kube-rbac-proxy/0.log" Jul 28 12:55:11.123210 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:11.123179 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7ngqn_6ea2b2fd-75f5-452b-a8eb-8ed3bc1e809a/init-textfile/0.log" Jul 28 12:55:11.630628 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:11.630579 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-76d9s_af5c3673-59b7-40d9-9877-525c4ec85bbd/prometheus-operator/0.log" Jul 28 12:55:11.664129 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:11.664097 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-76d9s_af5c3673-59b7-40d9-9877-525c4ec85bbd/kube-rbac-proxy/0.log" Jul 28 12:55:11.745575 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:11.745536 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cb88fffbb-5bmdz_eb13db89-e0bd-4d63-86d6-4aef14a0ace4/telemeter-client/0.log" Jul 28 12:55:11.774337 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:11.774309 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cb88fffbb-5bmdz_eb13db89-e0bd-4d63-86d6-4aef14a0ace4/reload/0.log" Jul 28 12:55:11.808109 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:11.808047 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cb88fffbb-5bmdz_eb13db89-e0bd-4d63-86d6-4aef14a0ace4/kube-rbac-proxy/0.log" Jul 28 12:55:13.761265 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:13.761226 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-br7dg_849f14b1-2639-4b88-ad46-49fcb4b0aa04/console-operator/1.log" Jul 28 12:55:13.767552 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:13.767526 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-br7dg_849f14b1-2639-4b88-ad46-49fcb4b0aa04/console-operator/2.log" Jul 28 12:55:14.225084 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.225059 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56559b9dcb-xvdst_d7febf83-4f46-4acd-a516-2898c3589b30/console/0.log" Jul 28 12:55:14.310549 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.310514 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8"] Jul 28 12:55:14.317225 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.317198 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.322948 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.322921 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8"] Jul 28 12:55:14.413851 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.413806 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ee092dc6-886a-4ead-a699-d48c0fabe625-podres\") pod \"perf-node-gather-daemonset-ttks8\" (UID: \"ee092dc6-886a-4ead-a699-d48c0fabe625\") " pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.414039 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.413876 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee092dc6-886a-4ead-a699-d48c0fabe625-sys\") pod \"perf-node-gather-daemonset-ttks8\" (UID: \"ee092dc6-886a-4ead-a699-d48c0fabe625\") " pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.414039 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.413909 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee092dc6-886a-4ead-a699-d48c0fabe625-lib-modules\") pod \"perf-node-gather-daemonset-ttks8\" (UID: \"ee092dc6-886a-4ead-a699-d48c0fabe625\") " pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.414039 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.413948 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ee092dc6-886a-4ead-a699-d48c0fabe625-proc\") pod \"perf-node-gather-daemonset-ttks8\" (UID: \"ee092dc6-886a-4ead-a699-d48c0fabe625\") " pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.414039 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.414007 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fqkg\" (UniqueName: \"kubernetes.io/projected/ee092dc6-886a-4ead-a699-d48c0fabe625-kube-api-access-5fqkg\") pod \"perf-node-gather-daemonset-ttks8\" (UID: \"ee092dc6-886a-4ead-a699-d48c0fabe625\") " pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.514976 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.514895 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ee092dc6-886a-4ead-a699-d48c0fabe625-podres\") pod \"perf-node-gather-daemonset-ttks8\" (UID: \"ee092dc6-886a-4ead-a699-d48c0fabe625\") " pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.514976 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.514945 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee092dc6-886a-4ead-a699-d48c0fabe625-sys\") pod \"perf-node-gather-daemonset-ttks8\" (UID: \"ee092dc6-886a-4ead-a699-d48c0fabe625\") " pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.514976 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.514971 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee092dc6-886a-4ead-a699-d48c0fabe625-lib-modules\") pod \"perf-node-gather-daemonset-ttks8\" (UID: \"ee092dc6-886a-4ead-a699-d48c0fabe625\") " pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.515258 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.515003 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ee092dc6-886a-4ead-a699-d48c0fabe625-proc\") pod \"perf-node-gather-daemonset-ttks8\" (UID: \"ee092dc6-886a-4ead-a699-d48c0fabe625\") " pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.515258 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.515052 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fqkg\" (UniqueName: \"kubernetes.io/projected/ee092dc6-886a-4ead-a699-d48c0fabe625-kube-api-access-5fqkg\") pod \"perf-node-gather-daemonset-ttks8\" (UID: \"ee092dc6-886a-4ead-a699-d48c0fabe625\") " pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.515258 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.515078 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ee092dc6-886a-4ead-a699-d48c0fabe625-podres\") pod \"perf-node-gather-daemonset-ttks8\" (UID: \"ee092dc6-886a-4ead-a699-d48c0fabe625\") " pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.515258 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.515103 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee092dc6-886a-4ead-a699-d48c0fabe625-sys\") pod \"perf-node-gather-daemonset-ttks8\" (UID: \"ee092dc6-886a-4ead-a699-d48c0fabe625\") " pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.515258 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.515117 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ee092dc6-886a-4ead-a699-d48c0fabe625-proc\") pod \"perf-node-gather-daemonset-ttks8\" (UID: \"ee092dc6-886a-4ead-a699-d48c0fabe625\") " pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.515258 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.515174 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee092dc6-886a-4ead-a699-d48c0fabe625-lib-modules\") pod \"perf-node-gather-daemonset-ttks8\" (UID: \"ee092dc6-886a-4ead-a699-d48c0fabe625\") " pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.525190 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.525161 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fqkg\" (UniqueName: \"kubernetes.io/projected/ee092dc6-886a-4ead-a699-d48c0fabe625-kube-api-access-5fqkg\") pod \"perf-node-gather-daemonset-ttks8\" (UID: \"ee092dc6-886a-4ead-a699-d48c0fabe625\") " pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.633172 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.632905 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:14.802098 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:14.802009 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8"] Jul 28 12:55:14.808502 ip-10-0-137-166 kubenswrapper[2557]: W0728 12:55:14.808460 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podee092dc6_886a_4ead_a699_d48c0fabe625.slice/crio-68d3d1142da8fb229c3cc242c885484c2c5e93b80338701c8e2be518ec9f5f8e WatchSource:0}: Error finding container 68d3d1142da8fb229c3cc242c885484c2c5e93b80338701c8e2be518ec9f5f8e: Status 404 returned error can't find the container with id 68d3d1142da8fb229c3cc242c885484c2c5e93b80338701c8e2be518ec9f5f8e Jul 28 12:55:15.532606 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:15.532566 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" event={"ID":"ee092dc6-886a-4ead-a699-d48c0fabe625","Type":"ContainerStarted","Data":"569bf1dbab42def52f082a07be8ddbd716e5b510bf3b085961dfbf7a2b24a4dd"} Jul 28 12:55:15.532955 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:15.532637 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" event={"ID":"ee092dc6-886a-4ead-a699-d48c0fabe625","Type":"ContainerStarted","Data":"68d3d1142da8fb229c3cc242c885484c2c5e93b80338701c8e2be518ec9f5f8e"} Jul 28 12:55:15.532955 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:15.532667 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:15.550352 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:15.550297 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" podStartSLOduration=1.550275939 podStartE2EDuration="1.550275939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:55:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:55:15.548465051 +0000 UTC m=+1219.672700853" watchObservedRunningTime="2026-07-28 12:55:15.550275939 +0000 UTC m=+1219.674511741" Jul 28 12:55:16.068378 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:16.068351 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xhn6f_79e554ec-3cf9-47c2-8c82-2dde86d3c221/dns/0.log" Jul 28 12:55:16.095847 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:16.095823 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xhn6f_79e554ec-3cf9-47c2-8c82-2dde86d3c221/kube-rbac-proxy/0.log" Jul 28 12:55:16.180916 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:16.180884 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v5n5n_6f6a422f-12a3-4a38-a815-885197adc8a3/dns-node-resolver/0.log" Jul 28 12:55:16.846611 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:16.846578 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xj4pd_bf30b692-7b37-45ee-8a67-262a2bdab3f3/node-ca/0.log" Jul 28 12:55:17.867978 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:17.867946 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-8699b59bbc-httr2_e0bf6b47-295a-4d23-aa00-76d0394fad73/istio-proxy/0.log" Jul 28 12:55:17.901816 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:17.901785 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56478d6f5-lmml8_54e64e8c-6beb-4e4a-8da8-b7095e0950b4/router/0.log" Jul 28 12:55:18.461566 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:18.461539 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mqm6b_6093022a-8be1-4ba2-94cc-3c2728666b3c/serve-healthcheck-canary/0.log" Jul 28 12:55:19.110230 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:19.110199 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vvd6l_fac8dfed-eb29-45fc-a85d-98a4f5e1ee77/kube-rbac-proxy/0.log" Jul 28 12:55:19.138811 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:19.138784 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vvd6l_fac8dfed-eb29-45fc-a85d-98a4f5e1ee77/exporter/0.log" Jul 28 12:55:19.165446 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:19.165419 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vvd6l_fac8dfed-eb29-45fc-a85d-98a4f5e1ee77/extractor/0.log" Jul 28 12:55:21.551378 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:21.551348 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5mqzp/perf-node-gather-daemonset-ttks8" Jul 28 12:55:22.059176 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:22.059133 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d9f9f6c89-v7ssv_813040be-5fe9-466b-8e90-238cc39f1e06/manager/0.log" Jul 28 12:55:22.824986 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:22.824955 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-zsc9b_3b840bd8-1945-448f-bd75-85f60c2a825c/seaweedfs/0.log" Jul 28 12:55:23.802528 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:23.802486 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-8699b59bbc-httr2_e0bf6b47-295a-4d23-aa00-76d0394fad73/istio-proxy/0.log" Jul 28 12:55:23.823910 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:23.823865 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56478d6f5-lmml8_54e64e8c-6beb-4e4a-8da8-b7095e0950b4/router/0.log" Jul 28 12:55:25.010107 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:25.010069 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-8699b59bbc-httr2_e0bf6b47-295a-4d23-aa00-76d0394fad73/istio-proxy/0.log" Jul 28 12:55:25.030732 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:25.030698 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56478d6f5-lmml8_54e64e8c-6beb-4e4a-8da8-b7095e0950b4/router/0.log" Jul 28 12:55:28.338085 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:28.338043 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dw2z4_fdbcffaa-ec9f-46a9-a13e-32f47a57ebf1/konnectivity-agent/0.log" limit=1024 Jul 28 12:55:30.111983 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:30.111947 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hctxj_62215987-8385-4369-9a68-78c84e1f1266/kube-multus-additional-cni-plugins/0.log" Jul 28 12:55:30.142777 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:30.142749 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hctxj_62215987-8385-4369-9a68-78c84e1f1266/egress-router-binary-copy/0.log" Jul 28 12:55:30.169324 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:30.169299 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hctxj_62215987-8385-4369-9a68-78c84e1f1266/cni-plugins/0.log" Jul 28 12:55:30.197070 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:30.197042 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hctxj_62215987-8385-4369-9a68-78c84e1f1266/bond-cni-plugin/0.log" Jul 28 12:55:30.222154 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:30.222112 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hctxj_62215987-8385-4369-9a68-78c84e1f1266/routeoverride-cni/0.log" Jul 28 12:55:30.247853 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:30.247830 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hctxj_62215987-8385-4369-9a68-78c84e1f1266/whereabouts-cni-bincopy/0.log" Jul 28 12:55:30.275650 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:30.275624 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hctxj_62215987-8385-4369-9a68-78c84e1f1266/whereabouts-cni/0.log" Jul 28 12:55:30.573012 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:30.572934 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zsgg5_01cceaff-a5df-4586-b5d6-dc036823143a/kube-multus/0.log" Jul 28 12:55:30.727256 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:30.727226 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z2bvn_402ce15c-b3be-428c-99b3-20384ca207fb/network-metrics-daemon/0.log" Jul 28 12:55:30.753216 ip-10-0-137-166 kubenswrapper[2557]: I0728 12:55:30.753187 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z2bvn_402ce15c-b3be-428c-99b3-20384ca207fb/kube-rbac-proxy/0.log"