Sep 15 17:29:12.397158 ip-10-0-141-84 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 15 17:29:12.397173 ip-10-0-141-84 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 15 17:29:12.397184 ip-10-0-141-84 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 15 17:29:12.397429 ip-10-0-141-84 systemd[1]: Failed to start Kubernetes Kubelet. Sep 15 17:29:22.557689 ip-10-0-141-84 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 15 17:29:22.557707 ip-10-0-141-84 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f4ccf52f889a4e90b1816486d1cb9432 -- Sep 15 17:31:17.177410 ip-10-0-141-84 systemd[1]: Starting Kubernetes Kubelet... Sep 15 17:31:17.495557 ip-10-0-141-84 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 17:31:17.495557 ip-10-0-141-84 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 15 17:31:17.495557 ip-10-0-141-84 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 17:31:17.495557 ip-10-0-141-84 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 15 17:31:17.495557 ip-10-0-141-84 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 17:31:17.496413 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.496320 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 15 17:31:17.499688 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499670 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 17:31:17.499688 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499688 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499693 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499697 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499700 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499703 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499706 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499711 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499715 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499718 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499722 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499724 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499727 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499735 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499738 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499741 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499744 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499747 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499750 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499752 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499755 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 17:31:17.499753 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499758 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499761 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499764 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499766 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499769 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499772 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499774 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499777 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499779 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499783 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499785 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499788 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499790 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499793 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499795 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499798 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499801 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499803 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499806 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499809 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 17:31:17.500268 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499811 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499814 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499817 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499819 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499821 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499824 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499826 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499829 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499831 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499835 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499838 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499841 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499843 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499847 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499850 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499853 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499855 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499858 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499861 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 17:31:17.500754 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499863 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499866 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499869 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499871 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499874 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499877 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499879 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499883 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499885 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499888 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499891 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499894 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499896 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499899 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499902 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499906 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499909 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499912 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499915 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499918 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 17:31:17.501240 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499920 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499923 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499925 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499928 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499930 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499933 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499935 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499939 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499942 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499945 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499948 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499950 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499953 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499956 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499958 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499961 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499963 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499966 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.499968 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 17:31:17.501731 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500759 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500767 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500770 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500774 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500777 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500781 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500784 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500787 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500789 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500792 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500794 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500797 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500799 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500802 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500805 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500809 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500813 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500816 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500818 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 17:31:17.502235 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500821 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500824 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500827 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500831 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500833 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500836 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500839 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500841 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500844 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500846 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500849 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500852 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500854 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500857 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500859 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500862 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500864 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500867 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500869 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500874 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 17:31:17.502746 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500876 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500879 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500882 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500885 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500889 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500893 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500896 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500898 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500901 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500903 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500906 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500908 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500911 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500914 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500917 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500919 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500922 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500924 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500927 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 17:31:17.503261 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500930 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500933 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500935 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500938 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500941 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500944 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500948 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500950 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500953 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500955 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500958 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500961 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500964 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500967 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500970 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500973 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500975 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500978 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500980 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500983 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 17:31:17.503764 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500985 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500988 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500990 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500994 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500997 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.500999 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501002 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501004 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501007 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501009 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501012 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501015 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501017 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501020 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501023 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501025 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501028 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501030 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501033 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501035 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 17:31:17.504284 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501038 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501433 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501439 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501442 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501444 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501447 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501450 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501453 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501455 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501458 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501460 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501463 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501466 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501468 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501471 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501473 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501475 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501478 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501484 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501486 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 17:31:17.504770 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501490 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501494 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501496 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501499 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501502 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501505 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501507 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501510 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501512 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501515 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501518 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501520 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501523 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501526 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501528 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501531 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501534 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501537 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501540 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501542 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 17:31:17.505291 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501545 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501547 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501550 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501552 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501555 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501557 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501559 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501562 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501564 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501567 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501571 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501575 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501579 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501582 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501585 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501589 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501592 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501595 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501598 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 17:31:17.505800 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501600 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501603 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501605 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501608 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501610 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501612 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501617 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501619 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501622 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501624 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501627 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501629 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501632 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501635 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501637 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501640 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501642 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501645 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501647 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501650 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 17:31:17.506299 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501652 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501655 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501657 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501661 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501664 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501666 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501669 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501673 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501677 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501679 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501682 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501684 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501687 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501690 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501692 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501695 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501697 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501700 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501705 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 17:31:17.506794 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501707 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.501710 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501804 2581 flags.go:64] FLAG: --address="0.0.0.0" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501837 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501843 2581 flags.go:64] FLAG: --anonymous-auth="true" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501848 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501853 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501857 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501861 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501866 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501869 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501872 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501875 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501879 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501882 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501885 2581 flags.go:64] FLAG: --cgroup-root="" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501890 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501893 2581 flags.go:64] FLAG: --client-ca-file="" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501896 2581 flags.go:64] FLAG: --cloud-provider="external" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501899 2581 flags.go:64] FLAG: --cluster-dns="[]" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501903 2581 flags.go:64] FLAG: --cluster-domain="" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501906 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501909 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501912 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 15 17:31:17.507271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501916 2581 flags.go:64] FLAG: --container-log-max-files="5" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501920 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501923 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501926 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501930 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501933 2581 flags.go:64] FLAG: --contention-profiling="false" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501936 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501941 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501944 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501947 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501951 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501954 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501957 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501960 2581 flags.go:64] FLAG: --enable-load-reader="false" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501963 2581 flags.go:64] FLAG: --enable-server="true" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501967 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501971 2581 flags.go:64] FLAG: --event-burst="100" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501974 2581 flags.go:64] FLAG: --event-qps="50" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501977 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501980 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501983 2581 flags.go:64] FLAG: --eviction-hard="" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501987 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501990 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501993 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.501997 2581 flags.go:64] FLAG: --eviction-soft="" Sep 15 17:31:17.507855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502000 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502003 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502006 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502009 2581 flags.go:64] FLAG: --experimental-mounter-path="" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502012 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502015 2581 flags.go:64] FLAG: --fail-swap-on="true" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502018 2581 flags.go:64] FLAG: --feature-gates="" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502022 2581 flags.go:64] FLAG: --file-check-frequency="20s" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502025 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502028 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502032 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502035 2581 flags.go:64] FLAG: --healthz-port="10248" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502038 2581 flags.go:64] FLAG: --help="false" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502041 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-141-84.ec2.internal" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502045 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502049 2581 flags.go:64] FLAG: --http-check-frequency="20s" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502052 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502055 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502059 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502062 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502065 2581 flags.go:64] FLAG: --image-service-endpoint="" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502067 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502070 2581 flags.go:64] FLAG: --kube-api-burst="100" Sep 15 17:31:17.508478 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502074 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502077 2581 flags.go:64] FLAG: --kube-api-qps="50" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502094 2581 flags.go:64] FLAG: --kube-reserved="" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502097 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502100 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502103 2581 flags.go:64] FLAG: --kubelet-cgroups="" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502106 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502109 2581 flags.go:64] FLAG: --lock-file="" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502113 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502116 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502119 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502125 2581 flags.go:64] FLAG: --log-json-split-stream="false" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502128 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502131 2581 flags.go:64] FLAG: --log-text-split-stream="false" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502134 2581 flags.go:64] FLAG: --logging-format="text" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502137 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502141 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502143 2581 flags.go:64] FLAG: --manifest-url="" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502147 2581 flags.go:64] FLAG: --manifest-url-header="" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502151 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502154 2581 flags.go:64] FLAG: --max-open-files="1000000" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502159 2581 flags.go:64] FLAG: --max-pods="110" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502162 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502166 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502169 2581 flags.go:64] FLAG: --memory-manager-policy="None" Sep 15 17:31:17.509229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502172 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502175 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502178 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502181 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502189 2581 flags.go:64] FLAG: --node-status-max-images="50" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502192 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502195 2581 flags.go:64] FLAG: --oom-score-adj="-999" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502198 2581 flags.go:64] FLAG: --pod-cidr="" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502202 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502208 2581 flags.go:64] FLAG: --pod-manifest-path="" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502210 2581 flags.go:64] FLAG: --pod-max-pids="-1" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502214 2581 flags.go:64] FLAG: --pods-per-core="0" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502216 2581 flags.go:64] FLAG: --port="10250" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502219 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502222 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ec393ceb0b79a838" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502225 2581 flags.go:64] FLAG: --qos-reserved="" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502230 2581 flags.go:64] FLAG: --read-only-port="10255" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502233 2581 flags.go:64] FLAG: --register-node="true" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502236 2581 flags.go:64] FLAG: --register-with-taints="" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502240 2581 flags.go:64] FLAG: --registry-burst="10" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502243 2581 flags.go:64] FLAG: --registry-qps="5" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502246 2581 flags.go:64] FLAG: --reserved-cpus="" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502249 2581 flags.go:64] FLAG: --reserved-memory="" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502253 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502256 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 15 17:31:17.509853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502259 2581 flags.go:64] FLAG: --rotate-certificates="false" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502262 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502265 2581 flags.go:64] FLAG: --runonce="false" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502268 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502271 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502275 2581 flags.go:64] FLAG: --seccomp-default="false" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502278 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502281 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502284 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502287 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502290 2581 flags.go:64] FLAG: --storage-driver-password="root" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502293 2581 flags.go:64] FLAG: --storage-driver-secure="false" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502296 2581 flags.go:64] FLAG: --storage-driver-table="stats" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502299 2581 flags.go:64] FLAG: --storage-driver-user="root" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502302 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502305 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502308 2581 flags.go:64] FLAG: --system-cgroups="" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502311 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502316 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502319 2581 flags.go:64] FLAG: --tls-cert-file="" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502322 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502326 2581 flags.go:64] FLAG: --tls-min-version="" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502329 2581 flags.go:64] FLAG: --tls-private-key-file="" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502334 2581 flags.go:64] FLAG: --topology-manager-policy="none" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502337 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 15 17:31:17.510495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502340 2581 flags.go:64] FLAG: --topology-manager-scope="container" Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502343 2581 flags.go:64] FLAG: --v="2" Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502347 2581 flags.go:64] FLAG: --version="false" Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502351 2581 flags.go:64] FLAG: --vmodule="" Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502355 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.502358 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502481 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502486 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502490 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502493 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502497 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502501 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502505 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502508 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502511 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502513 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502516 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502519 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502522 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502524 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 17:31:17.511110 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502527 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502530 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502533 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502535 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502538 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502541 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502543 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502546 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502549 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502551 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502555 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502557 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502560 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502563 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502565 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502568 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502571 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502573 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502576 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502579 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 17:31:17.511630 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502581 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502584 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502586 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502589 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502593 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502595 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502598 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502600 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502604 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502607 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502610 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502613 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502616 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502618 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502621 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502624 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502627 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502630 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502633 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502635 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 17:31:17.512186 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502638 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502641 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502644 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502647 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502649 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502652 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502655 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502657 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502660 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502663 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502665 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502668 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502670 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502673 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502676 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502678 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502682 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502685 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502687 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502690 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 17:31:17.512679 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502692 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502695 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502698 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502700 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502703 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502705 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502708 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502711 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502713 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502716 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502719 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502721 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502724 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502726 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502730 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502733 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502735 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502738 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502741 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502743 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 17:31:17.513289 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502746 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 17:31:17.513789 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502748 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 17:31:17.513789 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502751 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 17:31:17.513789 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502754 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 17:31:17.513789 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.502757 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 17:31:17.513789 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.503211 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 17:31:17.513789 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.509987 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 15 17:31:17.513789 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.510005 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 15 17:31:17.513789 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.510576 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 15 17:31:17.513789 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.510584 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 15 17:31:17.513789 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510642 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 17:31:17.513789 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510648 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 17:31:17.513789 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510652 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 17:31:17.513789 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510655 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 17:31:17.513789 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510658 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510660 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510663 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510666 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510668 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510672 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510675 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510677 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510680 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510683 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510685 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510688 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510691 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510693 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510696 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510698 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510701 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510703 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510706 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 17:31:17.514171 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510709 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510712 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510714 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510717 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510720 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510722 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510726 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510729 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510732 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510735 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510738 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510740 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510743 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510745 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510748 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510750 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510753 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510756 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510758 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510761 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 17:31:17.514637 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510764 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510766 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510768 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510771 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510775 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510779 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510782 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510785 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510788 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510790 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510794 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510797 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510799 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510802 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510805 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510808 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510810 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510814 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510817 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510820 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 17:31:17.515150 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510823 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510826 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510828 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510831 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510833 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510836 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510838 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510841 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510843 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510846 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510849 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510852 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510854 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510856 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510860 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510864 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510867 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510870 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510872 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 17:31:17.515674 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510875 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 17:31:17.516180 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510877 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 17:31:17.516180 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510880 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 17:31:17.516180 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510883 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 17:31:17.516180 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510886 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 15 17:31:17.516180 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510890 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 17:31:17.516180 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510894 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 17:31:17.516180 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510897 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 17:31:17.516180 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510899 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 17:31:17.516180 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510902 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 17:31:17.516180 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510905 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 17:31:17.516180 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510907 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 17:31:17.516180 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510910 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 17:31:17.516180 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510913 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 17:31:17.516180 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510916 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 17:31:17.516180 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510918 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 17:31:17.516180 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.510921 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 17:31:17.516629 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.510926 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 17:31:17.516629 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511059 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 17:31:17.516629 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511064 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 17:31:17.516629 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511068 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 17:31:17.516629 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511071 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 17:31:17.516629 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511074 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 17:31:17.516629 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511077 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 17:31:17.516629 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511093 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 17:31:17.516629 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511096 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 17:31:17.516629 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511099 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 17:31:17.516629 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511102 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 17:31:17.516629 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511105 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 17:31:17.516629 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511107 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 17:31:17.516629 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511111 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 17:31:17.516629 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511113 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511117 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511120 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511122 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511125 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511128 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511130 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511133 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511136 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511138 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511141 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511145 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511148 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511150 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511153 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511157 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511159 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511162 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511165 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 17:31:17.517037 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511168 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511171 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511174 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511176 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511179 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511181 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511184 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511187 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511189 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511192 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511196 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511200 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511203 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511206 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511209 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511211 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511214 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511217 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511220 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 17:31:17.517564 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511224 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511227 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511230 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511233 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511236 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511238 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511242 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511245 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511247 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511250 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511253 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511256 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511259 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511261 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511264 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511266 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511269 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511272 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511274 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511277 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 17:31:17.518026 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511279 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511282 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511284 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511287 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511289 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511292 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511294 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511297 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511299 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511302 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511304 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511308 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511311 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511314 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511316 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511319 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511321 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511323 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511327 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511329 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 17:31:17.518573 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511331 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 17:31:17.519105 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511334 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 17:31:17.519105 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511336 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 17:31:17.519105 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511340 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 17:31:17.519105 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511342 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 17:31:17.519105 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511345 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 17:31:17.519105 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511347 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 17:31:17.519105 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:17.511350 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 17:31:17.519105 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.511355 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 17:31:17.519105 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.511480 2581 server.go:962] "Client rotation is on, will bootstrap in background" Sep 15 17:31:17.519105 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.515441 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 15 17:31:17.519105 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.516184 2581 server.go:1019] "Starting client certificate rotation" Sep 15 17:31:17.519105 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.516287 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 15 17:31:17.519105 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.516351 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 15 17:31:17.519105 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.518332 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 15 17:31:17.523562 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.523538 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 15 17:31:17.529464 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.529447 2581 log.go:25] "Validated CRI v1 runtime API" Sep 15 17:31:17.531962 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.531942 2581 log.go:25] "Validated CRI v1 image API" Sep 15 17:31:17.535645 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.535626 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 15 17:31:17.538170 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.538142 2581 fs.go:135] Filesystem UUIDs: map[619f6c82-44a4-4045-9e62-f87728684a82:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9ce042ae-f8a0-45dd-84e6-16ce88ec7d03:/dev/nvme0n1p4] Sep 15 17:31:17.538241 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.538168 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 15 17:31:17.543235 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.543125 2581 manager.go:216] Machine: {Timestamp:2026-09-15 17:31:17.542020361 +0000 UTC m=+0.266838643 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099782 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22d017ddc9a4c9db033c11bf8e669f SystemUUID:ec22d017-ddc9-a4c9-db03-3c11bf8e669f BootID:f4ccf52f-889a-4e90-b181-6486d1cb9432 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d7:f0:ca:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d7:f0:ca:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:6e:4a:5a:7b:71 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 15 17:31:17.543235 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.543228 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 15 17:31:17.543341 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.543316 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 15 17:31:17.544803 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.544771 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 15 17:31:17.544949 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.544804 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-84.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 15 17:31:17.545390 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.545379 2581 topology_manager.go:138] "Creating topology manager with none policy" Sep 15 17:31:17.545422 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.545393 2581 container_manager_linux.go:309] "Creating device plugin manager" Sep 15 17:31:17.545422 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.545400 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 15 17:31:17.545422 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.545415 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 15 17:31:17.545674 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.545656 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 15 17:31:17.546244 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.546232 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 15 17:31:17.549949 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.549937 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 15 17:31:17.550064 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.550055 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 15 17:31:17.550117 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.550098 2581 kubelet.go:486] "Attempting to sync node with API server" Sep 15 17:31:17.550117 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.550109 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 15 17:31:17.550176 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.550124 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 15 17:31:17.550176 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.550134 2581 kubelet.go:398] "Adding apiserver pod source" Sep 15 17:31:17.550176 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.550143 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 15 17:31:17.550548 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.550536 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 15 17:31:17.550582 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.550555 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 15 17:31:17.553097 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.553066 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 15 17:31:17.555227 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.555213 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 15 17:31:17.555621 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.555605 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 15 17:31:17.557728 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.557712 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 15 17:31:17.557728 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.557732 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 15 17:31:17.557845 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.557738 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 15 17:31:17.557845 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.557744 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 15 17:31:17.557845 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.557753 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 15 17:31:17.557845 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.557762 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 15 17:31:17.557845 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.557778 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 15 17:31:17.557845 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.557785 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 15 17:31:17.557845 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.557792 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 15 17:31:17.557845 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.557797 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 15 17:31:17.557845 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.557806 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 15 17:31:17.557845 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.557812 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 15 17:31:17.557845 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.557836 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 15 17:31:17.557845 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.557841 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 15 17:31:17.561523 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.561499 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 15 17:31:17.561523 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.561502 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 15 17:31:17.561631 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.561525 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-84.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 15 17:31:17.561761 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.561750 2581 server.go:1268] "Started kubelet" Sep 15 17:31:17.561836 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.561802 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 15 17:31:17.561972 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.561843 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 15 17:31:17.561972 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.561903 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 15 17:31:17.562805 ip-10-0-141-84 systemd[1]: Started Kubernetes Kubelet. Sep 15 17:31:17.563800 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.563724 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 15 17:31:17.564757 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.564743 2581 server.go:310] "Adding debug handlers to kubelet server" Sep 15 17:31:17.567787 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.566726 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-84.ec2.internal.18d58ed631f1eafb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-84.ec2.internal,UID:ip-10-0-141-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-84.ec2.internal,},FirstTimestamp:2026-09-15 17:31:17.561723643 +0000 UTC m=+0.286541925,LastTimestamp:2026-09-15 17:31:17.561723643 +0000 UTC m=+0.286541925,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-84.ec2.internal,}" Sep 15 17:31:17.568468 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.568449 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 15 17:31:17.568554 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.568505 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 15 17:31:17.568903 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.568884 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 15 17:31:17.569022 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.569001 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-84.ec2.internal\" not found" Sep 15 17:31:17.569465 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.569447 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 15 17:31:17.569465 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.569449 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 15 17:31:17.569615 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.569478 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 15 17:31:17.569615 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.569547 2581 reconstruct.go:97] "Volume reconstruction finished" Sep 15 17:31:17.569615 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.569556 2581 reconciler.go:29] "Reconciler: start to sync state" Sep 15 17:31:17.569757 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.569735 2581 factory.go:55] Registering systemd factory Sep 15 17:31:17.569757 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.569752 2581 factory.go:223] Registration of the systemd container factory successfully Sep 15 17:31:17.569982 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.569966 2581 factory.go:153] Registering CRI-O factory Sep 15 17:31:17.570054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.569985 2581 factory.go:223] Registration of the crio container factory successfully Sep 15 17:31:17.570054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.570032 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 15 17:31:17.570054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.570049 2581 factory.go:103] Registering Raw factory Sep 15 17:31:17.570191 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.570063 2581 manager.go:1196] Started watching for new ooms in manager Sep 15 17:31:17.570486 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.570474 2581 manager.go:349] Starting recovery of all containers Sep 15 17:31:17.576191 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.576161 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 15 17:31:17.576191 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.576170 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 15 17:31:17.584235 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.584023 2581 manager.go:354] Recovery completed Sep 15 17:31:17.589911 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.589896 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 17:31:17.591953 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.591936 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasSufficientMemory" Sep 15 17:31:17.592025 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.591967 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 17:31:17.592025 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.591977 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasSufficientPID" Sep 15 17:31:17.592586 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.592568 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 15 17:31:17.592586 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.592583 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 15 17:31:17.592690 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.592600 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 15 17:31:17.592690 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.592574 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 17:31:17.593434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.593389 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasSufficientMemory" Sep 15 17:31:17.593434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.593413 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 17:31:17.593434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.593424 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasSufficientPID" Sep 15 17:31:17.594066 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.593991 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-84.ec2.internal.18d58ed633bf3105 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-84.ec2.internal,UID:ip-10-0-141-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-84.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-84.ec2.internal,},FirstTimestamp:2026-09-15 17:31:17.591953669 +0000 UTC m=+0.316771950,LastTimestamp:2026-09-15 17:31:17.591953669 +0000 UTC m=+0.316771950,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-84.ec2.internal,}" Sep 15 17:31:17.594835 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.594819 2581 policy_none.go:49] "None policy: Start" Sep 15 17:31:17.594835 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.594838 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 15 17:31:17.594931 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.594848 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 15 17:31:17.596836 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.596823 2581 policy_none.go:47] "Start" Sep 15 17:31:17.603123 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.603036 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-84.ec2.internal.18d58ed633bf7996 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-84.ec2.internal,UID:ip-10-0-141-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-84.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-84.ec2.internal,},FirstTimestamp:2026-09-15 17:31:17.591972246 +0000 UTC m=+0.316790528,LastTimestamp:2026-09-15 17:31:17.591972246 +0000 UTC m=+0.316790528,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-84.ec2.internal,}" Sep 15 17:31:17.610743 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.610671 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-84.ec2.internal.18d58ed633bf9f0e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-84.ec2.internal,UID:ip-10-0-141-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-84.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-84.ec2.internal,},FirstTimestamp:2026-09-15 17:31:17.591981838 +0000 UTC m=+0.316800119,LastTimestamp:2026-09-15 17:31:17.591981838 +0000 UTC m=+0.316800119,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-84.ec2.internal,}" Sep 15 17:31:17.641328 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.619383 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-84.ec2.internal.18d58ed633bf3105\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-84.ec2.internal.18d58ed633bf3105 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-84.ec2.internal,UID:ip-10-0-141-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-84.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-84.ec2.internal,},FirstTimestamp:2026-09-15 17:31:17.591953669 +0000 UTC m=+0.316771950,LastTimestamp:2026-09-15 17:31:17.593402078 +0000 UTC m=+0.318220360,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-84.ec2.internal,}" Sep 15 17:31:17.641328 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.627077 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-84.ec2.internal.18d58ed633bf7996\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-84.ec2.internal.18d58ed633bf7996 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-84.ec2.internal,UID:ip-10-0-141-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-84.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-84.ec2.internal,},FirstTimestamp:2026-09-15 17:31:17.591972246 +0000 UTC m=+0.316790528,LastTimestamp:2026-09-15 17:31:17.593418022 +0000 UTC m=+0.318236305,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-84.ec2.internal,}" Sep 15 17:31:17.641328 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.628789 2581 manager.go:337] "Starting Device Plugin manager" Sep 15 17:31:17.641328 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.628837 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 15 17:31:17.641328 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.628847 2581 server.go:87] "Starting device plugin registration server" Sep 15 17:31:17.641328 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.629228 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 15 17:31:17.641328 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.629240 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 15 17:31:17.641328 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.630096 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 15 17:31:17.641328 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.630151 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-84.ec2.internal\" not found" Sep 15 17:31:17.641328 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.631534 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 15 17:31:17.641328 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.631651 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 15 17:31:17.641328 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.631660 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 15 17:31:17.641328 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.632489 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ggbvk" Sep 15 17:31:17.641328 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.635833 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-84.ec2.internal.18d58ed633bf9f0e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-84.ec2.internal.18d58ed633bf9f0e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-84.ec2.internal,UID:ip-10-0-141-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-84.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-84.ec2.internal,},FirstTimestamp:2026-09-15 17:31:17.591981838 +0000 UTC m=+0.316800119,LastTimestamp:2026-09-15 17:31:17.593427589 +0000 UTC m=+0.318245870,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-84.ec2.internal,}" Sep 15 17:31:17.641328 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.639477 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ggbvk" Sep 15 17:31:17.729778 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.729757 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 17:31:17.731076 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.731054 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasSufficientMemory" Sep 15 17:31:17.731208 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.731106 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 17:31:17.731208 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.731120 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasSufficientPID" Sep 15 17:31:17.731208 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.731147 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-84.ec2.internal" Sep 15 17:31:17.739574 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.739547 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-84.ec2.internal" Sep 15 17:31:17.739574 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.739575 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-84.ec2.internal\": node \"ip-10-0-141-84.ec2.internal\" not found" Sep 15 17:31:17.744353 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.744328 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 15 17:31:17.745520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.745498 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 15 17:31:17.745632 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.745562 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 15 17:31:17.745632 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.745591 2581 kubelet.go:2448] "Starting kubelet main sync loop" Sep 15 17:31:17.745736 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.745643 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 15 17:31:17.748010 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.747986 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 17:31:17.771845 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.771818 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-84.ec2.internal\" not found" Sep 15 17:31:17.846510 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.846475 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-84.ec2.internal"] Sep 15 17:31:17.846688 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.846561 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 17:31:17.848334 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.848314 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasSufficientMemory" Sep 15 17:31:17.848462 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.848352 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 17:31:17.848462 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.848368 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasSufficientPID" Sep 15 17:31:17.850644 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.850630 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 17:31:17.850819 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.850802 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal" Sep 15 17:31:17.850853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.850832 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 17:31:17.851541 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.851524 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasSufficientMemory" Sep 15 17:31:17.851646 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.851550 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 17:31:17.851646 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.851562 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasSufficientPID" Sep 15 17:31:17.851646 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.851583 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasSufficientMemory" Sep 15 17:31:17.851646 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.851603 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 17:31:17.851646 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.851619 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasSufficientPID" Sep 15 17:31:17.853786 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.853769 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-84.ec2.internal" Sep 15 17:31:17.853881 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.853797 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 17:31:17.854658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.854645 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasSufficientMemory" Sep 15 17:31:17.854717 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.854669 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 17:31:17.854717 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.854678 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeHasSufficientPID" Sep 15 17:31:17.871141 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.871114 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a048dfbc799f86a2baabe7fe5ea46cb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal\" (UID: \"4a048dfbc799f86a2baabe7fe5ea46cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal" Sep 15 17:31:17.871259 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.871148 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a048dfbc799f86a2baabe7fe5ea46cb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal\" (UID: \"4a048dfbc799f86a2baabe7fe5ea46cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal" Sep 15 17:31:17.871259 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.871163 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/520fabedc60a64e4fd6648fb59243517-config\") pod \"kube-apiserver-proxy-ip-10-0-141-84.ec2.internal\" (UID: \"520fabedc60a64e4fd6648fb59243517\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-84.ec2.internal" Sep 15 17:31:17.872142 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.872128 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-84.ec2.internal\" not found" Sep 15 17:31:17.876937 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.876914 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-84.ec2.internal\" not found" node="ip-10-0-141-84.ec2.internal" Sep 15 17:31:17.881874 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.881856 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-84.ec2.internal\" not found" node="ip-10-0-141-84.ec2.internal" Sep 15 17:31:17.971979 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.971946 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/520fabedc60a64e4fd6648fb59243517-config\") pod \"kube-apiserver-proxy-ip-10-0-141-84.ec2.internal\" (UID: \"520fabedc60a64e4fd6648fb59243517\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-84.ec2.internal" Sep 15 17:31:17.972158 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.971993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a048dfbc799f86a2baabe7fe5ea46cb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal\" (UID: \"4a048dfbc799f86a2baabe7fe5ea46cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal" Sep 15 17:31:17.972158 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.972012 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a048dfbc799f86a2baabe7fe5ea46cb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal\" (UID: \"4a048dfbc799f86a2baabe7fe5ea46cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal" Sep 15 17:31:17.972158 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.972036 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a048dfbc799f86a2baabe7fe5ea46cb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal\" (UID: \"4a048dfbc799f86a2baabe7fe5ea46cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal" Sep 15 17:31:17.972158 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.971959 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/520fabedc60a64e4fd6648fb59243517-config\") pod \"kube-apiserver-proxy-ip-10-0-141-84.ec2.internal\" (UID: \"520fabedc60a64e4fd6648fb59243517\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-84.ec2.internal" Sep 15 17:31:17.972158 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:17.972106 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a048dfbc799f86a2baabe7fe5ea46cb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal\" (UID: \"4a048dfbc799f86a2baabe7fe5ea46cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal" Sep 15 17:31:17.972989 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:17.972973 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-84.ec2.internal\" not found" Sep 15 17:31:18.073804 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:18.073723 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-84.ec2.internal\" not found" Sep 15 17:31:18.174886 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:18.174857 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-84.ec2.internal\" not found" Sep 15 17:31:18.180452 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.180427 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal" Sep 15 17:31:18.184410 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.184377 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-84.ec2.internal" Sep 15 17:31:18.275878 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:18.275835 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-84.ec2.internal\" not found" Sep 15 17:31:18.376336 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:18.376252 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-84.ec2.internal\" not found" Sep 15 17:31:18.430249 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.430214 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 17:31:18.470063 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.470028 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal" Sep 15 17:31:18.485686 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.485659 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 15 17:31:18.487245 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.487229 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-84.ec2.internal" Sep 15 17:31:18.496728 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.496707 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 15 17:31:18.516843 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.516813 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 15 17:31:18.517019 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.516998 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 15 17:31:18.517084 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.517017 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 15 17:31:18.550418 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.550384 2581 apiserver.go:52] "Watching apiserver" Sep 15 17:31:18.566839 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.566811 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 15 17:31:18.567852 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.567810 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-p9llc","openshift-network-diagnostics/network-check-target-q6n92","openshift-ovn-kubernetes/ovnkube-node-ldm4p","kube-system/global-pull-secret-syncer-88jzz","kube-system/konnectivity-agent-9k6j4","openshift-cluster-node-tuning-operator/tuned-xfjqq","openshift-dns/node-resolver-btdt9","openshift-multus/network-metrics-daemon-k7k2q","openshift-network-operator/iptables-alerter-xwsvh","kube-system/kube-apiserver-proxy-ip-10-0-141-84.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j","openshift-image-registry/node-ca-tncm8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal","openshift-multus/multus-additional-cni-plugins-rb26f"] Sep 15 17:31:18.568627 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.568605 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 15 17:31:18.570683 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.570660 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.573009 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.572987 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:18.573130 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:18.573064 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:18.573231 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.573172 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 15 17:31:18.573231 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.573199 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 15 17:31:18.573231 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.573219 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gdmlm\"" Sep 15 17:31:18.573378 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.573229 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 15 17:31:18.573378 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.573176 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 15 17:31:18.575647 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.575630 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.576084 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.576062 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-var-lib-kubelet\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.576197 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.576110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-multus-socket-dir-parent\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.576197 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.576135 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-run-k8s-cni-cncf-io\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.576197 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.576166 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-run-netns\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.576318 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.576200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2927a04f-4bc9-400e-9afd-5480987c6ebc-multus-daemon-config\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.576318 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.576223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2927a04f-4bc9-400e-9afd-5480987c6ebc-cni-binary-copy\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.576318 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.576263 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-hostroot\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.576318 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.576288 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-run-multus-certs\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.576551 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.576320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-var-lib-cni-bin\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.576551 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.576337 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-system-cni-dir\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.576551 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.576351 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-multus-cni-dir\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.576551 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.576386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-multus-conf-dir\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.576551 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.576414 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-etc-kubernetes\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.576551 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.576432 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-cnibin\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.576551 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.576451 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-var-lib-cni-multus\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.576551 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.576492 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnbvq\" (UniqueName: \"kubernetes.io/projected/2927a04f-4bc9-400e-9afd-5480987c6ebc-kube-api-access-mnbvq\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.578181 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.578164 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:18.578266 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:18.578245 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:18.579709 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.579686 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 15 17:31:18.579777 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.579688 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 15 17:31:18.579777 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.579713 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 15 17:31:18.579867 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.579793 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kdzb4\"" Sep 15 17:31:18.580167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.580149 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 15 17:31:18.580237 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.580222 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 15 17:31:18.580318 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.580298 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 15 17:31:18.580519 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.580503 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9k6j4" Sep 15 17:31:18.582893 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.582874 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.583078 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.583006 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 15 17:31:18.583078 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.583047 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 15 17:31:18.583441 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.583428 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qvs2w\"" Sep 15 17:31:18.583683 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.583666 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 15 17:31:18.584997 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.584979 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 15 17:31:18.585366 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.585350 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 15 17:31:18.585444 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.585392 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nvssj\"" Sep 15 17:31:18.585523 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.585505 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-btdt9" Sep 15 17:31:18.587647 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.587619 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 15 17:31:18.587727 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.587702 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 15 17:31:18.587995 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.587978 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f9sbm\"" Sep 15 17:31:18.588060 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.588048 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:18.588153 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:18.588135 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:18.590488 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.590465 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xwsvh" Sep 15 17:31:18.592634 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.592612 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xg467\"" Sep 15 17:31:18.592736 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.592612 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 15 17:31:18.592799 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.592750 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 15 17:31:18.592799 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.592757 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 15 17:31:18.593021 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.593005 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.595128 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.595110 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 15 17:31:18.595492 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.595473 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-trfmp\"" Sep 15 17:31:18.595583 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.595507 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tncm8" Sep 15 17:31:18.595717 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.595697 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 15 17:31:18.595824 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.595804 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 15 17:31:18.598038 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.598020 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.599556 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.599226 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 15 17:31:18.599556 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.599298 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 15 17:31:18.602308 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.602284 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 15 17:31:18.602453 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.602358 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4scwg\"" Sep 15 17:31:18.602637 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.602607 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 15 17:31:18.602722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.602644 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 15 17:31:18.602722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.602709 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hn92b\"" Sep 15 17:31:18.603469 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.603450 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ljtrl" Sep 15 17:31:18.611607 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.611581 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ljtrl" Sep 15 17:31:18.644310 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.644260 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 17:26:17 +0000 UTC" deadline="2028-03-06 15:54:05.865877131 +0000 UTC" Sep 15 17:31:18.644310 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.644304 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12910h22m47.221575199s" Sep 15 17:31:18.670424 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.670402 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 15 17:31:18.676859 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.676830 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-var-lib-kubelet\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.677062 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.676863 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-multus-socket-dir-parent\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.677062 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.676886 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9a4c059e-96cd-4fef-bbce-0aed2fe62900-hosts-file\") pod \"node-resolver-btdt9\" (UID: \"9a4c059e-96cd-4fef-bbce-0aed2fe62900\") " pod="openshift-dns/node-resolver-btdt9" Sep 15 17:31:18.677062 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.676905 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-hostroot\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.677062 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.676926 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-run-netns\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.677062 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.676943 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-run-openvswitch\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.677062 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.676948 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-var-lib-kubelet\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.677062 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.676964 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-multus-socket-dir-parent\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.677062 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.676973 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-hostroot\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.677062 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.676959 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-var-lib-kubelet\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.677062 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677014 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7df6635-4580-4cef-809a-46d2b81cbb5c-host\") pod \"node-ca-tncm8\" (UID: \"a7df6635-4580-4cef-809a-46d2b81cbb5c\") " pod="openshift-image-registry/node-ca-tncm8" Sep 15 17:31:18.677062 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677041 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-sysconfig\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.677062 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-kubernetes\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.677658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677115 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-sysctl-conf\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.677658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/913d5e1b-5e80-4cda-8ceb-600f27b611fe-kubelet-config\") pod \"global-pull-secret-syncer-88jzz\" (UID: \"913d5e1b-5e80-4cda-8ceb-600f27b611fe\") " pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:18.677658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677197 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa4487e8-f742-4a86-9d47-8c4b4a90e76f-agent-certs\") pod \"konnectivity-agent-9k6j4\" (UID: \"fa4487e8-f742-4a86-9d47-8c4b4a90e76f\") " pod="kube-system/konnectivity-agent-9k6j4" Sep 15 17:31:18.677658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs\") pod \"network-metrics-daemon-k7k2q\" (UID: \"dd17968b-99b4-4dcf-afd3-33e5bc160e72\") " pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:18.677658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnbvq\" (UniqueName: \"kubernetes.io/projected/2927a04f-4bc9-400e-9afd-5480987c6ebc-kube-api-access-mnbvq\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.677658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-run\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.677658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677419 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa4487e8-f742-4a86-9d47-8c4b4a90e76f-konnectivity-ca\") pod \"konnectivity-agent-9k6j4\" (UID: \"fa4487e8-f742-4a86-9d47-8c4b4a90e76f\") " pod="kube-system/konnectivity-agent-9k6j4" Sep 15 17:31:18.677658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677455 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76e419fd-5854-4474-a4dd-324785d896bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.677658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2927a04f-4bc9-400e-9afd-5480987c6ebc-multus-daemon-config\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.677658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677523 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5tj5\" (UniqueName: \"kubernetes.io/projected/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-kube-api-access-w5tj5\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.677658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677542 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a4c059e-96cd-4fef-bbce-0aed2fe62900-tmp-dir\") pod \"node-resolver-btdt9\" (UID: \"9a4c059e-96cd-4fef-bbce-0aed2fe62900\") " pod="openshift-dns/node-resolver-btdt9" Sep 15 17:31:18.677658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f7wg\" (UniqueName: \"kubernetes.io/projected/9a4c059e-96cd-4fef-bbce-0aed2fe62900-kube-api-access-8f7wg\") pod \"node-resolver-btdt9\" (UID: \"9a4c059e-96cd-4fef-bbce-0aed2fe62900\") " pod="openshift-dns/node-resolver-btdt9" Sep 15 17:31:18.677658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677596 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz8ns\" (UniqueName: \"kubernetes.io/projected/dd17968b-99b4-4dcf-afd3-33e5bc160e72-kube-api-access-fz8ns\") pod \"network-metrics-daemon-k7k2q\" (UID: \"dd17968b-99b4-4dcf-afd3-33e5bc160e72\") " pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:18.677658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2927a04f-4bc9-400e-9afd-5480987c6ebc-cni-binary-copy\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.677658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677656 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-node-log\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677682 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c127eff-4d31-469d-968e-ec86c46bb4cd-ovn-node-metrics-cert\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677700 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld7g2\" (UniqueName: \"kubernetes.io/projected/4c127eff-4d31-469d-968e-ec86c46bb4cd-kube-api-access-ld7g2\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677768 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-host\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677803 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-tmp\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677849 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-var-lib-cni-bin\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677910 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-var-lib-cni-bin\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677924 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-kubelet\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.677958 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-run-ovn-kubernetes\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678001 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-tuned\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678032 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret\") pod \"global-pull-secret-syncer-88jzz\" (UID: \"913d5e1b-5e80-4cda-8ceb-600f27b611fe\") " pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678053 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76e419fd-5854-4474-a4dd-324785d896bd-cnibin\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678069 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z9pn\" (UniqueName: \"kubernetes.io/projected/0faf1e06-3f08-460a-87db-360f3ef5e233-kube-api-access-8z9pn\") pod \"iptables-alerter-xwsvh\" (UID: \"0faf1e06-3f08-460a-87db-360f3ef5e233\") " pod="openshift-network-operator/iptables-alerter-xwsvh" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678073 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2927a04f-4bc9-400e-9afd-5480987c6ebc-multus-daemon-config\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678108 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-run-k8s-cni-cncf-io\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-run-netns\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.678323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678146 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c127eff-4d31-469d-968e-ec86c46bb4cd-ovnkube-script-lib\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678172 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-run-k8s-cni-cncf-io\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678175 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2927a04f-4bc9-400e-9afd-5480987c6ebc-cni-binary-copy\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-cni-netd\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678222 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-run-netns\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c127eff-4d31-469d-968e-ec86c46bb4cd-ovnkube-config\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678279 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7df6635-4580-4cef-809a-46d2b81cbb5c-serviceca\") pod \"node-ca-tncm8\" (UID: \"a7df6635-4580-4cef-809a-46d2b81cbb5c\") " pod="openshift-image-registry/node-ca-tncm8" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678315 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678347 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-sys-fs\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678371 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlgvf\" (UniqueName: \"kubernetes.io/projected/3103f121-024d-41f9-9f24-d2e0333dae4e-kube-api-access-vlgvf\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678392 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-multus-conf-dir\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678431 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-multus-conf-dir\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678444 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-etc-kubernetes\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678473 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-log-socket\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678499 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-etc-kubernetes\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-device-dir\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76e419fd-5854-4474-a4dd-324785d896bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.679054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678572 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsr9r\" (UniqueName: \"kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r\") pod \"network-check-target-q6n92\" (UID: \"fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b\") " pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:18.679807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678604 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-run-ovn\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.679807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678630 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-cni-bin\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.679807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678653 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-systemd\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.679807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678683 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-sys\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.679807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-lib-modules\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.679807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678731 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/913d5e1b-5e80-4cda-8ceb-600f27b611fe-dbus\") pod \"global-pull-secret-syncer-88jzz\" (UID: \"913d5e1b-5e80-4cda-8ceb-600f27b611fe\") " pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:18.679807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678755 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-registration-dir\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.679807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678782 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-etc-openvswitch\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.679807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678809 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-slash\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.679807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678842 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.679807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678860 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-sysctl-d\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.679807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678874 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-socket-dir\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.679807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678889 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7jrs\" (UniqueName: \"kubernetes.io/projected/76e419fd-5854-4474-a4dd-324785d896bd-kube-api-access-d7jrs\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.679807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-run-multus-certs\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.679807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-systemd-units\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.679807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678948 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-run-multus-certs\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c127eff-4d31-469d-968e-ec86c46bb4cd-env-overrides\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.678995 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0faf1e06-3f08-460a-87db-360f3ef5e233-iptables-alerter-script\") pod \"iptables-alerter-xwsvh\" (UID: \"0faf1e06-3f08-460a-87db-360f3ef5e233\") " pod="openshift-network-operator/iptables-alerter-xwsvh" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.679021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vs7k\" (UniqueName: \"kubernetes.io/projected/a7df6635-4580-4cef-809a-46d2b81cbb5c-kube-api-access-6vs7k\") pod \"node-ca-tncm8\" (UID: \"a7df6635-4580-4cef-809a-46d2b81cbb5c\") " pod="openshift-image-registry/node-ca-tncm8" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.679047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76e419fd-5854-4474-a4dd-324785d896bd-system-cni-dir\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.679073 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-system-cni-dir\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.679120 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-multus-cni-dir\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.679148 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-run-systemd\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.679191 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-var-lib-openvswitch\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.679206 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-multus-cni-dir\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.679219 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-cnibin\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.679245 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-var-lib-cni-multus\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.679271 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-modprobe-d\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.679272 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-system-cni-dir\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.679289 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-cnibin\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.679307 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0faf1e06-3f08-460a-87db-360f3ef5e233-host-slash\") pod \"iptables-alerter-xwsvh\" (UID: \"0faf1e06-3f08-460a-87db-360f3ef5e233\") " pod="openshift-network-operator/iptables-alerter-xwsvh" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.679327 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2927a04f-4bc9-400e-9afd-5480987c6ebc-host-var-lib-cni-multus\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.680434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.679332 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76e419fd-5854-4474-a4dd-324785d896bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.681043 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.679349 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76e419fd-5854-4474-a4dd-324785d896bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.682560 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.682540 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 15 17:31:18.685935 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.685914 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnbvq\" (UniqueName: \"kubernetes.io/projected/2927a04f-4bc9-400e-9afd-5480987c6ebc-kube-api-access-mnbvq\") pod \"multus-p9llc\" (UID: \"2927a04f-4bc9-400e-9afd-5480987c6ebc\") " pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.715870 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.715844 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 17:31:18.760086 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.760054 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 17:31:18.779862 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.779828 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5tj5\" (UniqueName: \"kubernetes.io/projected/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-kube-api-access-w5tj5\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.779862 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.779863 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a4c059e-96cd-4fef-bbce-0aed2fe62900-tmp-dir\") pod \"node-resolver-btdt9\" (UID: \"9a4c059e-96cd-4fef-bbce-0aed2fe62900\") " pod="openshift-dns/node-resolver-btdt9" Sep 15 17:31:18.780077 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.779880 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f7wg\" (UniqueName: \"kubernetes.io/projected/9a4c059e-96cd-4fef-bbce-0aed2fe62900-kube-api-access-8f7wg\") pod \"node-resolver-btdt9\" (UID: \"9a4c059e-96cd-4fef-bbce-0aed2fe62900\") " pod="openshift-dns/node-resolver-btdt9" Sep 15 17:31:18.780077 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.779896 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz8ns\" (UniqueName: \"kubernetes.io/projected/dd17968b-99b4-4dcf-afd3-33e5bc160e72-kube-api-access-fz8ns\") pod \"network-metrics-daemon-k7k2q\" (UID: \"dd17968b-99b4-4dcf-afd3-33e5bc160e72\") " pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:18.780077 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.779918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-node-log\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.780077 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.779942 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c127eff-4d31-469d-968e-ec86c46bb4cd-ovn-node-metrics-cert\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.780077 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.779978 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld7g2\" (UniqueName: \"kubernetes.io/projected/4c127eff-4d31-469d-968e-ec86c46bb4cd-kube-api-access-ld7g2\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.780077 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780003 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-host\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.780077 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780026 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-tmp\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.780077 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780051 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.780077 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-kubelet\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.780558 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.779999 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-node-log\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.780558 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780174 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.780558 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780218 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-run-ovn-kubernetes\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.780558 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780239 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a4c059e-96cd-4fef-bbce-0aed2fe62900-tmp-dir\") pod \"node-resolver-btdt9\" (UID: \"9a4c059e-96cd-4fef-bbce-0aed2fe62900\") " pod="openshift-dns/node-resolver-btdt9" Sep 15 17:31:18.780558 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780270 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-kubelet\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.780558 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780321 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-host\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.780558 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780321 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-run-ovn-kubernetes\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.780558 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780270 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-tuned\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.780558 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780559 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret\") pod \"global-pull-secret-syncer-88jzz\" (UID: \"913d5e1b-5e80-4cda-8ceb-600f27b611fe\") " pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:18.781016 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780590 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76e419fd-5854-4474-a4dd-324785d896bd-cnibin\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.781016 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780642 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76e419fd-5854-4474-a4dd-324785d896bd-cnibin\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.781016 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:18.780664 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 17:31:18.781016 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780713 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z9pn\" (UniqueName: \"kubernetes.io/projected/0faf1e06-3f08-460a-87db-360f3ef5e233-kube-api-access-8z9pn\") pod \"iptables-alerter-xwsvh\" (UID: \"0faf1e06-3f08-460a-87db-360f3ef5e233\") " pod="openshift-network-operator/iptables-alerter-xwsvh" Sep 15 17:31:18.781016 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:18.780737 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret podName:913d5e1b-5e80-4cda-8ceb-600f27b611fe nodeName:}" failed. No retries permitted until 2026-09-15 17:31:19.280718995 +0000 UTC m=+2.005537265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret") pod "global-pull-secret-syncer-88jzz" (UID: "913d5e1b-5e80-4cda-8ceb-600f27b611fe") : object "kube-system"/"original-pull-secret" not registered Sep 15 17:31:18.781016 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780771 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c127eff-4d31-469d-968e-ec86c46bb4cd-ovnkube-script-lib\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.781016 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780798 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-cni-netd\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.781016 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780824 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c127eff-4d31-469d-968e-ec86c46bb4cd-ovnkube-config\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.781016 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7df6635-4580-4cef-809a-46d2b81cbb5c-serviceca\") pod \"node-ca-tncm8\" (UID: \"a7df6635-4580-4cef-809a-46d2b81cbb5c\") " pod="openshift-image-registry/node-ca-tncm8" Sep 15 17:31:18.781016 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.781016 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-sys-fs\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.781016 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780925 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-cni-netd\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.781016 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.780929 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlgvf\" (UniqueName: \"kubernetes.io/projected/3103f121-024d-41f9-9f24-d2e0333dae4e-kube-api-access-vlgvf\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.781657 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781147 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.781657 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781222 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-sys-fs\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.781657 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781477 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c127eff-4d31-469d-968e-ec86c46bb4cd-ovnkube-config\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.781657 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781497 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c127eff-4d31-469d-968e-ec86c46bb4cd-ovnkube-script-lib\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.781657 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781528 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-log-socket\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.781657 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781575 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-log-socket\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.781657 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-device-dir\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.781991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781659 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7df6635-4580-4cef-809a-46d2b81cbb5c-serviceca\") pod \"node-ca-tncm8\" (UID: \"a7df6635-4580-4cef-809a-46d2b81cbb5c\") " pod="openshift-image-registry/node-ca-tncm8" Sep 15 17:31:18.781991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781680 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76e419fd-5854-4474-a4dd-324785d896bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.781991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsr9r\" (UniqueName: \"kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r\") pod \"network-check-target-q6n92\" (UID: \"fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b\") " pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:18.781991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781724 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-device-dir\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.781991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-run-ovn\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.781991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781774 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-run-ovn\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.781991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-cni-bin\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.781991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781835 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-systemd\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.781991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781856 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-sys\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.781991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-lib-modules\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.781991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781889 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/913d5e1b-5e80-4cda-8ceb-600f27b611fe-dbus\") pod \"global-pull-secret-syncer-88jzz\" (UID: \"913d5e1b-5e80-4cda-8ceb-600f27b611fe\") " pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:18.781991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781910 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76e419fd-5854-4474-a4dd-324785d896bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.781991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781946 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-cni-bin\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.781991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781975 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-registration-dir\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.781991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781982 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-systemd\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.781991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.781912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-registration-dir\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-etc-openvswitch\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782021 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-sys\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782039 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-slash\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782058 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/913d5e1b-5e80-4cda-8ceb-600f27b611fe-dbus\") pod \"global-pull-secret-syncer-88jzz\" (UID: \"913d5e1b-5e80-4cda-8ceb-600f27b611fe\") " pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782093 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-etc-openvswitch\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782107 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-lib-modules\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782106 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-sysctl-d\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782144 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-socket-dir\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782150 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-slash\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782122 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782205 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7jrs\" (UniqueName: \"kubernetes.io/projected/76e419fd-5854-4474-a4dd-324785d896bd-kube-api-access-d7jrs\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782230 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-sysctl-d\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782234 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-systemd-units\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782257 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3103f121-024d-41f9-9f24-d2e0333dae4e-socket-dir\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c127eff-4d31-469d-968e-ec86c46bb4cd-env-overrides\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.782804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782264 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-systemd-units\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0faf1e06-3f08-460a-87db-360f3ef5e233-iptables-alerter-script\") pod \"iptables-alerter-xwsvh\" (UID: \"0faf1e06-3f08-460a-87db-360f3ef5e233\") " pod="openshift-network-operator/iptables-alerter-xwsvh" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782350 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vs7k\" (UniqueName: \"kubernetes.io/projected/a7df6635-4580-4cef-809a-46d2b81cbb5c-kube-api-access-6vs7k\") pod \"node-ca-tncm8\" (UID: \"a7df6635-4580-4cef-809a-46d2b81cbb5c\") " pod="openshift-image-registry/node-ca-tncm8" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76e419fd-5854-4474-a4dd-324785d896bd-system-cni-dir\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782407 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-run-systemd\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782432 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-var-lib-openvswitch\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782461 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-modprobe-d\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782466 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76e419fd-5854-4474-a4dd-324785d896bd-system-cni-dir\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782466 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-run-systemd\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782503 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-var-lib-openvswitch\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782535 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0faf1e06-3f08-460a-87db-360f3ef5e233-host-slash\") pod \"iptables-alerter-xwsvh\" (UID: \"0faf1e06-3f08-460a-87db-360f3ef5e233\") " pod="openshift-network-operator/iptables-alerter-xwsvh" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0faf1e06-3f08-460a-87db-360f3ef5e233-host-slash\") pod \"iptables-alerter-xwsvh\" (UID: \"0faf1e06-3f08-460a-87db-360f3ef5e233\") " pod="openshift-network-operator/iptables-alerter-xwsvh" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782562 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-modprobe-d\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782577 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76e419fd-5854-4474-a4dd-324785d896bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76e419fd-5854-4474-a4dd-324785d896bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9a4c059e-96cd-4fef-bbce-0aed2fe62900-hosts-file\") pod \"node-resolver-btdt9\" (UID: \"9a4c059e-96cd-4fef-bbce-0aed2fe62900\") " pod="openshift-dns/node-resolver-btdt9" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782662 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-run-netns\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.783722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-run-openvswitch\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782716 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-var-lib-kubelet\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782734 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c127eff-4d31-469d-968e-ec86c46bb4cd-env-overrides\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782779 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7df6635-4580-4cef-809a-46d2b81cbb5c-host\") pod \"node-ca-tncm8\" (UID: \"a7df6635-4580-4cef-809a-46d2b81cbb5c\") " pod="openshift-image-registry/node-ca-tncm8" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782842 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-var-lib-kubelet\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782868 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9a4c059e-96cd-4fef-bbce-0aed2fe62900-hosts-file\") pod \"node-resolver-btdt9\" (UID: \"9a4c059e-96cd-4fef-bbce-0aed2fe62900\") " pod="openshift-dns/node-resolver-btdt9" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7df6635-4580-4cef-809a-46d2b81cbb5c-host\") pod \"node-ca-tncm8\" (UID: \"a7df6635-4580-4cef-809a-46d2b81cbb5c\") " pod="openshift-image-registry/node-ca-tncm8" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-sysconfig\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782942 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-kubernetes\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.782985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-sysctl-conf\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.783016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/913d5e1b-5e80-4cda-8ceb-600f27b611fe-kubelet-config\") pod \"global-pull-secret-syncer-88jzz\" (UID: \"913d5e1b-5e80-4cda-8ceb-600f27b611fe\") " pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.783043 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa4487e8-f742-4a86-9d47-8c4b4a90e76f-agent-certs\") pod \"konnectivity-agent-9k6j4\" (UID: \"fa4487e8-f742-4a86-9d47-8c4b4a90e76f\") " pod="kube-system/konnectivity-agent-9k6j4" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.783072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs\") pod \"network-metrics-daemon-k7k2q\" (UID: \"dd17968b-99b4-4dcf-afd3-33e5bc160e72\") " pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.783222 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-run\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.783236 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-sysctl-conf\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.783256 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa4487e8-f742-4a86-9d47-8c4b4a90e76f-konnectivity-ca\") pod \"konnectivity-agent-9k6j4\" (UID: \"fa4487e8-f742-4a86-9d47-8c4b4a90e76f\") " pod="kube-system/konnectivity-agent-9k6j4" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.783290 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-run\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.783300 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-tuned\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.784411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.783306 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-kubernetes\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.784946 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.783256 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-host-run-netns\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.784946 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.783299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76e419fd-5854-4474-a4dd-324785d896bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.784946 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:18.783403 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:31:18.784946 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:18.783468 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs podName:dd17968b-99b4-4dcf-afd3-33e5bc160e72 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:19.283451659 +0000 UTC m=+2.008269932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs") pod "network-metrics-daemon-k7k2q" (UID: "dd17968b-99b4-4dcf-afd3-33e5bc160e72") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:31:18.784946 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.783403 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0faf1e06-3f08-460a-87db-360f3ef5e233-iptables-alerter-script\") pod \"iptables-alerter-xwsvh\" (UID: \"0faf1e06-3f08-460a-87db-360f3ef5e233\") " pod="openshift-network-operator/iptables-alerter-xwsvh" Sep 15 17:31:18.784946 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.783505 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/913d5e1b-5e80-4cda-8ceb-600f27b611fe-kubelet-config\") pod \"global-pull-secret-syncer-88jzz\" (UID: \"913d5e1b-5e80-4cda-8ceb-600f27b611fe\") " pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:18.784946 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.783539 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c127eff-4d31-469d-968e-ec86c46bb4cd-run-openvswitch\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.784946 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.783688 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-etc-sysconfig\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.784946 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.783946 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76e419fd-5854-4474-a4dd-324785d896bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.784946 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.784003 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fa4487e8-f742-4a86-9d47-8c4b4a90e76f-konnectivity-ca\") pod \"konnectivity-agent-9k6j4\" (UID: \"fa4487e8-f742-4a86-9d47-8c4b4a90e76f\") " pod="kube-system/konnectivity-agent-9k6j4" Sep 15 17:31:18.784946 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.784010 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76e419fd-5854-4474-a4dd-324785d896bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.784946 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.784214 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-tmp\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.784946 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.784251 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c127eff-4d31-469d-968e-ec86c46bb4cd-ovn-node-metrics-cert\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.784946 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.784371 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76e419fd-5854-4474-a4dd-324785d896bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.785671 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.785649 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fa4487e8-f742-4a86-9d47-8c4b4a90e76f-agent-certs\") pod \"konnectivity-agent-9k6j4\" (UID: \"fa4487e8-f742-4a86-9d47-8c4b4a90e76f\") " pod="kube-system/konnectivity-agent-9k6j4" Sep 15 17:31:18.787668 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.787647 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz8ns\" (UniqueName: \"kubernetes.io/projected/dd17968b-99b4-4dcf-afd3-33e5bc160e72-kube-api-access-fz8ns\") pod \"network-metrics-daemon-k7k2q\" (UID: \"dd17968b-99b4-4dcf-afd3-33e5bc160e72\") " pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:18.792645 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.792615 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f7wg\" (UniqueName: \"kubernetes.io/projected/9a4c059e-96cd-4fef-bbce-0aed2fe62900-kube-api-access-8f7wg\") pod \"node-resolver-btdt9\" (UID: \"9a4c059e-96cd-4fef-bbce-0aed2fe62900\") " pod="openshift-dns/node-resolver-btdt9" Sep 15 17:31:18.792756 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.792650 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlgvf\" (UniqueName: \"kubernetes.io/projected/3103f121-024d-41f9-9f24-d2e0333dae4e-kube-api-access-vlgvf\") pod \"aws-ebs-csi-driver-node-vj89j\" (UID: \"3103f121-024d-41f9-9f24-d2e0333dae4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:18.792969 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:18.792949 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 17:31:18.793048 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:18.792979 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 17:31:18.793048 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:18.792995 2581 projected.go:196] Error preparing data for projected volume kube-api-access-tsr9r for pod openshift-network-diagnostics/network-check-target-q6n92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:31:18.793048 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.793034 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5tj5\" (UniqueName: \"kubernetes.io/projected/11cb962a-5bd8-43c5-8a9f-390b28d58bfc-kube-api-access-w5tj5\") pod \"tuned-xfjqq\" (UID: \"11cb962a-5bd8-43c5-8a9f-390b28d58bfc\") " pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.793200 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:18.793067 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r podName:fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b nodeName:}" failed. No retries permitted until 2026-09-15 17:31:19.29304713 +0000 UTC m=+2.017865421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tsr9r" (UniqueName: "kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r") pod "network-check-target-q6n92" (UID: "fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:31:18.793827 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.793795 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld7g2\" (UniqueName: \"kubernetes.io/projected/4c127eff-4d31-469d-968e-ec86c46bb4cd-kube-api-access-ld7g2\") pod \"ovnkube-node-ldm4p\" (UID: \"4c127eff-4d31-469d-968e-ec86c46bb4cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.795257 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.795234 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7jrs\" (UniqueName: \"kubernetes.io/projected/76e419fd-5854-4474-a4dd-324785d896bd-kube-api-access-d7jrs\") pod \"multus-additional-cni-plugins-rb26f\" (UID: \"76e419fd-5854-4474-a4dd-324785d896bd\") " pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:18.795479 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.795458 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z9pn\" (UniqueName: \"kubernetes.io/projected/0faf1e06-3f08-460a-87db-360f3ef5e233-kube-api-access-8z9pn\") pod \"iptables-alerter-xwsvh\" (UID: \"0faf1e06-3f08-460a-87db-360f3ef5e233\") " pod="openshift-network-operator/iptables-alerter-xwsvh" Sep 15 17:31:18.795871 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.795854 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vs7k\" (UniqueName: \"kubernetes.io/projected/a7df6635-4580-4cef-809a-46d2b81cbb5c-kube-api-access-6vs7k\") pod \"node-ca-tncm8\" (UID: \"a7df6635-4580-4cef-809a-46d2b81cbb5c\") " pod="openshift-image-registry/node-ca-tncm8" Sep 15 17:31:18.843948 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:18.843896 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520fabedc60a64e4fd6648fb59243517.slice/crio-976947dc1d50d131102aa366b78278ca7a110d8635996bdbefbd31e5a3756b2c WatchSource:0}: Error finding container 976947dc1d50d131102aa366b78278ca7a110d8635996bdbefbd31e5a3756b2c: Status 404 returned error can't find the container with id 976947dc1d50d131102aa366b78278ca7a110d8635996bdbefbd31e5a3756b2c Sep 15 17:31:18.844256 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:18.844232 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a048dfbc799f86a2baabe7fe5ea46cb.slice/crio-f316b0f3495308312c41fa265999c56c535a14c9a8bd8e962b938071e4a42746 WatchSource:0}: Error finding container f316b0f3495308312c41fa265999c56c535a14c9a8bd8e962b938071e4a42746: Status 404 returned error can't find the container with id f316b0f3495308312c41fa265999c56c535a14c9a8bd8e962b938071e4a42746 Sep 15 17:31:18.849821 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.849803 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 17:31:18.894259 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.894158 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p9llc" Sep 15 17:31:18.904821 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:18.904790 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2927a04f_4bc9_400e_9afd_5480987c6ebc.slice/crio-f2cea7293f94edd88dc8fbbfbd0228b13c9c767c6ed177a984ead68cec65d0da WatchSource:0}: Error finding container f2cea7293f94edd88dc8fbbfbd0228b13c9c767c6ed177a984ead68cec65d0da: Status 404 returned error can't find the container with id f2cea7293f94edd88dc8fbbfbd0228b13c9c767c6ed177a984ead68cec65d0da Sep 15 17:31:18.909384 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.909364 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:18.918236 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:18.918209 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c127eff_4d31_469d_968e_ec86c46bb4cd.slice/crio-7552cd2f4843aa2b27cabad4cff1785554077a5f5de62cc9ddad0f361502e8a7 WatchSource:0}: Error finding container 7552cd2f4843aa2b27cabad4cff1785554077a5f5de62cc9ddad0f361502e8a7: Status 404 returned error can't find the container with id 7552cd2f4843aa2b27cabad4cff1785554077a5f5de62cc9ddad0f361502e8a7 Sep 15 17:31:18.929112 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.929071 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9k6j4" Sep 15 17:31:18.938480 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:18.938456 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4487e8_f742_4a86_9d47_8c4b4a90e76f.slice/crio-04205d44394b2340732964d7006862fb380a37cd4161aecbeb9d0ab18e7ec843 WatchSource:0}: Error finding container 04205d44394b2340732964d7006862fb380a37cd4161aecbeb9d0ab18e7ec843: Status 404 returned error can't find the container with id 04205d44394b2340732964d7006862fb380a37cd4161aecbeb9d0ab18e7ec843 Sep 15 17:31:18.952571 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.952536 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" Sep 15 17:31:18.961146 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:18.961116 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11cb962a_5bd8_43c5_8a9f_390b28d58bfc.slice/crio-39615c157081149e60ce4ccd782be302544ab6762e331d9d996711d1cce0ce68 WatchSource:0}: Error finding container 39615c157081149e60ce4ccd782be302544ab6762e331d9d996711d1cce0ce68: Status 404 returned error can't find the container with id 39615c157081149e60ce4ccd782be302544ab6762e331d9d996711d1cce0ce68 Sep 15 17:31:18.971354 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.971331 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-btdt9" Sep 15 17:31:18.980301 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:18.980276 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a4c059e_96cd_4fef_bbce_0aed2fe62900.slice/crio-87fccec2971fa43b1ac7121f7b28a780cf06dca19714832958b75082dccb4e73 WatchSource:0}: Error finding container 87fccec2971fa43b1ac7121f7b28a780cf06dca19714832958b75082dccb4e73: Status 404 returned error can't find the container with id 87fccec2971fa43b1ac7121f7b28a780cf06dca19714832958b75082dccb4e73 Sep 15 17:31:18.996447 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:18.996406 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xwsvh" Sep 15 17:31:19.006212 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:19.006183 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0faf1e06_3f08_460a_87db_360f3ef5e233.slice/crio-377107137eaf0d96e8725542315e7d7a7ae6c575256fe09c3e862da8760ec6af WatchSource:0}: Error finding container 377107137eaf0d96e8725542315e7d7a7ae6c575256fe09c3e862da8760ec6af: Status 404 returned error can't find the container with id 377107137eaf0d96e8725542315e7d7a7ae6c575256fe09c3e862da8760ec6af Sep 15 17:31:19.009634 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.009567 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" Sep 15 17:31:19.016499 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.016475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tncm8" Sep 15 17:31:19.018846 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:19.018820 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3103f121_024d_41f9_9f24_d2e0333dae4e.slice/crio-6f36d6162233dc19380032f2d71fec3a3ffbea1df2c9730aa441b8dfd1f0c480 WatchSource:0}: Error finding container 6f36d6162233dc19380032f2d71fec3a3ffbea1df2c9730aa441b8dfd1f0c480: Status 404 returned error can't find the container with id 6f36d6162233dc19380032f2d71fec3a3ffbea1df2c9730aa441b8dfd1f0c480 Sep 15 17:31:19.022256 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.022232 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rb26f" Sep 15 17:31:19.028542 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:19.028273 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7df6635_4580_4cef_809a_46d2b81cbb5c.slice/crio-37c5ffcbe6b7a44cd960f3bd27e25a5378f79c1845d1f3207636770930fdc368 WatchSource:0}: Error finding container 37c5ffcbe6b7a44cd960f3bd27e25a5378f79c1845d1f3207636770930fdc368: Status 404 returned error can't find the container with id 37c5ffcbe6b7a44cd960f3bd27e25a5378f79c1845d1f3207636770930fdc368 Sep 15 17:31:19.033978 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:19.033953 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e419fd_5854_4474_a4dd_324785d896bd.slice/crio-ad6f6524dca76100954b3dea0aa96b9674d87cc21de7e4e2dc8030b96573a815 WatchSource:0}: Error finding container ad6f6524dca76100954b3dea0aa96b9674d87cc21de7e4e2dc8030b96573a815: Status 404 returned error can't find the container with id ad6f6524dca76100954b3dea0aa96b9674d87cc21de7e4e2dc8030b96573a815 Sep 15 17:31:19.036040 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:19.036011 2581 kuberuntime_manager.go:1459] "Unhandled Error" err="init container egress-router-binary-copy start failed in pod multus-additional-cni-plugins-rb26f_openshift-multus(76e419fd-5854-4474-a4dd-324785d896bd): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Sep 15 17:31:19.036148 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:19.036061 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"egress-router-binary-copy\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-multus/multus-additional-cni-plugins-rb26f" podUID="76e419fd-5854-4474-a4dd-324785d896bd" Sep 15 17:31:19.287981 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.287869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs\") pod \"network-metrics-daemon-k7k2q\" (UID: \"dd17968b-99b4-4dcf-afd3-33e5bc160e72\") " pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:19.287981 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.287927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret\") pod \"global-pull-secret-syncer-88jzz\" (UID: \"913d5e1b-5e80-4cda-8ceb-600f27b611fe\") " pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:19.288212 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:19.288034 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 17:31:19.288212 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:19.288096 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret podName:913d5e1b-5e80-4cda-8ceb-600f27b611fe nodeName:}" failed. No retries permitted until 2026-09-15 17:31:20.288080418 +0000 UTC m=+3.012898692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret") pod "global-pull-secret-syncer-88jzz" (UID: "913d5e1b-5e80-4cda-8ceb-600f27b611fe") : object "kube-system"/"original-pull-secret" not registered Sep 15 17:31:19.288212 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:19.288036 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:31:19.288212 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:19.288190 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs podName:dd17968b-99b4-4dcf-afd3-33e5bc160e72 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:20.288173683 +0000 UTC m=+3.012991953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs") pod "network-metrics-daemon-k7k2q" (UID: "dd17968b-99b4-4dcf-afd3-33e5bc160e72") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:31:19.388532 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.388492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsr9r\" (UniqueName: \"kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r\") pod \"network-check-target-q6n92\" (UID: \"fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b\") " pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:19.388705 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:19.388684 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 17:31:19.388705 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:19.388702 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 17:31:19.388772 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:19.388712 2581 projected.go:196] Error preparing data for projected volume kube-api-access-tsr9r for pod openshift-network-diagnostics/network-check-target-q6n92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:31:19.388809 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:19.388773 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r podName:fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b nodeName:}" failed. No retries permitted until 2026-09-15 17:31:20.388755447 +0000 UTC m=+3.113573719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tsr9r" (UniqueName: "kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r") pod "network-check-target-q6n92" (UID: "fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:31:19.545243 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.545155 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 17:31:19.614804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.614755 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 17:26:18 +0000 UTC" deadline="2028-05-12 05:40:59.511360641 +0000 UTC" Sep 15 17:31:19.614804 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.614798 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14508h9m39.896568342s" Sep 15 17:31:19.753672 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.753015 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rb26f" event={"ID":"76e419fd-5854-4474-a4dd-324785d896bd","Type":"ContainerStarted","Data":"ad6f6524dca76100954b3dea0aa96b9674d87cc21de7e4e2dc8030b96573a815"} Sep 15 17:31:19.755092 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:19.755026 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"egress-router-binary-copy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:62c7cc09ff9f9684116e4c6b702d22ac67be29319eb961485e46f9441db87fb0\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-multus/multus-additional-cni-plugins-rb26f" podUID="76e419fd-5854-4474-a4dd-324785d896bd" Sep 15 17:31:19.755497 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.755468 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" event={"ID":"3103f121-024d-41f9-9f24-d2e0333dae4e","Type":"ContainerStarted","Data":"6f36d6162233dc19380032f2d71fec3a3ffbea1df2c9730aa441b8dfd1f0c480"} Sep 15 17:31:19.758512 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.758402 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xwsvh" event={"ID":"0faf1e06-3f08-460a-87db-360f3ef5e233","Type":"ContainerStarted","Data":"377107137eaf0d96e8725542315e7d7a7ae6c575256fe09c3e862da8760ec6af"} Sep 15 17:31:19.760126 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.760041 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-btdt9" event={"ID":"9a4c059e-96cd-4fef-bbce-0aed2fe62900","Type":"ContainerStarted","Data":"87fccec2971fa43b1ac7121f7b28a780cf06dca19714832958b75082dccb4e73"} Sep 15 17:31:19.761485 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.761457 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9k6j4" event={"ID":"fa4487e8-f742-4a86-9d47-8c4b4a90e76f","Type":"ContainerStarted","Data":"04205d44394b2340732964d7006862fb380a37cd4161aecbeb9d0ab18e7ec843"} Sep 15 17:31:19.764291 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.764228 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" event={"ID":"4c127eff-4d31-469d-968e-ec86c46bb4cd","Type":"ContainerStarted","Data":"7552cd2f4843aa2b27cabad4cff1785554077a5f5de62cc9ddad0f361502e8a7"} Sep 15 17:31:19.766202 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.766119 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal" event={"ID":"4a048dfbc799f86a2baabe7fe5ea46cb","Type":"ContainerStarted","Data":"f316b0f3495308312c41fa265999c56c535a14c9a8bd8e962b938071e4a42746"} Sep 15 17:31:19.767814 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.767748 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-84.ec2.internal" event={"ID":"520fabedc60a64e4fd6648fb59243517","Type":"ContainerStarted","Data":"976947dc1d50d131102aa366b78278ca7a110d8635996bdbefbd31e5a3756b2c"} Sep 15 17:31:19.769569 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.769497 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tncm8" event={"ID":"a7df6635-4580-4cef-809a-46d2b81cbb5c","Type":"ContainerStarted","Data":"37c5ffcbe6b7a44cd960f3bd27e25a5378f79c1845d1f3207636770930fdc368"} Sep 15 17:31:19.771255 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.771190 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" event={"ID":"11cb962a-5bd8-43c5-8a9f-390b28d58bfc","Type":"ContainerStarted","Data":"39615c157081149e60ce4ccd782be302544ab6762e331d9d996711d1cce0ce68"} Sep 15 17:31:19.774737 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:19.774689 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p9llc" event={"ID":"2927a04f-4bc9-400e-9afd-5480987c6ebc","Type":"ContainerStarted","Data":"f2cea7293f94edd88dc8fbbfbd0228b13c9c767c6ed177a984ead68cec65d0da"} Sep 15 17:31:20.297656 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:20.296791 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs\") pod \"network-metrics-daemon-k7k2q\" (UID: \"dd17968b-99b4-4dcf-afd3-33e5bc160e72\") " pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:20.297656 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:20.296869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret\") pod \"global-pull-secret-syncer-88jzz\" (UID: \"913d5e1b-5e80-4cda-8ceb-600f27b611fe\") " pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:20.297656 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:20.297019 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 17:31:20.297656 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:20.297089 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret podName:913d5e1b-5e80-4cda-8ceb-600f27b611fe nodeName:}" failed. No retries permitted until 2026-09-15 17:31:22.297069747 +0000 UTC m=+5.021888025 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret") pod "global-pull-secret-syncer-88jzz" (UID: "913d5e1b-5e80-4cda-8ceb-600f27b611fe") : object "kube-system"/"original-pull-secret" not registered Sep 15 17:31:20.297656 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:20.297562 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:31:20.297656 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:20.297625 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs podName:dd17968b-99b4-4dcf-afd3-33e5bc160e72 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:22.297606619 +0000 UTC m=+5.022424895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs") pod "network-metrics-daemon-k7k2q" (UID: "dd17968b-99b4-4dcf-afd3-33e5bc160e72") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:31:20.398870 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:20.398154 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsr9r\" (UniqueName: \"kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r\") pod \"network-check-target-q6n92\" (UID: \"fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b\") " pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:20.398870 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:20.398379 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 17:31:20.398870 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:20.398402 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 17:31:20.398870 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:20.398415 2581 projected.go:196] Error preparing data for projected volume kube-api-access-tsr9r for pod openshift-network-diagnostics/network-check-target-q6n92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:31:20.398870 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:20.398483 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r podName:fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b nodeName:}" failed. No retries permitted until 2026-09-15 17:31:22.398460884 +0000 UTC m=+5.123279158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tsr9r" (UniqueName: "kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r") pod "network-check-target-q6n92" (UID: "fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:31:20.615828 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:20.615639 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 17:26:18 +0000 UTC" deadline="2028-06-08 23:14:29.79925278 +0000 UTC" Sep 15 17:31:20.615828 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:20.615709 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15173h43m9.183548261s" Sep 15 17:31:20.746200 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:20.746162 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:20.746426 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:20.746168 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:20.746426 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:20.746354 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:20.746426 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:20.746370 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:20.746606 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:20.746483 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:20.746606 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:20.746571 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:21.222383 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:21.222128 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 17:31:22.314683 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:22.314644 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs\") pod \"network-metrics-daemon-k7k2q\" (UID: \"dd17968b-99b4-4dcf-afd3-33e5bc160e72\") " pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:22.315187 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:22.314707 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret\") pod \"global-pull-secret-syncer-88jzz\" (UID: \"913d5e1b-5e80-4cda-8ceb-600f27b611fe\") " pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:22.315187 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:22.314836 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 17:31:22.315187 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:22.314897 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret podName:913d5e1b-5e80-4cda-8ceb-600f27b611fe nodeName:}" failed. No retries permitted until 2026-09-15 17:31:26.314880019 +0000 UTC m=+9.039698295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret") pod "global-pull-secret-syncer-88jzz" (UID: "913d5e1b-5e80-4cda-8ceb-600f27b611fe") : object "kube-system"/"original-pull-secret" not registered Sep 15 17:31:22.315358 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:22.315303 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:31:22.315358 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:22.315357 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs podName:dd17968b-99b4-4dcf-afd3-33e5bc160e72 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:26.315341643 +0000 UTC m=+9.040159916 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs") pod "network-metrics-daemon-k7k2q" (UID: "dd17968b-99b4-4dcf-afd3-33e5bc160e72") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:31:22.416033 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:22.415973 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsr9r\" (UniqueName: \"kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r\") pod \"network-check-target-q6n92\" (UID: \"fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b\") " pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:22.416242 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:22.416180 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 17:31:22.416242 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:22.416204 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 17:31:22.416242 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:22.416215 2581 projected.go:196] Error preparing data for projected volume kube-api-access-tsr9r for pod openshift-network-diagnostics/network-check-target-q6n92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:31:22.416401 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:22.416274 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r podName:fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b nodeName:}" failed. No retries permitted until 2026-09-15 17:31:26.416256278 +0000 UTC m=+9.141074564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tsr9r" (UniqueName: "kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r") pod "network-check-target-q6n92" (UID: "fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:31:22.746510 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:22.746477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:22.746694 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:22.746519 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:22.746694 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:22.746488 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:22.746694 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:22.746630 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:22.746694 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:22.746677 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:22.746908 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:22.746754 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:24.746351 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:24.746312 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:24.746875 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:24.746455 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:24.746875 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:24.746496 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:24.746875 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:24.746485 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:24.747022 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:24.746976 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:24.747233 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:24.747197 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:26.350945 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:26.350906 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs\") pod \"network-metrics-daemon-k7k2q\" (UID: \"dd17968b-99b4-4dcf-afd3-33e5bc160e72\") " pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:26.351476 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:26.350965 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret\") pod \"global-pull-secret-syncer-88jzz\" (UID: \"913d5e1b-5e80-4cda-8ceb-600f27b611fe\") " pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:26.351476 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:26.351128 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 17:31:26.351476 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:26.351191 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret podName:913d5e1b-5e80-4cda-8ceb-600f27b611fe nodeName:}" failed. No retries permitted until 2026-09-15 17:31:34.351172891 +0000 UTC m=+17.075991162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret") pod "global-pull-secret-syncer-88jzz" (UID: "913d5e1b-5e80-4cda-8ceb-600f27b611fe") : object "kube-system"/"original-pull-secret" not registered Sep 15 17:31:26.351638 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:26.351590 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:31:26.351638 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:26.351636 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs podName:dd17968b-99b4-4dcf-afd3-33e5bc160e72 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:34.35162181 +0000 UTC m=+17.076440084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs") pod "network-metrics-daemon-k7k2q" (UID: "dd17968b-99b4-4dcf-afd3-33e5bc160e72") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:31:26.453179 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:26.452480 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsr9r\" (UniqueName: \"kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r\") pod \"network-check-target-q6n92\" (UID: \"fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b\") " pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:26.453179 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:26.452708 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 17:31:26.453179 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:26.452729 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 17:31:26.453179 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:26.452742 2581 projected.go:196] Error preparing data for projected volume kube-api-access-tsr9r for pod openshift-network-diagnostics/network-check-target-q6n92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:31:26.453179 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:26.452802 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r podName:fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b nodeName:}" failed. No retries permitted until 2026-09-15 17:31:34.452783636 +0000 UTC m=+17.177601919 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tsr9r" (UniqueName: "kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r") pod "network-check-target-q6n92" (UID: "fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:31:26.746779 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:26.746694 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:26.746779 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:26.746743 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:26.747002 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:26.746694 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:26.747002 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:26.746842 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:26.747002 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:26.746938 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:26.747201 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:26.747024 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:28.746217 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:28.746163 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:28.746811 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:28.746227 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:28.746811 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:28.746326 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:28.746811 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:28.746186 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:28.746811 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:28.746458 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:28.746811 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:28.746540 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:30.746343 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:30.746256 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:30.746343 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:30.746303 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:30.746830 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:30.746392 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:30.746830 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:30.746390 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:30.746830 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:30.746509 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:30.746830 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:30.746607 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:32.746275 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:32.746232 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:32.746275 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:32.746263 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:32.746883 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:32.746263 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:32.746883 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:32.746362 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:32.746883 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:32.746502 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:32.746883 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:32.746605 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:34.413451 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:34.413409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret\") pod \"global-pull-secret-syncer-88jzz\" (UID: \"913d5e1b-5e80-4cda-8ceb-600f27b611fe\") " pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:34.413905 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:34.413501 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs\") pod \"network-metrics-daemon-k7k2q\" (UID: \"dd17968b-99b4-4dcf-afd3-33e5bc160e72\") " pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:34.413905 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:34.413578 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:31:34.413905 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:34.413596 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 17:31:34.413905 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:34.413640 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs podName:dd17968b-99b4-4dcf-afd3-33e5bc160e72 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:50.413621169 +0000 UTC m=+33.138439455 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs") pod "network-metrics-daemon-k7k2q" (UID: "dd17968b-99b4-4dcf-afd3-33e5bc160e72") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:31:34.413905 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:34.413667 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret podName:913d5e1b-5e80-4cda-8ceb-600f27b611fe nodeName:}" failed. No retries permitted until 2026-09-15 17:31:50.413646966 +0000 UTC m=+33.138465257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret") pod "global-pull-secret-syncer-88jzz" (UID: "913d5e1b-5e80-4cda-8ceb-600f27b611fe") : object "kube-system"/"original-pull-secret" not registered Sep 15 17:31:34.513962 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:34.513914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsr9r\" (UniqueName: \"kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r\") pod \"network-check-target-q6n92\" (UID: \"fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b\") " pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:34.514155 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:34.514111 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 17:31:34.514155 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:34.514141 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 17:31:34.514155 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:34.514156 2581 projected.go:196] Error preparing data for projected volume kube-api-access-tsr9r for pod openshift-network-diagnostics/network-check-target-q6n92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:31:34.514311 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:34.514221 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r podName:fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b nodeName:}" failed. No retries permitted until 2026-09-15 17:31:50.514199892 +0000 UTC m=+33.239018161 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tsr9r" (UniqueName: "kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r") pod "network-check-target-q6n92" (UID: "fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:31:34.746457 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:34.746367 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:34.746623 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:34.746384 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:34.746623 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:34.746391 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:34.746623 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:34.746536 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:34.746786 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:34.746617 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:34.746786 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:34.746487 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:36.746264 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:36.746228 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:36.746264 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:36.746262 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:36.746790 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:36.746234 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:36.746790 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:36.746378 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:36.746790 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:36.746537 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:36.746790 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:36.746607 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:38.746431 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.746028 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:38.747193 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.746110 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:38.747193 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:38.746472 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:38.747193 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.746110 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:38.747193 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:38.746570 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:38.747193 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:38.746621 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:38.827605 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.827563 2581 generic.go:356] "Generic (PLEG): container finished" podID="4a048dfbc799f86a2baabe7fe5ea46cb" containerID="d771d4964d598361ebb05548ee26114534b901b563ccf9b9d40d28100543dd43" exitCode=0 Sep 15 17:31:38.827780 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.827678 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal" event={"ID":"4a048dfbc799f86a2baabe7fe5ea46cb","Type":"ContainerDied","Data":"d771d4964d598361ebb05548ee26114534b901b563ccf9b9d40d28100543dd43"} Sep 15 17:31:38.829907 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.829877 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-84.ec2.internal" event={"ID":"520fabedc60a64e4fd6648fb59243517","Type":"ContainerStarted","Data":"9df9957eb6c0e46044cb881c75dcff04c3980243d2e9845d7532e626a62a9583"} Sep 15 17:31:38.831735 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.831712 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tncm8" event={"ID":"a7df6635-4580-4cef-809a-46d2b81cbb5c","Type":"ContainerStarted","Data":"ca71c15ce0b65ecad7800f49e6a9870e5e5e3b45925e97fd2d58427189693813"} Sep 15 17:31:38.833550 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.833522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" event={"ID":"11cb962a-5bd8-43c5-8a9f-390b28d58bfc","Type":"ContainerStarted","Data":"0fdbf417d306c8e14fc19577520ce14f74cc79fa3c3927076cd034084c541030"} Sep 15 17:31:38.838257 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.838226 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p9llc" event={"ID":"2927a04f-4bc9-400e-9afd-5480987c6ebc","Type":"ContainerStarted","Data":"9611d42f50ff6545880b5fe79cf7042b57a324c6a14c5a4aa0220c05e4ab0927"} Sep 15 17:31:38.840023 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.839997 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" event={"ID":"3103f121-024d-41f9-9f24-d2e0333dae4e","Type":"ContainerStarted","Data":"0ee8ba802f7cb6c21d8708233464eb550db08775978970d3d679fe5d4e6f4cb4"} Sep 15 17:31:38.841834 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.841807 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-btdt9" event={"ID":"9a4c059e-96cd-4fef-bbce-0aed2fe62900","Type":"ContainerStarted","Data":"7094dbffdb92bed2cedb51826081a2d0140f60c96e5ff000af1f10d0c1b3a3b0"} Sep 15 17:31:38.843517 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.843491 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9k6j4" event={"ID":"fa4487e8-f742-4a86-9d47-8c4b4a90e76f","Type":"ContainerStarted","Data":"e3f4812d47ecd0c5068d4982ea9099427b4936a514bd7a327e07218e55ec8fdc"} Sep 15 17:31:38.846781 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.846753 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/ovn-acl-logging/0.log" Sep 15 17:31:38.847209 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.847184 2581 generic.go:356] "Generic (PLEG): container finished" podID="4c127eff-4d31-469d-968e-ec86c46bb4cd" containerID="72482310e929a48c47694e4fcc7a9e11d7ae1b719fa39bc1dde049be1dae7953" exitCode=1 Sep 15 17:31:38.847308 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.847220 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" event={"ID":"4c127eff-4d31-469d-968e-ec86c46bb4cd","Type":"ContainerStarted","Data":"79e7200205640e3b5c1703375e20f9d9d6b4fcdb6c63778dafec62462c26eb64"} Sep 15 17:31:38.847308 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.847281 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" event={"ID":"4c127eff-4d31-469d-968e-ec86c46bb4cd","Type":"ContainerStarted","Data":"30c112e1bae113372cea1d3c1b1082d5276f49619ecbbbac67db0d922fef1394"} Sep 15 17:31:38.847396 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.847331 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" event={"ID":"4c127eff-4d31-469d-968e-ec86c46bb4cd","Type":"ContainerStarted","Data":"a231f78cb758202a053f21812970c88b2bbf9508c5b6eff7dfa1c0fb996094d0"} Sep 15 17:31:38.847396 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.847377 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" event={"ID":"4c127eff-4d31-469d-968e-ec86c46bb4cd","Type":"ContainerStarted","Data":"ec8751fe06fdfae633869b0b97a8e304f4b742004140b3b300a4c7bbb4aec6aa"} Sep 15 17:31:38.847472 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.847416 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" event={"ID":"4c127eff-4d31-469d-968e-ec86c46bb4cd","Type":"ContainerDied","Data":"72482310e929a48c47694e4fcc7a9e11d7ae1b719fa39bc1dde049be1dae7953"} Sep 15 17:31:38.847472 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.847446 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" event={"ID":"4c127eff-4d31-469d-968e-ec86c46bb4cd","Type":"ContainerStarted","Data":"cbe505846a47cfbff0f1e4d152c02cd5dc3300ca209dd42030949789c9eecf63"} Sep 15 17:31:38.855256 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.855186 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xfjqq" podStartSLOduration=2.064984504 podStartE2EDuration="20.855164146s" totalImagesPullingTime="18.790179642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:31:38.854760391 +0000 UTC m=+21.579578681" watchObservedRunningTime="2026-09-15 17:31:38.855164146 +0000 UTC m=+21.579982435" Sep 15 17:31:38.888179 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.888101 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-84.ec2.internal" podStartSLOduration=20.888062463 podStartE2EDuration="20.888062463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:31:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:31:38.866679868 +0000 UTC m=+21.591498161" watchObservedRunningTime="2026-09-15 17:31:38.888062463 +0000 UTC m=+21.612880769" Sep 15 17:31:38.905320 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.905271 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p9llc" podStartSLOduration=1.778930784 podStartE2EDuration="20.90525049s" totalImagesPullingTime="19.126319706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:31:38.888706783 +0000 UTC m=+21.613525074" watchObservedRunningTime="2026-09-15 17:31:38.90525049 +0000 UTC m=+21.630068984" Sep 15 17:31:38.905977 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.905927 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tncm8" podStartSLOduration=2.254784543 podStartE2EDuration="20.905916479s" totalImagesPullingTime="18.651131936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:31:38.905120355 +0000 UTC m=+21.629938646" watchObservedRunningTime="2026-09-15 17:31:38.905916479 +0000 UTC m=+21.630734769" Sep 15 17:31:38.919486 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.919436 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9k6j4" podStartSLOduration=2.582965238 podStartE2EDuration="20.919418781s" totalImagesPullingTime="18.336453543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:31:38.91898081 +0000 UTC m=+21.643799104" watchObservedRunningTime="2026-09-15 17:31:38.919418781 +0000 UTC m=+21.644237072" Sep 15 17:31:38.932572 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:38.932509 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-btdt9" podStartSLOduration=2.185005163 podStartE2EDuration="20.932485793s" totalImagesPullingTime="18.74748063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:31:38.932162894 +0000 UTC m=+21.656981203" watchObservedRunningTime="2026-09-15 17:31:38.932485793 +0000 UTC m=+21.657304085" Sep 15 17:31:39.851440 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:39.851409 2581 generic.go:356] "Generic (PLEG): container finished" podID="76e419fd-5854-4474-a4dd-324785d896bd" containerID="663cf2ff4b317004619593142a49aadcd8cd906cb8e93ae331cfd9bea3642059" exitCode=0 Sep 15 17:31:39.852280 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:39.851483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rb26f" event={"ID":"76e419fd-5854-4474-a4dd-324785d896bd","Type":"ContainerDied","Data":"663cf2ff4b317004619593142a49aadcd8cd906cb8e93ae331cfd9bea3642059"} Sep 15 17:31:39.853106 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:39.853032 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xwsvh" event={"ID":"0faf1e06-3f08-460a-87db-360f3ef5e233","Type":"ContainerStarted","Data":"04dae18dc115c3ff4668a4eeedfc84dbb1aca59184a630fbe2d84eec36c2fd3b"} Sep 15 17:31:39.855132 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:39.855102 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal" event={"ID":"4a048dfbc799f86a2baabe7fe5ea46cb","Type":"ContainerStarted","Data":"98f8f9d015637198fc4d73aba2c3a05b02800e2f65009b84b6ed00e626be4614"} Sep 15 17:31:39.873007 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:39.872981 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 15 17:31:39.899269 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:39.899217 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xwsvh" podStartSLOduration=3.152209956 podStartE2EDuration="21.899199032s" totalImagesPullingTime="18.746989076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:31:39.884837931 +0000 UTC m=+22.609656224" watchObservedRunningTime="2026-09-15 17:31:39.899199032 +0000 UTC m=+22.624017323" Sep 15 17:31:39.899441 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:39.899384 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-84.ec2.internal" podStartSLOduration=21.89937821 podStartE2EDuration="21.89937821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:31:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:31:39.899067885 +0000 UTC m=+22.623886176" watchObservedRunningTime="2026-09-15 17:31:39.89937821 +0000 UTC m=+22.624196500" Sep 15 17:31:40.647213 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:40.646858 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T17:31:39.873001708Z","UUID":"8678db6a-8fc8-4d40-a2bb-257e376a8c0c","Handler":null,"Name":"","Endpoint":""} Sep 15 17:31:40.648596 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:40.648572 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 15 17:31:40.648596 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:40.648603 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 15 17:31:40.746170 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:40.746138 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:40.746357 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:40.746137 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:40.746357 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:40.746282 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:40.746357 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:40.746310 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:40.746357 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:40.746155 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:40.746553 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:40.746381 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:40.860597 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:40.860444 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" event={"ID":"3103f121-024d-41f9-9f24-d2e0333dae4e","Type":"ContainerStarted","Data":"ac822373c9c001e142e8aa075a8b01892c101aa107c7f7f466cd6abebca7e97b"} Sep 15 17:31:40.864449 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:40.864425 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/ovn-acl-logging/0.log" Sep 15 17:31:40.865099 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:40.865056 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" event={"ID":"4c127eff-4d31-469d-968e-ec86c46bb4cd","Type":"ContainerStarted","Data":"1b9a7ef111340244a5a1ff1c6c0b49573b9c7d480d5fa7fa17e5059858521053"} Sep 15 17:31:41.870009 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:41.869972 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" event={"ID":"3103f121-024d-41f9-9f24-d2e0333dae4e","Type":"ContainerStarted","Data":"ce15d1c022ac49897800dc32dff3e72f942886149052cf69d37db3abbf2d88a3"} Sep 15 17:31:41.890808 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:41.890751 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vj89j" podStartSLOduration=2.772392023 podStartE2EDuration="23.890728738s" totalImagesPullingTime="21.118336715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:31:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:31:41.890134011 +0000 UTC m=+24.614952302" watchObservedRunningTime="2026-09-15 17:31:41.890728738 +0000 UTC m=+24.615547032" Sep 15 17:31:42.289707 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:42.289614 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9k6j4" Sep 15 17:31:42.290418 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:42.290392 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9k6j4" Sep 15 17:31:42.746570 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:42.746541 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:42.746701 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:42.746541 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:42.746701 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:42.746680 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:42.746812 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:42.746541 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:42.746865 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:42.746799 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:42.746932 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:42.746909 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:42.877561 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:42.877535 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/ovn-acl-logging/0.log" Sep 15 17:31:42.878057 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:42.878020 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" event={"ID":"4c127eff-4d31-469d-968e-ec86c46bb4cd","Type":"ContainerStarted","Data":"770486a13878c9b1411114c49f55f361b9304472da4cc4d8ae5e62811bbcda2d"} Sep 15 17:31:42.878338 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:42.878315 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9k6j4" Sep 15 17:31:42.878740 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:42.878533 2581 scope.go:117] "RemoveContainer" containerID="72482310e929a48c47694e4fcc7a9e11d7ae1b719fa39bc1dde049be1dae7953" Sep 15 17:31:42.879413 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:42.879396 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9k6j4" Sep 15 17:31:44.651322 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:44.651130 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-88jzz"] Sep 15 17:31:44.651933 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:44.651423 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:44.651933 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:44.651535 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:44.651933 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:44.651750 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q6n92"] Sep 15 17:31:44.651933 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:44.651840 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:44.652153 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:44.651935 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:44.654299 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:44.654273 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k7k2q"] Sep 15 17:31:44.654446 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:44.654388 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:44.654515 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:44.654485 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:44.887470 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:44.887395 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/ovn-acl-logging/0.log" Sep 15 17:31:44.887833 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:44.887803 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" event={"ID":"4c127eff-4d31-469d-968e-ec86c46bb4cd","Type":"ContainerStarted","Data":"54ee54681f22391b4bfa47f198446c395272e7d00c254b75ecaab120e6957be3"} Sep 15 17:31:44.888136 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:44.888114 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:44.888348 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:44.888313 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:44.888439 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:44.888384 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:44.904899 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:44.904867 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:44.905606 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:44.905587 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:31:44.919149 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:44.919099 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" podStartSLOduration=8.066498879 podStartE2EDuration="26.919068936s" totalImagesPullingTime="18.852570057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:31:44.919029712 +0000 UTC m=+27.643848014" watchObservedRunningTime="2026-09-15 17:31:44.919068936 +0000 UTC m=+27.643887221" Sep 15 17:31:45.746055 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:45.746023 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:45.746571 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:45.746184 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:45.892046 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:45.892009 2581 generic.go:356] "Generic (PLEG): container finished" podID="76e419fd-5854-4474-a4dd-324785d896bd" containerID="d05688d3c183d8c08e04a4f4610347c4d50373aa92b1470bc617dd1f6411d350" exitCode=0 Sep 15 17:31:45.892245 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:45.892078 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rb26f" event={"ID":"76e419fd-5854-4474-a4dd-324785d896bd","Type":"ContainerDied","Data":"d05688d3c183d8c08e04a4f4610347c4d50373aa92b1470bc617dd1f6411d350"} Sep 15 17:31:46.746211 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:46.746127 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:46.746739 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:46.746126 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:46.746739 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:46.746252 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:46.746739 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:46.746367 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:47.747209 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:47.747108 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:47.747667 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:47.747235 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:47.899264 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:47.899231 2581 generic.go:356] "Generic (PLEG): container finished" podID="76e419fd-5854-4474-a4dd-324785d896bd" containerID="8bfec4f4f1f88bb2e996c4231e752388e57efde223b5f39b67c4e8a5903f2d04" exitCode=0 Sep 15 17:31:47.899439 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:47.899304 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rb26f" event={"ID":"76e419fd-5854-4474-a4dd-324785d896bd","Type":"ContainerDied","Data":"8bfec4f4f1f88bb2e996c4231e752388e57efde223b5f39b67c4e8a5903f2d04"} Sep 15 17:31:48.746475 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:48.746375 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:48.746661 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:48.746518 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:48.746661 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:48.746563 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:48.746661 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:48.746649 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:48.904738 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:48.904706 2581 generic.go:356] "Generic (PLEG): container finished" podID="76e419fd-5854-4474-a4dd-324785d896bd" containerID="7f4f54ea83bd55c1dca2a0524447b1697f4b5bc6ba943ddce72a55b31594aed8" exitCode=0 Sep 15 17:31:48.905213 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:48.904780 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rb26f" event={"ID":"76e419fd-5854-4474-a4dd-324785d896bd","Type":"ContainerDied","Data":"7f4f54ea83bd55c1dca2a0524447b1697f4b5bc6ba943ddce72a55b31594aed8"} Sep 15 17:31:49.746692 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:49.746656 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:49.746868 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:49.746771 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q6n92" podUID="fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b" Sep 15 17:31:50.431852 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:50.431811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs\") pod \"network-metrics-daemon-k7k2q\" (UID: \"dd17968b-99b4-4dcf-afd3-33e5bc160e72\") " pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:50.432353 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:50.431867 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret\") pod \"global-pull-secret-syncer-88jzz\" (UID: \"913d5e1b-5e80-4cda-8ceb-600f27b611fe\") " pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:50.432353 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:50.431934 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:31:50.432353 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:50.431974 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 17:31:50.432353 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:50.432011 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs podName:dd17968b-99b4-4dcf-afd3-33e5bc160e72 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:22.431993488 +0000 UTC m=+65.156811758 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs") pod "network-metrics-daemon-k7k2q" (UID: "dd17968b-99b4-4dcf-afd3-33e5bc160e72") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 17:31:50.432353 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:50.432032 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret podName:913d5e1b-5e80-4cda-8ceb-600f27b611fe nodeName:}" failed. No retries permitted until 2026-09-15 17:32:22.432021635 +0000 UTC m=+65.156839912 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret") pod "global-pull-secret-syncer-88jzz" (UID: "913d5e1b-5e80-4cda-8ceb-600f27b611fe") : object "kube-system"/"original-pull-secret" not registered Sep 15 17:31:50.532705 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:50.532666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsr9r\" (UniqueName: \"kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r\") pod \"network-check-target-q6n92\" (UID: \"fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b\") " pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:50.532927 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:50.532808 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 17:31:50.532927 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:50.532823 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 17:31:50.532927 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:50.532831 2581 projected.go:196] Error preparing data for projected volume kube-api-access-tsr9r for pod openshift-network-diagnostics/network-check-target-q6n92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:31:50.532927 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:50.532887 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r podName:fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b nodeName:}" failed. No retries permitted until 2026-09-15 17:32:22.532873539 +0000 UTC m=+65.257691808 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tsr9r" (UniqueName: "kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r") pod "network-check-target-q6n92" (UID: "fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 17:31:50.746039 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:50.745958 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:50.746213 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:50.746127 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7k2q" podUID="dd17968b-99b4-4dcf-afd3-33e5bc160e72" Sep 15 17:31:50.746213 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:50.746138 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:50.746327 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:50.746217 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-88jzz" podUID="913d5e1b-5e80-4cda-8ceb-600f27b611fe" Sep 15 17:31:51.068755 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.068664 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-84.ec2.internal" event="NodeReady" Sep 15 17:31:51.068918 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.068825 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 15 17:31:51.107730 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.107694 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-777b6b5f6d-g8cb2"] Sep 15 17:31:51.131213 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.131179 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q7tlz"] Sep 15 17:31:51.131385 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.131310 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.133067 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.133042 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-x96rj"] Sep 15 17:31:51.133233 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.133191 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q7tlz" Sep 15 17:31:51.133723 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.133702 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 15 17:31:51.133864 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.133836 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fkvsx\"" Sep 15 17:31:51.133975 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.133956 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 15 17:31:51.134047 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.134020 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 15 17:31:51.134991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.134968 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6"] Sep 15 17:31:51.135573 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.135552 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 15 17:31:51.136212 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.135816 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.136212 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.135840 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 15 17:31:51.136212 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.136077 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8p5cn\"" Sep 15 17:31:51.136631 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.136609 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph"] Sep 15 17:31:51.136765 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.136747 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6" Sep 15 17:31:51.138221 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.138159 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zvchl\"" Sep 15 17:31:51.138329 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.138244 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 15 17:31:51.140018 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.139982 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 15 17:31:51.140272 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.140235 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 15 17:31:51.140372 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.140272 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 15 17:31:51.140590 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.140541 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-qzlwj"] Sep 15 17:31:51.140674 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.140622 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 15 17:31:51.141192 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.140813 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 15 17:31:51.141192 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.140851 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 15 17:31:51.141192 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.141058 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 15 17:31:51.141192 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.141121 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 15 17:31:51.144840 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.144204 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph" Sep 15 17:31:51.151069 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.151037 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-d2v9j\"" Sep 15 17:31:51.151069 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.151064 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl"] Sep 15 17:31:51.151322 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.151072 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:31:51.153794 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.153529 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 15 17:31:51.153794 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.153550 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 15 17:31:51.153794 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.153690 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 15 17:31:51.154050 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.153812 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 15 17:31:51.154050 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.153827 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-76b4c8ff46-4fdtq"] Sep 15 17:31:51.154050 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.154007 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-n7q2k\"" Sep 15 17:31:51.154312 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.154291 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rqkhk\"" Sep 15 17:31:51.154394 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.154318 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 15 17:31:51.154449 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.154441 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 15 17:31:51.154502 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.154463 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 15 17:31:51.154829 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.154763 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" Sep 15 17:31:51.154964 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.154924 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 15 17:31:51.155551 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.155317 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 15 17:31:51.157985 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.157959 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-777b6b5f6d-g8cb2"] Sep 15 17:31:51.158101 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.157999 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q7tlz"] Sep 15 17:31:51.158101 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.158019 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-x96rj"] Sep 15 17:31:51.158101 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.158062 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6"] Sep 15 17:31:51.158260 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.158106 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-qzlwj"] Sep 15 17:31:51.158260 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.158127 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-2tq2k"] Sep 15 17:31:51.158931 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.158913 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:51.160768 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.160731 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qvf8k"] Sep 15 17:31:51.161352 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.161255 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-2tq2k" Sep 15 17:31:51.161910 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.161603 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5kn9b\"" Sep 15 17:31:51.161910 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.161691 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 15 17:31:51.161910 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.161814 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 15 17:31:51.162103 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.162042 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 15 17:31:51.162167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.162122 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 15 17:31:51.162474 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.162385 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 15 17:31:51.162661 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.162532 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4tjpg\"" Sep 15 17:31:51.162661 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.162560 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 15 17:31:51.162661 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.162608 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 15 17:31:51.162839 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.162767 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 15 17:31:51.162839 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.162772 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 15 17:31:51.164375 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.164182 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 15 17:31:51.164569 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.164546 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg"] Sep 15 17:31:51.164840 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.164825 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qvf8k" Sep 15 17:31:51.165796 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.165776 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 15 17:31:51.166272 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.166251 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bwphg\"" Sep 15 17:31:51.166935 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.166916 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw"] Sep 15 17:31:51.167020 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.166991 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:31:51.167683 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.167661 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 15 17:31:51.168063 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.168045 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 15 17:31:51.168171 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.168071 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 15 17:31:51.168340 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.168322 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v2qkh\"" Sep 15 17:31:51.170502 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.170142 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 15 17:31:51.170778 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.170537 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-666q6"] Sep 15 17:31:51.170778 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.170731 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" Sep 15 17:31:51.171523 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.171495 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 15 17:31:51.171746 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.171725 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rbtn9\"" Sep 15 17:31:51.174963 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.174938 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 15 17:31:51.175373 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.175347 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7q7rz\"" Sep 15 17:31:51.175470 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.175376 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 15 17:31:51.175641 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.175023 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 15 17:31:51.175987 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.175960 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-666q6" Sep 15 17:31:51.176592 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.175639 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-2tq2k"] Sep 15 17:31:51.176592 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.176294 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph"] Sep 15 17:31:51.176592 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.176332 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg"] Sep 15 17:31:51.176592 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.176355 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-666q6"] Sep 15 17:31:51.176592 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.176380 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 15 17:31:51.176592 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.176385 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl"] Sep 15 17:31:51.176592 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.176588 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qvf8k"] Sep 15 17:31:51.177021 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.176749 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76b4c8ff46-4fdtq"] Sep 15 17:31:51.179970 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.179945 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 15 17:31:51.180344 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.180285 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m99qw\"" Sep 15 17:31:51.180542 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.180523 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 15 17:31:51.180761 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.180736 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 15 17:31:51.182484 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.182461 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw"] Sep 15 17:31:51.237136 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237107 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bds9m\" (UniqueName: \"kubernetes.io/projected/d83e4858-93c2-45eb-9bd5-b70be1b0b965-kube-api-access-bds9m\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:51.237340 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237149 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:31:51.237340 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237191 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrwxg\" (UniqueName: \"kubernetes.io/projected/b9605bf3-fd4f-4659-b69d-b4698683fbad-kube-api-access-hrwxg\") pod \"kube-storage-version-migrator-operator-6c8f84f897-59jf6\" (UID: \"b9605bf3-fd4f-4659-b69d-b4698683fbad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6" Sep 15 17:31:51.237340 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237212 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb2f968d-aebe-461c-b000-e2196237c78f-cert\") pod \"ingress-canary-666q6\" (UID: \"bb2f968d-aebe-461c-b000-e2196237c78f\") " pod="openshift-ingress-canary/ingress-canary-666q6" Sep 15 17:31:51.237340 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-574jg\" (UID: \"472f8dc7-89fb-4761-b5cb-a114e0037550\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:31:51.237340 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm5m9\" (UniqueName: \"kubernetes.io/projected/8821da49-cabf-4590-ad24-19fb7b68fcbd-kube-api-access-pm5m9\") pod \"network-check-source-6f8b768455-2tq2k\" (UID: \"8821da49-cabf-4590-ad24-19fb7b68fcbd\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-2tq2k" Sep 15 17:31:51.237340 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/616628e3-7f4d-477e-9a66-29c031761648-serving-cert\") pod \"service-ca-operator-cf7c776b7-sfcph\" (UID: \"616628e3-7f4d-477e-9a66-29c031761648\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph" Sep 15 17:31:51.237627 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/010e5abf-f2d3-4060-97dc-21ce1136d961-trusted-ca\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.237627 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237406 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzsqp\" (UniqueName: \"kubernetes.io/projected/df742678-4924-49d7-a502-f2a24850b318-kube-api-access-zzsqp\") pod \"cluster-samples-operator-86499c89c4-f4kdl\" (UID: \"df742678-4924-49d7-a502-f2a24850b318\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" Sep 15 17:31:51.237627 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff23d4ac-6b19-456a-86b4-195197a89788-trusted-ca\") pod \"console-operator-696884fb9c-qzlwj\" (UID: \"ff23d4ac-6b19-456a-86b4-195197a89788\") " pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:31:51.237627 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237466 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:51.237627 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237488 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7625f3fc-9afb-4a69-87d1-4978d83ffad8-service-ca-bundle\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.237627 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237513 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.237627 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237548 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-f4kdl\" (UID: \"df742678-4924-49d7-a502-f2a24850b318\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" Sep 15 17:31:51.237627 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237597 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/010e5abf-f2d3-4060-97dc-21ce1136d961-ca-trust-extracted\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.237970 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237672 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:51.237970 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237700 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff23d4ac-6b19-456a-86b4-195197a89788-config\") pod \"console-operator-696884fb9c-qzlwj\" (UID: \"ff23d4ac-6b19-456a-86b4-195197a89788\") " pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:31:51.237970 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237723 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rzbrw\" (UID: \"553d3f2c-4029-44be-a0ca-8e26b8cf6478\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" Sep 15 17:31:51.237970 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237749 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8988q\" (UniqueName: \"kubernetes.io/projected/616628e3-7f4d-477e-9a66-29c031761648-kube-api-access-8988q\") pod \"service-ca-operator-cf7c776b7-sfcph\" (UID: \"616628e3-7f4d-477e-9a66-29c031761648\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph" Sep 15 17:31:51.237970 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237799 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plpbh\" (UniqueName: \"kubernetes.io/projected/7625f3fc-9afb-4a69-87d1-4978d83ffad8-kube-api-access-plpbh\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.237970 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237828 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zjh2\" (UniqueName: \"kubernetes.io/projected/472f8dc7-89fb-4761-b5cb-a114e0037550-kube-api-access-4zjh2\") pod \"cluster-monitoring-operator-6cd954b897-574jg\" (UID: \"472f8dc7-89fb-4761-b5cb-a114e0037550\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:31:51.237970 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237852 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksfnf\" (UniqueName: \"kubernetes.io/projected/bb2f968d-aebe-461c-b000-e2196237c78f-kube-api-access-ksfnf\") pod \"ingress-canary-666q6\" (UID: \"bb2f968d-aebe-461c-b000-e2196237c78f\") " pod="openshift-ingress-canary/ingress-canary-666q6" Sep 15 17:31:51.237970 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237896 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7625f3fc-9afb-4a69-87d1-4978d83ffad8-serving-cert\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.237970 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237921 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9605bf3-fd4f-4659-b69d-b4698683fbad-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-59jf6\" (UID: \"b9605bf3-fd4f-4659-b69d-b4698683fbad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6" Sep 15 17:31:51.237970 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.237962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/010e5abf-f2d3-4060-97dc-21ce1136d961-installation-pull-secrets\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.238420 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238007 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg7rh\" (UniqueName: \"kubernetes.io/projected/bcf3a972-2bdd-4ead-8482-0485ffb1101d-kube-api-access-mg7rh\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:31:51.238420 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs45d\" (UniqueName: \"kubernetes.io/projected/4aa95671-b9a0-4162-840b-46d8eaaf2506-kube-api-access-fs45d\") pod \"volume-data-source-validator-86695b7cc7-q7tlz\" (UID: \"4aa95671-b9a0-4162-840b-46d8eaaf2506\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q7tlz" Sep 15 17:31:51.238420 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238072 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9605bf3-fd4f-4659-b69d-b4698683fbad-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-59jf6\" (UID: \"b9605bf3-fd4f-4659-b69d-b4698683fbad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6" Sep 15 17:31:51.238420 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-default-certificate\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:51.238420 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238163 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcf3a972-2bdd-4ead-8482-0485ffb1101d-tmp-dir\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:31:51.238420 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238185 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/472f8dc7-89fb-4761-b5cb-a114e0037550-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-574jg\" (UID: \"472f8dc7-89fb-4761-b5cb-a114e0037550\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:31:51.238420 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff23d4ac-6b19-456a-86b4-195197a89788-serving-cert\") pod \"console-operator-696884fb9c-qzlwj\" (UID: \"ff23d4ac-6b19-456a-86b4-195197a89788\") " pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:31:51.238420 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-bound-sa-token\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.238420 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238318 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/553d3f2c-4029-44be-a0ca-8e26b8cf6478-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-rzbrw\" (UID: \"553d3f2c-4029-44be-a0ca-8e26b8cf6478\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" Sep 15 17:31:51.238420 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238349 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bcf3a972-2bdd-4ead-8482-0485ffb1101d-config-volume\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:31:51.238420 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238380 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-stats-auth\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:51.238420 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7625f3fc-9afb-4a69-87d1-4978d83ffad8-tmp\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.238823 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/616628e3-7f4d-477e-9a66-29c031761648-config\") pod \"service-ca-operator-cf7c776b7-sfcph\" (UID: \"616628e3-7f4d-477e-9a66-29c031761648\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph" Sep 15 17:31:51.238823 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238459 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7625f3fc-9afb-4a69-87d1-4978d83ffad8-snapshots\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.238823 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238492 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7625f3fc-9afb-4a69-87d1-4978d83ffad8-trusted-ca-bundle\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.238823 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238536 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv5k2\" (UniqueName: \"kubernetes.io/projected/ff23d4ac-6b19-456a-86b4-195197a89788-kube-api-access-rv5k2\") pod \"console-operator-696884fb9c-qzlwj\" (UID: \"ff23d4ac-6b19-456a-86b4-195197a89788\") " pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:31:51.238823 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238564 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/010e5abf-f2d3-4060-97dc-21ce1136d961-image-registry-private-configuration\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.238823 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238594 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmkvl\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-kube-api-access-qmkvl\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.238823 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.238624 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-certificates\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.339587 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.339550 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/010e5abf-f2d3-4060-97dc-21ce1136d961-ca-trust-extracted\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.339783 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.339605 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:51.339783 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.339628 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff23d4ac-6b19-456a-86b4-195197a89788-config\") pod \"console-operator-696884fb9c-qzlwj\" (UID: \"ff23d4ac-6b19-456a-86b4-195197a89788\") " pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:31:51.339783 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.339653 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rzbrw\" (UID: \"553d3f2c-4029-44be-a0ca-8e26b8cf6478\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" Sep 15 17:31:51.339783 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.339679 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8988q\" (UniqueName: \"kubernetes.io/projected/616628e3-7f4d-477e-9a66-29c031761648-kube-api-access-8988q\") pod \"service-ca-operator-cf7c776b7-sfcph\" (UID: \"616628e3-7f4d-477e-9a66-29c031761648\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph" Sep 15 17:31:51.339783 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.339706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plpbh\" (UniqueName: \"kubernetes.io/projected/7625f3fc-9afb-4a69-87d1-4978d83ffad8-kube-api-access-plpbh\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.339783 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.339729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zjh2\" (UniqueName: \"kubernetes.io/projected/472f8dc7-89fb-4761-b5cb-a114e0037550-kube-api-access-4zjh2\") pod \"cluster-monitoring-operator-6cd954b897-574jg\" (UID: \"472f8dc7-89fb-4761-b5cb-a114e0037550\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:31:51.339783 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.339765 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle podName:d83e4858-93c2-45eb-9bd5-b70be1b0b965 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:51.839743912 +0000 UTC m=+34.564562201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle") pod "router-default-76b4c8ff46-4fdtq" (UID: "d83e4858-93c2-45eb-9bd5-b70be1b0b965") : configmap references non-existent config key: service-ca.crt Sep 15 17:31:51.340167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.339788 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksfnf\" (UniqueName: \"kubernetes.io/projected/bb2f968d-aebe-461c-b000-e2196237c78f-kube-api-access-ksfnf\") pod \"ingress-canary-666q6\" (UID: \"bb2f968d-aebe-461c-b000-e2196237c78f\") " pod="openshift-ingress-canary/ingress-canary-666q6" Sep 15 17:31:51.340167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.339819 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7625f3fc-9afb-4a69-87d1-4978d83ffad8-serving-cert\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.340167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.339842 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9605bf3-fd4f-4659-b69d-b4698683fbad-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-59jf6\" (UID: \"b9605bf3-fd4f-4659-b69d-b4698683fbad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6" Sep 15 17:31:51.340167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.339866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/010e5abf-f2d3-4060-97dc-21ce1136d961-installation-pull-secrets\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.340167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.339913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg7rh\" (UniqueName: \"kubernetes.io/projected/bcf3a972-2bdd-4ead-8482-0485ffb1101d-kube-api-access-mg7rh\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:31:51.340167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.339939 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs45d\" (UniqueName: \"kubernetes.io/projected/4aa95671-b9a0-4162-840b-46d8eaaf2506-kube-api-access-fs45d\") pod \"volume-data-source-validator-86695b7cc7-q7tlz\" (UID: \"4aa95671-b9a0-4162-840b-46d8eaaf2506\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q7tlz" Sep 15 17:31:51.340167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.339963 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9605bf3-fd4f-4659-b69d-b4698683fbad-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-59jf6\" (UID: \"b9605bf3-fd4f-4659-b69d-b4698683fbad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6" Sep 15 17:31:51.340167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.339987 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-default-certificate\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:51.340167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcf3a972-2bdd-4ead-8482-0485ffb1101d-tmp-dir\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:31:51.340167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340018 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/010e5abf-f2d3-4060-97dc-21ce1136d961-ca-trust-extracted\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.340167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/472f8dc7-89fb-4761-b5cb-a114e0037550-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-574jg\" (UID: \"472f8dc7-89fb-4761-b5cb-a114e0037550\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:31:51.340167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340103 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff23d4ac-6b19-456a-86b4-195197a89788-serving-cert\") pod \"console-operator-696884fb9c-qzlwj\" (UID: \"ff23d4ac-6b19-456a-86b4-195197a89788\") " pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:31:51.340167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340140 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-bound-sa-token\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.340791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340184 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/553d3f2c-4029-44be-a0ca-8e26b8cf6478-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-rzbrw\" (UID: \"553d3f2c-4029-44be-a0ca-8e26b8cf6478\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" Sep 15 17:31:51.340791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340207 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bcf3a972-2bdd-4ead-8482-0485ffb1101d-config-volume\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:31:51.340791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-stats-auth\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:51.340791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340260 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7625f3fc-9afb-4a69-87d1-4978d83ffad8-tmp\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.340791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/616628e3-7f4d-477e-9a66-29c031761648-config\") pod \"service-ca-operator-cf7c776b7-sfcph\" (UID: \"616628e3-7f4d-477e-9a66-29c031761648\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph" Sep 15 17:31:51.340791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340313 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7625f3fc-9afb-4a69-87d1-4978d83ffad8-snapshots\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.340791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340339 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7625f3fc-9afb-4a69-87d1-4978d83ffad8-trusted-ca-bundle\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.340791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv5k2\" (UniqueName: \"kubernetes.io/projected/ff23d4ac-6b19-456a-86b4-195197a89788-kube-api-access-rv5k2\") pod \"console-operator-696884fb9c-qzlwj\" (UID: \"ff23d4ac-6b19-456a-86b4-195197a89788\") " pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:31:51.340791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/010e5abf-f2d3-4060-97dc-21ce1136d961-image-registry-private-configuration\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.340791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340428 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmkvl\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-kube-api-access-qmkvl\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.340791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-certificates\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.340791 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.340471 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 17:31:51.340791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340487 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bds9m\" (UniqueName: \"kubernetes.io/projected/d83e4858-93c2-45eb-9bd5-b70be1b0b965-kube-api-access-bds9m\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:51.340791 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.340522 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert podName:553d3f2c-4029-44be-a0ca-8e26b8cf6478 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:51.840506419 +0000 UTC m=+34.565324690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-rzbrw" (UID: "553d3f2c-4029-44be-a0ca-8e26b8cf6478") : secret "networking-console-plugin-cert" not found Sep 15 17:31:51.340791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:31:51.340791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrwxg\" (UniqueName: \"kubernetes.io/projected/b9605bf3-fd4f-4659-b69d-b4698683fbad-kube-api-access-hrwxg\") pod \"kube-storage-version-migrator-operator-6c8f84f897-59jf6\" (UID: \"b9605bf3-fd4f-4659-b69d-b4698683fbad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6" Sep 15 17:31:51.341577 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb2f968d-aebe-461c-b000-e2196237c78f-cert\") pod \"ingress-canary-666q6\" (UID: \"bb2f968d-aebe-461c-b000-e2196237c78f\") " pod="openshift-ingress-canary/ingress-canary-666q6" Sep 15 17:31:51.341577 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340642 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-574jg\" (UID: \"472f8dc7-89fb-4761-b5cb-a114e0037550\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:31:51.341577 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.340673 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm5m9\" (UniqueName: \"kubernetes.io/projected/8821da49-cabf-4590-ad24-19fb7b68fcbd-kube-api-access-pm5m9\") pod \"network-check-source-6f8b768455-2tq2k\" (UID: \"8821da49-cabf-4590-ad24-19fb7b68fcbd\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-2tq2k" Sep 15 17:31:51.341577 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.340885 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 17:31:51.341577 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.340945 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls podName:bcf3a972-2bdd-4ead-8482-0485ffb1101d nodeName:}" failed. No retries permitted until 2026-09-15 17:31:51.840928587 +0000 UTC m=+34.565746858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls") pod "dns-default-qvf8k" (UID: "bcf3a972-2bdd-4ead-8482-0485ffb1101d") : secret "dns-default-metrics-tls" not found Sep 15 17:31:51.341577 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.341425 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/472f8dc7-89fb-4761-b5cb-a114e0037550-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-574jg\" (UID: \"472f8dc7-89fb-4761-b5cb-a114e0037550\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:31:51.341577 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.341448 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/553d3f2c-4029-44be-a0ca-8e26b8cf6478-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-rzbrw\" (UID: \"553d3f2c-4029-44be-a0ca-8e26b8cf6478\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" Sep 15 17:31:51.341577 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.341472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/616628e3-7f4d-477e-9a66-29c031761648-serving-cert\") pod \"service-ca-operator-cf7c776b7-sfcph\" (UID: \"616628e3-7f4d-477e-9a66-29c031761648\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph" Sep 15 17:31:51.341577 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.341501 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/010e5abf-f2d3-4060-97dc-21ce1136d961-trusted-ca\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.341577 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.341538 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzsqp\" (UniqueName: \"kubernetes.io/projected/df742678-4924-49d7-a502-f2a24850b318-kube-api-access-zzsqp\") pod \"cluster-samples-operator-86499c89c4-f4kdl\" (UID: \"df742678-4924-49d7-a502-f2a24850b318\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" Sep 15 17:31:51.341577 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.341568 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff23d4ac-6b19-456a-86b4-195197a89788-trusted-ca\") pod \"console-operator-696884fb9c-qzlwj\" (UID: \"ff23d4ac-6b19-456a-86b4-195197a89788\") " pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:31:51.342117 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.341593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:51.342117 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.341616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7625f3fc-9afb-4a69-87d1-4978d83ffad8-service-ca-bundle\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.342117 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.341641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.342117 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.341668 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-f4kdl\" (UID: \"df742678-4924-49d7-a502-f2a24850b318\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" Sep 15 17:31:51.342117 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.341788 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 17:31:51.342117 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.341838 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls podName:df742678-4924-49d7-a502-f2a24850b318 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:51.841825051 +0000 UTC m=+34.566643319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-f4kdl" (UID: "df742678-4924-49d7-a502-f2a24850b318") : secret "samples-operator-tls" not found Sep 15 17:31:51.342405 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.342194 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 17:31:51.342405 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.342240 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls podName:472f8dc7-89fb-4761-b5cb-a114e0037550 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:51.84222634 +0000 UTC m=+34.567044621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-574jg" (UID: "472f8dc7-89fb-4761-b5cb-a114e0037550") : secret "cluster-monitoring-operator-tls" not found Sep 15 17:31:51.342628 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.342603 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7625f3fc-9afb-4a69-87d1-4978d83ffad8-tmp\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.342705 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.342606 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/010e5abf-f2d3-4060-97dc-21ce1136d961-trusted-ca\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.342759 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.342711 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff23d4ac-6b19-456a-86b4-195197a89788-trusted-ca\") pod \"console-operator-696884fb9c-qzlwj\" (UID: \"ff23d4ac-6b19-456a-86b4-195197a89788\") " pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:31:51.342818 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.342789 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 17:31:51.342874 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.342831 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs podName:d83e4858-93c2-45eb-9bd5-b70be1b0b965 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:51.842816666 +0000 UTC m=+34.567634938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs") pod "router-default-76b4c8ff46-4fdtq" (UID: "d83e4858-93c2-45eb-9bd5-b70be1b0b965") : secret "router-metrics-certs-default" not found Sep 15 17:31:51.343187 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.343162 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bcf3a972-2bdd-4ead-8482-0485ffb1101d-config-volume\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:31:51.343808 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.343310 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7625f3fc-9afb-4a69-87d1-4978d83ffad8-service-ca-bundle\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.343808 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.343407 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 17:31:51.343808 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.343422 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777b6b5f6d-g8cb2: secret "image-registry-tls" not found Sep 15 17:31:51.343808 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.343463 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls podName:010e5abf-f2d3-4060-97dc-21ce1136d961 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:51.843450033 +0000 UTC m=+34.568268317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls") pod "image-registry-777b6b5f6d-g8cb2" (UID: "010e5abf-f2d3-4060-97dc-21ce1136d961") : secret "image-registry-tls" not found Sep 15 17:31:51.343808 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.343552 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff23d4ac-6b19-456a-86b4-195197a89788-config\") pod \"console-operator-696884fb9c-qzlwj\" (UID: \"ff23d4ac-6b19-456a-86b4-195197a89788\") " pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:31:51.344141 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.343831 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcf3a972-2bdd-4ead-8482-0485ffb1101d-tmp-dir\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:31:51.344141 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.343856 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9605bf3-fd4f-4659-b69d-b4698683fbad-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-59jf6\" (UID: \"b9605bf3-fd4f-4659-b69d-b4698683fbad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6" Sep 15 17:31:51.344519 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.344495 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/616628e3-7f4d-477e-9a66-29c031761648-config\") pod \"service-ca-operator-cf7c776b7-sfcph\" (UID: \"616628e3-7f4d-477e-9a66-29c031761648\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph" Sep 15 17:31:51.345208 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.345189 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-certificates\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.345727 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.345700 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7625f3fc-9afb-4a69-87d1-4978d83ffad8-snapshots\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.346575 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.346525 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7625f3fc-9afb-4a69-87d1-4978d83ffad8-trusted-ca-bundle\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.347461 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.347434 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/010e5abf-f2d3-4060-97dc-21ce1136d961-installation-pull-secrets\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.347563 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.347531 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff23d4ac-6b19-456a-86b4-195197a89788-serving-cert\") pod \"console-operator-696884fb9c-qzlwj\" (UID: \"ff23d4ac-6b19-456a-86b4-195197a89788\") " pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:31:51.347951 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.347930 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-stats-auth\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:51.348034 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.347998 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb2f968d-aebe-461c-b000-e2196237c78f-cert\") pod \"ingress-canary-666q6\" (UID: \"bb2f968d-aebe-461c-b000-e2196237c78f\") " pod="openshift-ingress-canary/ingress-canary-666q6" Sep 15 17:31:51.348323 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.348294 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9605bf3-fd4f-4659-b69d-b4698683fbad-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-59jf6\" (UID: \"b9605bf3-fd4f-4659-b69d-b4698683fbad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6" Sep 15 17:31:51.348619 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.348594 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/010e5abf-f2d3-4060-97dc-21ce1136d961-image-registry-private-configuration\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.348719 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.348597 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7625f3fc-9afb-4a69-87d1-4978d83ffad8-serving-cert\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.349031 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.349006 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-default-certificate\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:51.350427 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.350407 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/616628e3-7f4d-477e-9a66-29c031761648-serving-cert\") pod \"service-ca-operator-cf7c776b7-sfcph\" (UID: \"616628e3-7f4d-477e-9a66-29c031761648\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph" Sep 15 17:31:51.351465 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.351411 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8988q\" (UniqueName: \"kubernetes.io/projected/616628e3-7f4d-477e-9a66-29c031761648-kube-api-access-8988q\") pod \"service-ca-operator-cf7c776b7-sfcph\" (UID: \"616628e3-7f4d-477e-9a66-29c031761648\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph" Sep 15 17:31:51.367380 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.367312 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg7rh\" (UniqueName: \"kubernetes.io/projected/bcf3a972-2bdd-4ead-8482-0485ffb1101d-kube-api-access-mg7rh\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:31:51.368213 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.368156 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzsqp\" (UniqueName: \"kubernetes.io/projected/df742678-4924-49d7-a502-f2a24850b318-kube-api-access-zzsqp\") pod \"cluster-samples-operator-86499c89c4-f4kdl\" (UID: \"df742678-4924-49d7-a502-f2a24850b318\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" Sep 15 17:31:51.369784 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.369760 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zjh2\" (UniqueName: \"kubernetes.io/projected/472f8dc7-89fb-4761-b5cb-a114e0037550-kube-api-access-4zjh2\") pod \"cluster-monitoring-operator-6cd954b897-574jg\" (UID: \"472f8dc7-89fb-4761-b5cb-a114e0037550\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:31:51.370840 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.370813 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plpbh\" (UniqueName: \"kubernetes.io/projected/7625f3fc-9afb-4a69-87d1-4978d83ffad8-kube-api-access-plpbh\") pod \"insights-operator-5844b856db-x96rj\" (UID: \"7625f3fc-9afb-4a69-87d1-4978d83ffad8\") " pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.371340 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.371281 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrwxg\" (UniqueName: \"kubernetes.io/projected/b9605bf3-fd4f-4659-b69d-b4698683fbad-kube-api-access-hrwxg\") pod \"kube-storage-version-migrator-operator-6c8f84f897-59jf6\" (UID: \"b9605bf3-fd4f-4659-b69d-b4698683fbad\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6" Sep 15 17:31:51.371449 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.371428 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs45d\" (UniqueName: \"kubernetes.io/projected/4aa95671-b9a0-4162-840b-46d8eaaf2506-kube-api-access-fs45d\") pod \"volume-data-source-validator-86695b7cc7-q7tlz\" (UID: \"4aa95671-b9a0-4162-840b-46d8eaaf2506\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q7tlz" Sep 15 17:31:51.371524 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.371468 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksfnf\" (UniqueName: \"kubernetes.io/projected/bb2f968d-aebe-461c-b000-e2196237c78f-kube-api-access-ksfnf\") pod \"ingress-canary-666q6\" (UID: \"bb2f968d-aebe-461c-b000-e2196237c78f\") " pod="openshift-ingress-canary/ingress-canary-666q6" Sep 15 17:31:51.371739 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.371714 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv5k2\" (UniqueName: \"kubernetes.io/projected/ff23d4ac-6b19-456a-86b4-195197a89788-kube-api-access-rv5k2\") pod \"console-operator-696884fb9c-qzlwj\" (UID: \"ff23d4ac-6b19-456a-86b4-195197a89788\") " pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:31:51.371918 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.371901 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-bound-sa-token\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.372531 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.372508 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bds9m\" (UniqueName: \"kubernetes.io/projected/d83e4858-93c2-45eb-9bd5-b70be1b0b965-kube-api-access-bds9m\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:51.372670 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.372645 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmkvl\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-kube-api-access-qmkvl\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.374261 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.374219 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm5m9\" (UniqueName: \"kubernetes.io/projected/8821da49-cabf-4590-ad24-19fb7b68fcbd-kube-api-access-pm5m9\") pod \"network-check-source-6f8b768455-2tq2k\" (UID: \"8821da49-cabf-4590-ad24-19fb7b68fcbd\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-2tq2k" Sep 15 17:31:51.465717 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.465678 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q7tlz" Sep 15 17:31:51.478153 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.478120 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-x96rj" Sep 15 17:31:51.486888 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.486855 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6" Sep 15 17:31:51.493955 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.493688 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph" Sep 15 17:31:51.501564 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.501528 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:31:51.523747 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.523303 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-2tq2k" Sep 15 17:31:51.558059 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.555519 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-666q6" Sep 15 17:31:51.746204 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.746173 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:31:51.748969 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.748758 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-db4xp\"" Sep 15 17:31:51.783327 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.783286 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q7tlz"] Sep 15 17:31:51.786512 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.786447 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-x96rj"] Sep 15 17:31:51.788419 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:51.788390 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa95671_b9a0_4162_840b_46d8eaaf2506.slice/crio-c43ea648e6b29e80fbdc42d30999197637656a6233f5f2fb36d89065bbbb9ed5 WatchSource:0}: Error finding container c43ea648e6b29e80fbdc42d30999197637656a6233f5f2fb36d89065bbbb9ed5: Status 404 returned error can't find the container with id c43ea648e6b29e80fbdc42d30999197637656a6233f5f2fb36d89065bbbb9ed5 Sep 15 17:31:51.789054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.789028 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6"] Sep 15 17:31:51.790055 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:51.789932 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7625f3fc_9afb_4a69_87d1_4978d83ffad8.slice/crio-4b7bdf28cda28e4110e683ade6028357d456e354b9febaddae3b0772ec0f3f66 WatchSource:0}: Error finding container 4b7bdf28cda28e4110e683ade6028357d456e354b9febaddae3b0772ec0f3f66: Status 404 returned error can't find the container with id 4b7bdf28cda28e4110e683ade6028357d456e354b9febaddae3b0772ec0f3f66 Sep 15 17:31:51.792226 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:51.792196 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9605bf3_fd4f_4659_b69d_b4698683fbad.slice/crio-a2b8733b29ec5dbc46b906371bf55a18187bf7fa207d94cc45c51638e16cf434 WatchSource:0}: Error finding container a2b8733b29ec5dbc46b906371bf55a18187bf7fa207d94cc45c51638e16cf434: Status 404 returned error can't find the container with id a2b8733b29ec5dbc46b906371bf55a18187bf7fa207d94cc45c51638e16cf434 Sep 15 17:31:51.813612 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.813581 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph"] Sep 15 17:31:51.816504 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:51.816478 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616628e3_7f4d_477e_9a66_29c031761648.slice/crio-b339e127cbd508d93fdf86c4a6eb6630326ddb16a74f7be1bf93a1b28b2904d6 WatchSource:0}: Error finding container b339e127cbd508d93fdf86c4a6eb6630326ddb16a74f7be1bf93a1b28b2904d6: Status 404 returned error can't find the container with id b339e127cbd508d93fdf86c4a6eb6630326ddb16a74f7be1bf93a1b28b2904d6 Sep 15 17:31:51.823645 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.823617 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-qzlwj"] Sep 15 17:31:51.843515 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.843483 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-2tq2k"] Sep 15 17:31:51.846541 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.846513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:51.846660 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.846548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rzbrw\" (UID: \"553d3f2c-4029-44be-a0ca-8e26b8cf6478\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" Sep 15 17:31:51.846660 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.846622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:31:51.846660 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.846651 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-574jg\" (UID: \"472f8dc7-89fb-4761-b5cb-a114e0037550\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:31:51.846836 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.846675 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:51.846836 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.846696 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle podName:d83e4858-93c2-45eb-9bd5-b70be1b0b965 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:52.846673047 +0000 UTC m=+35.571491319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle") pod "router-default-76b4c8ff46-4fdtq" (UID: "d83e4858-93c2-45eb-9bd5-b70be1b0b965") : configmap references non-existent config key: service-ca.crt Sep 15 17:31:51.846836 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.846737 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 17:31:51.846836 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.846747 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:51.846836 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.846737 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 17:31:51.846836 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.846796 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 17:31:51.846836 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.846819 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 17:31:51.846836 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.846828 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777b6b5f6d-g8cb2: secret "image-registry-tls" not found Sep 15 17:31:51.846836 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.846737 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 17:31:51.847283 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.846779 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls podName:bcf3a972-2bdd-4ead-8482-0485ffb1101d nodeName:}" failed. No retries permitted until 2026-09-15 17:31:52.846767156 +0000 UTC m=+35.571585443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls") pod "dns-default-qvf8k" (UID: "bcf3a972-2bdd-4ead-8482-0485ffb1101d") : secret "dns-default-metrics-tls" not found Sep 15 17:31:51.847283 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.846885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-f4kdl\" (UID: \"df742678-4924-49d7-a502-f2a24850b318\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" Sep 15 17:31:51.847283 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.846933 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 17:31:51.847283 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.846947 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs podName:d83e4858-93c2-45eb-9bd5-b70be1b0b965 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:52.846930066 +0000 UTC m=+35.571748349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs") pod "router-default-76b4c8ff46-4fdtq" (UID: "d83e4858-93c2-45eb-9bd5-b70be1b0b965") : secret "router-metrics-certs-default" not found Sep 15 17:31:51.847283 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.846966 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls podName:472f8dc7-89fb-4761-b5cb-a114e0037550 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:52.846955577 +0000 UTC m=+35.571773860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-574jg" (UID: "472f8dc7-89fb-4761-b5cb-a114e0037550") : secret "cluster-monitoring-operator-tls" not found Sep 15 17:31:51.847283 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.846978 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls podName:010e5abf-f2d3-4060-97dc-21ce1136d961 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:52.846973048 +0000 UTC m=+35.571791316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls") pod "image-registry-777b6b5f6d-g8cb2" (UID: "010e5abf-f2d3-4060-97dc-21ce1136d961") : secret "image-registry-tls" not found Sep 15 17:31:51.847283 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.846995 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert podName:553d3f2c-4029-44be-a0ca-8e26b8cf6478 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:52.84698931 +0000 UTC m=+35.571807578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-rzbrw" (UID: "553d3f2c-4029-44be-a0ca-8e26b8cf6478") : secret "networking-console-plugin-cert" not found Sep 15 17:31:51.847283 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:51.847007 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls podName:df742678-4924-49d7-a502-f2a24850b318 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:52.847002701 +0000 UTC m=+35.571820970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-f4kdl" (UID: "df742678-4924-49d7-a502-f2a24850b318") : secret "samples-operator-tls" not found Sep 15 17:31:51.878423 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.878337 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-666q6"] Sep 15 17:31:51.913836 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.913799 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph" event={"ID":"616628e3-7f4d-477e-9a66-29c031761648","Type":"ContainerStarted","Data":"b339e127cbd508d93fdf86c4a6eb6630326ddb16a74f7be1bf93a1b28b2904d6"} Sep 15 17:31:51.915169 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.915125 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6" event={"ID":"b9605bf3-fd4f-4659-b69d-b4698683fbad","Type":"ContainerStarted","Data":"a2b8733b29ec5dbc46b906371bf55a18187bf7fa207d94cc45c51638e16cf434"} Sep 15 17:31:51.916406 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.916373 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-x96rj" event={"ID":"7625f3fc-9afb-4a69-87d1-4978d83ffad8","Type":"ContainerStarted","Data":"4b7bdf28cda28e4110e683ade6028357d456e354b9febaddae3b0772ec0f3f66"} Sep 15 17:31:51.917624 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:51.917599 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q7tlz" event={"ID":"4aa95671-b9a0-4162-840b-46d8eaaf2506","Type":"ContainerStarted","Data":"c43ea648e6b29e80fbdc42d30999197637656a6233f5f2fb36d89065bbbb9ed5"} Sep 15 17:31:52.746451 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:52.746414 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:31:52.747243 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:52.746462 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:31:52.749202 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:52.749037 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 15 17:31:52.749202 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:52.749047 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-296mp\"" Sep 15 17:31:52.749202 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:52.749112 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 15 17:31:52.857864 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:52.857829 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:31:52.858050 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:52.857873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-574jg\" (UID: \"472f8dc7-89fb-4761-b5cb-a114e0037550\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:31:52.858050 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:52.857919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:52.858050 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:52.857943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:52.858050 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:52.857961 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-f4kdl\" (UID: \"df742678-4924-49d7-a502-f2a24850b318\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" Sep 15 17:31:52.858050 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:52.858007 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:52.858050 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:52.858010 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 17:31:52.858050 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:52.858032 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 17:31:52.858050 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:52.858037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rzbrw\" (UID: \"553d3f2c-4029-44be-a0ca-8e26b8cf6478\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" Sep 15 17:31:52.858050 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:52.858054 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 17:31:52.858571 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:52.858069 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777b6b5f6d-g8cb2: secret "image-registry-tls" not found Sep 15 17:31:52.858571 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:52.858031 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 17:31:52.858571 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:52.858098 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls podName:472f8dc7-89fb-4761-b5cb-a114e0037550 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:54.858062744 +0000 UTC m=+37.582881029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-574jg" (UID: "472f8dc7-89fb-4761-b5cb-a114e0037550") : secret "cluster-monitoring-operator-tls" not found Sep 15 17:31:52.858571 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:52.858117 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 17:31:52.858571 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:52.858137 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 17:31:52.858571 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:52.858147 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs podName:d83e4858-93c2-45eb-9bd5-b70be1b0b965 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:54.858129871 +0000 UTC m=+37.582948154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs") pod "router-default-76b4c8ff46-4fdtq" (UID: "d83e4858-93c2-45eb-9bd5-b70be1b0b965") : secret "router-metrics-certs-default" not found Sep 15 17:31:52.858571 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:52.858172 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls podName:010e5abf-f2d3-4060-97dc-21ce1136d961 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:54.858158159 +0000 UTC m=+37.582976442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls") pod "image-registry-777b6b5f6d-g8cb2" (UID: "010e5abf-f2d3-4060-97dc-21ce1136d961") : secret "image-registry-tls" not found Sep 15 17:31:52.858571 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:52.858191 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls podName:bcf3a972-2bdd-4ead-8482-0485ffb1101d nodeName:}" failed. No retries permitted until 2026-09-15 17:31:54.858182148 +0000 UTC m=+37.583000425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls") pod "dns-default-qvf8k" (UID: "bcf3a972-2bdd-4ead-8482-0485ffb1101d") : secret "dns-default-metrics-tls" not found Sep 15 17:31:52.858571 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:52.858207 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls podName:df742678-4924-49d7-a502-f2a24850b318 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:54.858199445 +0000 UTC m=+37.583017717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-f4kdl" (UID: "df742678-4924-49d7-a502-f2a24850b318") : secret "samples-operator-tls" not found Sep 15 17:31:52.858571 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:52.858235 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert podName:553d3f2c-4029-44be-a0ca-8e26b8cf6478 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:54.85822891 +0000 UTC m=+37.583047185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-rzbrw" (UID: "553d3f2c-4029-44be-a0ca-8e26b8cf6478") : secret "networking-console-plugin-cert" not found Sep 15 17:31:52.858571 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:52.858246 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle podName:d83e4858-93c2-45eb-9bd5-b70be1b0b965 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:54.858240922 +0000 UTC m=+37.583059190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle") pod "router-default-76b4c8ff46-4fdtq" (UID: "d83e4858-93c2-45eb-9bd5-b70be1b0b965") : configmap references non-existent config key: service-ca.crt Sep 15 17:31:53.397300 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:53.397259 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb2f968d_aebe_461c_b000_e2196237c78f.slice/crio-b3647979c70d99d08af6ef36b3e8d5846ed81e2c4f213a591ad32bd5257037f4 WatchSource:0}: Error finding container b3647979c70d99d08af6ef36b3e8d5846ed81e2c4f213a591ad32bd5257037f4: Status 404 returned error can't find the container with id b3647979c70d99d08af6ef36b3e8d5846ed81e2c4f213a591ad32bd5257037f4 Sep 15 17:31:53.397789 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:53.397765 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff23d4ac_6b19_456a_86b4_195197a89788.slice/crio-67c6ca90321c46c3568c0162f968bf3f75557104b320c8f46b9a0dc585c0381e WatchSource:0}: Error finding container 67c6ca90321c46c3568c0162f968bf3f75557104b320c8f46b9a0dc585c0381e: Status 404 returned error can't find the container with id 67c6ca90321c46c3568c0162f968bf3f75557104b320c8f46b9a0dc585c0381e Sep 15 17:31:53.398932 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:31:53.398900 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8821da49_cabf_4590_ad24_19fb7b68fcbd.slice/crio-d42e94b0b0cb8da71eb0c46082dcc1273c8a5d0c3810d339477dec6e7631c46f WatchSource:0}: Error finding container d42e94b0b0cb8da71eb0c46082dcc1273c8a5d0c3810d339477dec6e7631c46f: Status 404 returned error can't find the container with id d42e94b0b0cb8da71eb0c46082dcc1273c8a5d0c3810d339477dec6e7631c46f Sep 15 17:31:53.934381 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:53.933616 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rb26f" event={"ID":"76e419fd-5854-4474-a4dd-324785d896bd","Type":"ContainerStarted","Data":"e8f0672dc7f65a071a9a8916e6cf58bd43628cc73141edea303086480d10e452"} Sep 15 17:31:53.937673 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:53.937584 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" event={"ID":"ff23d4ac-6b19-456a-86b4-195197a89788","Type":"ContainerStarted","Data":"67c6ca90321c46c3568c0162f968bf3f75557104b320c8f46b9a0dc585c0381e"} Sep 15 17:31:53.943861 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:53.943772 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-666q6" event={"ID":"bb2f968d-aebe-461c-b000-e2196237c78f","Type":"ContainerStarted","Data":"b3647979c70d99d08af6ef36b3e8d5846ed81e2c4f213a591ad32bd5257037f4"} Sep 15 17:31:53.946590 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:53.946518 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-2tq2k" event={"ID":"8821da49-cabf-4590-ad24-19fb7b68fcbd","Type":"ContainerStarted","Data":"d42e94b0b0cb8da71eb0c46082dcc1273c8a5d0c3810d339477dec6e7631c46f"} Sep 15 17:31:54.226020 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:54.225942 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:31:54.310448 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:54.310246 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:31:54.364933 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:54.364834 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:31:54.880798 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:54.880757 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:54.880998 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:54.880813 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rzbrw\" (UID: \"553d3f2c-4029-44be-a0ca-8e26b8cf6478\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" Sep 15 17:31:54.880998 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:54.880920 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:31:54.880998 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:54.880954 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-574jg\" (UID: \"472f8dc7-89fb-4761-b5cb-a114e0037550\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:31:54.880998 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:54.880989 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:54.881247 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:54.881016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:54.881247 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:54.881042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-f4kdl\" (UID: \"df742678-4924-49d7-a502-f2a24850b318\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" Sep 15 17:31:54.881247 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:54.881202 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 17:31:54.881390 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:54.881270 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls podName:df742678-4924-49d7-a502-f2a24850b318 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:58.881250037 +0000 UTC m=+41.606068310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-f4kdl" (UID: "df742678-4924-49d7-a502-f2a24850b318") : secret "samples-operator-tls" not found Sep 15 17:31:54.881898 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:54.881626 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 17:31:54.881898 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:54.881681 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 17:31:54.881898 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:54.881697 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls podName:472f8dc7-89fb-4761-b5cb-a114e0037550 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:58.881677003 +0000 UTC m=+41.606495288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-574jg" (UID: "472f8dc7-89fb-4761-b5cb-a114e0037550") : secret "cluster-monitoring-operator-tls" not found Sep 15 17:31:54.881898 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:54.881730 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs podName:d83e4858-93c2-45eb-9bd5-b70be1b0b965 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:58.881715823 +0000 UTC m=+41.606534099 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs") pod "router-default-76b4c8ff46-4fdtq" (UID: "d83e4858-93c2-45eb-9bd5-b70be1b0b965") : secret "router-metrics-certs-default" not found Sep 15 17:31:54.881898 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:54.881770 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle podName:d83e4858-93c2-45eb-9bd5-b70be1b0b965 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:58.881759037 +0000 UTC m=+41.606577328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle") pod "router-default-76b4c8ff46-4fdtq" (UID: "d83e4858-93c2-45eb-9bd5-b70be1b0b965") : configmap references non-existent config key: service-ca.crt Sep 15 17:31:54.881898 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:54.881805 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 17:31:54.881898 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:54.881809 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 17:31:54.881898 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:54.881823 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777b6b5f6d-g8cb2: secret "image-registry-tls" not found Sep 15 17:31:54.881898 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:54.881834 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 17:31:54.881898 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:54.881840 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert podName:553d3f2c-4029-44be-a0ca-8e26b8cf6478 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:58.88182847 +0000 UTC m=+41.606646770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-rzbrw" (UID: "553d3f2c-4029-44be-a0ca-8e26b8cf6478") : secret "networking-console-plugin-cert" not found Sep 15 17:31:54.881898 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:54.881860 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls podName:010e5abf-f2d3-4060-97dc-21ce1136d961 nodeName:}" failed. No retries permitted until 2026-09-15 17:31:58.881847256 +0000 UTC m=+41.606665555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls") pod "image-registry-777b6b5f6d-g8cb2" (UID: "010e5abf-f2d3-4060-97dc-21ce1136d961") : secret "image-registry-tls" not found Sep 15 17:31:54.881898 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:54.881876 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls podName:bcf3a972-2bdd-4ead-8482-0485ffb1101d nodeName:}" failed. No retries permitted until 2026-09-15 17:31:58.881868394 +0000 UTC m=+41.606686663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls") pod "dns-default-qvf8k" (UID: "bcf3a972-2bdd-4ead-8482-0485ffb1101d") : secret "dns-default-metrics-tls" not found Sep 15 17:31:54.957912 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:54.956831 2581 generic.go:356] "Generic (PLEG): container finished" podID="76e419fd-5854-4474-a4dd-324785d896bd" containerID="e8f0672dc7f65a071a9a8916e6cf58bd43628cc73141edea303086480d10e452" exitCode=0 Sep 15 17:31:54.957912 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:54.956918 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rb26f" event={"ID":"76e419fd-5854-4474-a4dd-324785d896bd","Type":"ContainerDied","Data":"e8f0672dc7f65a071a9a8916e6cf58bd43628cc73141edea303086480d10e452"} Sep 15 17:31:56.616744 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:56.616543 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:31:56.714015 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:56.713953 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:31:56.770506 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:56.770455 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:31:57.340665 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:57.340629 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:31:58.920245 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:58.920203 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:31:58.920692 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:58.920252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-574jg\" (UID: \"472f8dc7-89fb-4761-b5cb-a114e0037550\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:31:58.920692 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:58.920351 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 17:31:58.920692 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:58.920376 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 17:31:58.920692 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:58.920415 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls podName:472f8dc7-89fb-4761-b5cb-a114e0037550 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:06.920394529 +0000 UTC m=+49.645212815 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-574jg" (UID: "472f8dc7-89fb-4761-b5cb-a114e0037550") : secret "cluster-monitoring-operator-tls" not found Sep 15 17:31:58.920692 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:58.920438 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 17:31:58.920692 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:58.920445 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls podName:bcf3a972-2bdd-4ead-8482-0485ffb1101d nodeName:}" failed. No retries permitted until 2026-09-15 17:32:06.920424644 +0000 UTC m=+49.645242918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls") pod "dns-default-qvf8k" (UID: "bcf3a972-2bdd-4ead-8482-0485ffb1101d") : secret "dns-default-metrics-tls" not found Sep 15 17:31:58.920692 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:58.920379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:58.920692 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:58.920491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:31:58.920692 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:58.920529 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs podName:d83e4858-93c2-45eb-9bd5-b70be1b0b965 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:06.920507836 +0000 UTC m=+49.645326109 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs") pod "router-default-76b4c8ff46-4fdtq" (UID: "d83e4858-93c2-45eb-9bd5-b70be1b0b965") : secret "router-metrics-certs-default" not found Sep 15 17:31:58.920692 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:58.920541 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 17:31:58.920692 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:58.920552 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777b6b5f6d-g8cb2: secret "image-registry-tls" not found Sep 15 17:31:58.920692 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:58.920558 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-f4kdl\" (UID: \"df742678-4924-49d7-a502-f2a24850b318\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" Sep 15 17:31:58.920692 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:58.920588 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls podName:010e5abf-f2d3-4060-97dc-21ce1136d961 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:06.920574843 +0000 UTC m=+49.645393116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls") pod "image-registry-777b6b5f6d-g8cb2" (UID: "010e5abf-f2d3-4060-97dc-21ce1136d961") : secret "image-registry-tls" not found Sep 15 17:31:58.920692 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:58.920635 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 17:31:58.920692 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:58.920638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:31:58.920692 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:58.920678 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls podName:df742678-4924-49d7-a502-f2a24850b318 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:06.920669549 +0000 UTC m=+49.645487817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-f4kdl" (UID: "df742678-4924-49d7-a502-f2a24850b318") : secret "samples-operator-tls" not found Sep 15 17:31:58.921348 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:31:58.920672 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rzbrw\" (UID: \"553d3f2c-4029-44be-a0ca-8e26b8cf6478\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" Sep 15 17:31:58.921348 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:58.920728 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 17:31:58.921348 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:58.920762 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert podName:553d3f2c-4029-44be-a0ca-8e26b8cf6478 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:06.920752704 +0000 UTC m=+49.645570976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-rzbrw" (UID: "553d3f2c-4029-44be-a0ca-8e26b8cf6478") : secret "networking-console-plugin-cert" not found Sep 15 17:31:58.921348 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:31:58.920831 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle podName:d83e4858-93c2-45eb-9bd5-b70be1b0b965 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:06.920819865 +0000 UTC m=+49.645638135 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle") pod "router-default-76b4c8ff46-4fdtq" (UID: "d83e4858-93c2-45eb-9bd5-b70be1b0b965") : configmap references non-existent config key: service-ca.crt Sep 15 17:32:01.154746 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:01.154697 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:01.249021 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:01.248954 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:01.978692 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:01.978456 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph" event={"ID":"616628e3-7f4d-477e-9a66-29c031761648","Type":"ContainerStarted","Data":"fab46da205b25e235abef91e305185de93af7566c1f6333d3cac1d09f953fe3f"} Sep 15 17:32:01.980286 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:01.980250 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6" event={"ID":"b9605bf3-fd4f-4659-b69d-b4698683fbad","Type":"ContainerStarted","Data":"7d85252998880ed4579f73cefa269129651a51a0cd3e7ec047355bdf7b17a09e"} Sep 15 17:32:01.982181 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:01.982157 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-x96rj" event={"ID":"7625f3fc-9afb-4a69-87d1-4978d83ffad8","Type":"ContainerStarted","Data":"c922cb03cf73ae8775d2a90ccc88ec886e44a17a1712a0dd89536788c5bec41a"} Sep 15 17:32:01.983832 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:01.983812 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qzlwj_ff23d4ac-6b19-456a-86b4-195197a89788/console-operator/0.log" Sep 15 17:32:01.983948 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:01.983851 2581 generic.go:356] "Generic (PLEG): container finished" podID="ff23d4ac-6b19-456a-86b4-195197a89788" containerID="e7fc4cfb1ac4009dcadb124b2283caa035070d76d00e8f48faa65dc91e5a3d52" exitCode=255 Sep 15 17:32:01.983948 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:01.983931 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" event={"ID":"ff23d4ac-6b19-456a-86b4-195197a89788","Type":"ContainerDied","Data":"e7fc4cfb1ac4009dcadb124b2283caa035070d76d00e8f48faa65dc91e5a3d52"} Sep 15 17:32:01.984229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:01.984211 2581 scope.go:117] "RemoveContainer" containerID="e7fc4cfb1ac4009dcadb124b2283caa035070d76d00e8f48faa65dc91e5a3d52" Sep 15 17:32:01.986000 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:01.985952 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q7tlz" event={"ID":"4aa95671-b9a0-4162-840b-46d8eaaf2506","Type":"ContainerStarted","Data":"dcb28bd0bbb2e92cf383e9fbc2a04db6ffd04b24af7a8488bdecd2f47225be41"} Sep 15 17:32:01.987809 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:01.987783 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-666q6" event={"ID":"bb2f968d-aebe-461c-b000-e2196237c78f","Type":"ContainerStarted","Data":"afb25f812297d49bc9510b9b93435f47d6ab960adf06dd5a9273d8ff6efc0bdc"} Sep 15 17:32:01.989705 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:01.989511 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-2tq2k" event={"ID":"8821da49-cabf-4590-ad24-19fb7b68fcbd","Type":"ContainerStarted","Data":"aeb4aa159f2ff347a3fa4600475fe751c875493adcc6be8cccfc4558b620b4b4"} Sep 15 17:32:01.992875 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:01.992850 2581 generic.go:356] "Generic (PLEG): container finished" podID="76e419fd-5854-4474-a4dd-324785d896bd" containerID="46d0fa0c75c4f869f28e3abd715527d67f026992b16e3c45f88f7e8697d5e0f1" exitCode=0 Sep 15 17:32:01.993034 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:01.992891 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rb26f" event={"ID":"76e419fd-5854-4474-a4dd-324785d896bd","Type":"ContainerDied","Data":"46d0fa0c75c4f869f28e3abd715527d67f026992b16e3c45f88f7e8697d5e0f1"} Sep 15 17:32:01.996022 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:01.995974 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph" podStartSLOduration=33.780787676 podStartE2EDuration="42.995959014s" totalImagesPullingTime="9.215171338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:01.994400828 +0000 UTC m=+44.719219118" watchObservedRunningTime="2026-09-15 17:32:01.995959014 +0000 UTC m=+44.720777306" Sep 15 17:32:02.020695 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.019235 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-q7tlz" podStartSLOduration=34.021215674 podStartE2EDuration="43.019215175s" totalImagesPullingTime="8.997999501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:02.018666832 +0000 UTC m=+44.743485124" watchObservedRunningTime="2026-09-15 17:32:02.019215175 +0000 UTC m=+44.744033467" Sep 15 17:32:02.069916 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.069851 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-x96rj" podStartSLOduration=33.828303217 podStartE2EDuration="43.069828052s" totalImagesPullingTime="9.241524835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:02.068128137 +0000 UTC m=+44.792946429" watchObservedRunningTime="2026-09-15 17:32:02.069828052 +0000 UTC m=+44.794646344" Sep 15 17:32:02.089145 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.087298 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6" podStartSLOduration=33.848226535 podStartE2EDuration="43.087277749s" totalImagesPullingTime="9.239051214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:02.08695951 +0000 UTC m=+44.811777802" watchObservedRunningTime="2026-09-15 17:32:02.087277749 +0000 UTC m=+44.812096038" Sep 15 17:32:02.110502 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.110444 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-666q6" podStartSLOduration=3.476315557 podStartE2EDuration="11.110422815s" totalImagesPullingTime="7.634107258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:02.108861496 +0000 UTC m=+44.833679788" watchObservedRunningTime="2026-09-15 17:32:02.110422815 +0000 UTC m=+44.835241101" Sep 15 17:32:02.127231 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.126753 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-2tq2k" podStartSLOduration=35.483504717 podStartE2EDuration="43.126731704s" totalImagesPullingTime="7.643226987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:02.125460801 +0000 UTC m=+44.850279098" watchObservedRunningTime="2026-09-15 17:32:02.126731704 +0000 UTC m=+44.851549996" Sep 15 17:32:02.130673 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.130614 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:02.232684 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.232656 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:02.402687 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.402627 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:02.949886 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.949850 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nx5fj"] Sep 15 17:32:02.955544 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.955509 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:02.972372 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.972343 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nx5fj"] Sep 15 17:32:02.972554 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.972499 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:02.976768 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.976739 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 15 17:32:02.977026 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.976751 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 15 17:32:02.977175 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.976774 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m995r\"" Sep 15 17:32:02.999129 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.999104 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qzlwj_ff23d4ac-6b19-456a-86b4-195197a89788/console-operator/1.log" Sep 15 17:32:02.999645 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.999626 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qzlwj_ff23d4ac-6b19-456a-86b4-195197a89788/console-operator/0.log" Sep 15 17:32:02.999745 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.999672 2581 generic.go:356] "Generic (PLEG): container finished" podID="ff23d4ac-6b19-456a-86b4-195197a89788" containerID="1861c6e3b0b3b86b8df243e569f160b78696144757386a77ddf972ad439d33e5" exitCode=255 Sep 15 17:32:02.999798 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:02.999779 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" event={"ID":"ff23d4ac-6b19-456a-86b4-195197a89788","Type":"ContainerDied","Data":"1861c6e3b0b3b86b8df243e569f160b78696144757386a77ddf972ad439d33e5"} Sep 15 17:32:03.004287 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.004255 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rb26f" event={"ID":"76e419fd-5854-4474-a4dd-324785d896bd","Type":"ContainerStarted","Data":"3a83393a979ff5a6c19354fa40d11864b4c84a1a7fff146a364a82d8478007ad"} Sep 15 17:32:03.012363 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.012282 2581 scope.go:117] "RemoveContainer" containerID="e7fc4cfb1ac4009dcadb124b2283caa035070d76d00e8f48faa65dc91e5a3d52" Sep 15 17:32:03.012509 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.012408 2581 scope.go:117] "RemoveContainer" containerID="1861c6e3b0b3b86b8df243e569f160b78696144757386a77ddf972ad439d33e5" Sep 15 17:32:03.012695 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:03.012668 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-qzlwj_openshift-console-operator(ff23d4ac-6b19-456a-86b4-195197a89788)\"" pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" podUID="ff23d4ac-6b19-456a-86b4-195197a89788" Sep 15 17:32:03.044985 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.044944 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:03.163746 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.163713 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:03.164621 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.164583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkhjf\" (UniqueName: \"kubernetes.io/projected/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-api-access-gkhjf\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:03.164783 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.164675 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/584dd0af-72b6-4a59-93c9-0a948e9f0e12-crio-socket\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:03.164783 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.164707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:03.164904 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.164855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/584dd0af-72b6-4a59-93c9-0a948e9f0e12-data-volume\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:03.216262 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.216226 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:03.265995 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.265910 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkhjf\" (UniqueName: \"kubernetes.io/projected/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-api-access-gkhjf\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:03.265995 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.265948 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/584dd0af-72b6-4a59-93c9-0a948e9f0e12-crio-socket\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:03.265995 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.265969 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:03.266553 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.266031 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/584dd0af-72b6-4a59-93c9-0a948e9f0e12-data-volume\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:03.266553 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.266070 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:03.266553 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:03.266171 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 17:32:03.266553 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.266188 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/584dd0af-72b6-4a59-93c9-0a948e9f0e12-crio-socket\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:03.266553 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:03.266231 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 17:32:03.266553 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:03.266242 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls podName:584dd0af-72b6-4a59-93c9-0a948e9f0e12 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:03.766225396 +0000 UTC m=+46.491043684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nx5fj" (UID: "584dd0af-72b6-4a59-93c9-0a948e9f0e12") : secret "insights-runtime-extractor-tls" not found Sep 15 17:32:03.266553 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:03.266283 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-rbac-proxy-cm podName:584dd0af-72b6-4a59-93c9-0a948e9f0e12 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:03.766269352 +0000 UTC m=+46.491087621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nx5fj" (UID: "584dd0af-72b6-4a59-93c9-0a948e9f0e12") : configmap "kube-rbac-proxy" not found Sep 15 17:32:03.266553 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.266468 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/584dd0af-72b6-4a59-93c9-0a948e9f0e12-data-volume\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:03.275550 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.275518 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkhjf\" (UniqueName: \"kubernetes.io/projected/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-api-access-gkhjf\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:03.279140 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.279033 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:03.770699 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.770649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:03.770877 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:03.770756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:03.770877 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:03.770807 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 17:32:03.770877 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:03.770873 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls podName:584dd0af-72b6-4a59-93c9-0a948e9f0e12 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:04.77085783 +0000 UTC m=+47.495676099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nx5fj" (UID: "584dd0af-72b6-4a59-93c9-0a948e9f0e12") : secret "insights-runtime-extractor-tls" not found Sep 15 17:32:03.771035 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:03.770884 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 17:32:03.771035 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:03.770948 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-rbac-proxy-cm podName:584dd0af-72b6-4a59-93c9-0a948e9f0e12 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:04.770932465 +0000 UTC m=+47.495750752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nx5fj" (UID: "584dd0af-72b6-4a59-93c9-0a948e9f0e12") : configmap "kube-rbac-proxy" not found Sep 15 17:32:04.009104 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:04.009058 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qzlwj_ff23d4ac-6b19-456a-86b4-195197a89788/console-operator/1.log" Sep 15 17:32:04.009442 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:04.009427 2581 scope.go:117] "RemoveContainer" containerID="1861c6e3b0b3b86b8df243e569f160b78696144757386a77ddf972ad439d33e5" Sep 15 17:32:04.009596 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:04.009579 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-qzlwj_openshift-console-operator(ff23d4ac-6b19-456a-86b4-195197a89788)\"" pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" podUID="ff23d4ac-6b19-456a-86b4-195197a89788" Sep 15 17:32:04.027527 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:04.027434 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rb26f" podStartSLOduration=11.32245833 podStartE2EDuration="46.027416406s" totalImagesPullingTime="34.704958076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:31:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=1 observedRunningTime="2026-09-15 17:32:03.041135222 +0000 UTC m=+45.765953514" watchObservedRunningTime="2026-09-15 17:32:04.027416406 +0000 UTC m=+46.752234742" Sep 15 17:32:04.621762 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:04.621713 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:04.723541 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:04.723506 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:04.780874 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:04.780840 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:04.781023 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:04.780916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:04.781023 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:04.780991 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 17:32:04.781133 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:04.781040 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 17:32:04.781133 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:04.781056 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls podName:584dd0af-72b6-4a59-93c9-0a948e9f0e12 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:06.781040901 +0000 UTC m=+49.505859169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nx5fj" (UID: "584dd0af-72b6-4a59-93c9-0a948e9f0e12") : secret "insights-runtime-extractor-tls" not found Sep 15 17:32:04.781133 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:04.781126 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-rbac-proxy-cm podName:584dd0af-72b6-4a59-93c9-0a948e9f0e12 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:06.781108182 +0000 UTC m=+49.505926453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nx5fj" (UID: "584dd0af-72b6-4a59-93c9-0a948e9f0e12") : configmap "kube-rbac-proxy" not found Sep 15 17:32:04.912607 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:04.912535 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-btdt9_9a4c059e-96cd-4fef-bbce-0aed2fe62900/dns-node-resolver/0.log" Sep 15 17:32:05.565093 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:05.565056 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:05.911942 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:05.911914 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tncm8_a7df6635-4580-4cef-809a-46d2b81cbb5c/node-ca/0.log" Sep 15 17:32:06.512535 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:06.512508 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-666q6_bb2f968d-aebe-461c-b000-e2196237c78f/serve-healthcheck-canary/0.log" Sep 15 17:32:06.775719 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:06.775633 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:06.799672 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:06.799635 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:06.799763 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:06.799734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:06.799810 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:06.799797 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 17:32:06.799870 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:06.799851 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 17:32:06.799910 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:06.799874 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls podName:584dd0af-72b6-4a59-93c9-0a948e9f0e12 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:10.799857367 +0000 UTC m=+53.524675639 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nx5fj" (UID: "584dd0af-72b6-4a59-93c9-0a948e9f0e12") : secret "insights-runtime-extractor-tls" not found Sep 15 17:32:06.799910 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:06.799904 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-rbac-proxy-cm podName:584dd0af-72b6-4a59-93c9-0a948e9f0e12 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:10.799891156 +0000 UTC m=+53.524709425 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nx5fj" (UID: "584dd0af-72b6-4a59-93c9-0a948e9f0e12") : configmap "kube-rbac-proxy" not found Sep 15 17:32:06.875160 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:06.875121 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:07.001493 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:07.001453 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:32:07.001914 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:07.001506 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-574jg\" (UID: \"472f8dc7-89fb-4761-b5cb-a114e0037550\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:32:07.001914 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:07.001538 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:32:07.001914 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:07.001564 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:32:07.001914 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:07.001591 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-f4kdl\" (UID: \"df742678-4924-49d7-a502-f2a24850b318\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" Sep 15 17:32:07.001914 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:07.001608 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 17:32:07.001914 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:07.001622 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 17:32:07.001914 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:07.001650 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:32:07.001914 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:07.001679 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls podName:bcf3a972-2bdd-4ead-8482-0485ffb1101d nodeName:}" failed. No retries permitted until 2026-09-15 17:32:23.00165939 +0000 UTC m=+65.726477678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls") pod "dns-default-qvf8k" (UID: "bcf3a972-2bdd-4ead-8482-0485ffb1101d") : secret "dns-default-metrics-tls" not found Sep 15 17:32:07.001914 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:07.001690 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 17:32:07.001914 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:07.001716 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls podName:472f8dc7-89fb-4761-b5cb-a114e0037550 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:23.001706303 +0000 UTC m=+65.726524574 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-574jg" (UID: "472f8dc7-89fb-4761-b5cb-a114e0037550") : secret "cluster-monitoring-operator-tls" not found Sep 15 17:32:07.001914 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:07.001729 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 17:32:07.001914 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:07.001744 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-777b6b5f6d-g8cb2: secret "image-registry-tls" not found Sep 15 17:32:07.001914 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:07.001749 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs podName:d83e4858-93c2-45eb-9bd5-b70be1b0b965 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:23.001731828 +0000 UTC m=+65.726550098 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs") pod "router-default-76b4c8ff46-4fdtq" (UID: "d83e4858-93c2-45eb-9bd5-b70be1b0b965") : secret "router-metrics-certs-default" not found Sep 15 17:32:07.001914 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:07.001766 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 17:32:07.001914 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:07.001787 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls podName:010e5abf-f2d3-4060-97dc-21ce1136d961 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:23.001778174 +0000 UTC m=+65.726596449 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls") pod "image-registry-777b6b5f6d-g8cb2" (UID: "010e5abf-f2d3-4060-97dc-21ce1136d961") : secret "image-registry-tls" not found Sep 15 17:32:07.001914 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:07.001817 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 17:32:07.002522 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:07.001831 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls podName:df742678-4924-49d7-a502-f2a24850b318 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:23.001815894 +0000 UTC m=+65.726634167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-f4kdl" (UID: "df742678-4924-49d7-a502-f2a24850b318") : secret "samples-operator-tls" not found Sep 15 17:32:07.002522 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:07.001851 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert podName:553d3f2c-4029-44be-a0ca-8e26b8cf6478 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:23.001842307 +0000 UTC m=+65.726660575 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-rzbrw" (UID: "553d3f2c-4029-44be-a0ca-8e26b8cf6478") : secret "networking-console-plugin-cert" not found Sep 15 17:32:07.002522 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:07.001770 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rzbrw\" (UID: \"553d3f2c-4029-44be-a0ca-8e26b8cf6478\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" Sep 15 17:32:07.002522 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:07.001865 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle podName:d83e4858-93c2-45eb-9bd5-b70be1b0b965 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:23.001858212 +0000 UTC m=+65.726676487 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle") pod "router-default-76b4c8ff46-4fdtq" (UID: "d83e4858-93c2-45eb-9bd5-b70be1b0b965") : configmap references non-existent config key: service-ca.crt Sep 15 17:32:07.497657 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:07.497620 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:09.194452 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:09.194418 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:09.253997 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:09.253963 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:09.553199 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:09.553074 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:09.654787 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:09.654747 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:09.785501 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:09.785473 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:09.886253 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:09.886223 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:09.986490 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:09.986457 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:10.094876 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:10.094846 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:10.471328 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:10.471289 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:10.679945 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:10.679901 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:10.836324 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:10.836289 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:10.836458 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:10.836436 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:10.836458 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:10.836443 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 17:32:10.836570 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:10.836503 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls podName:584dd0af-72b6-4a59-93c9-0a948e9f0e12 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:18.836486646 +0000 UTC m=+61.561304915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nx5fj" (UID: "584dd0af-72b6-4a59-93c9-0a948e9f0e12") : secret "insights-runtime-extractor-tls" not found Sep 15 17:32:10.836948 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:10.836931 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/584dd0af-72b6-4a59-93c9-0a948e9f0e12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:11.502405 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:11.502370 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:32:11.502916 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:11.502432 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:32:11.502916 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:11.502819 2581 scope.go:117] "RemoveContainer" containerID="1861c6e3b0b3b86b8df243e569f160b78696144757386a77ddf972ad439d33e5" Sep 15 17:32:11.503001 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:11.502969 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-qzlwj_openshift-console-operator(ff23d4ac-6b19-456a-86b4-195197a89788)\"" pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" podUID="ff23d4ac-6b19-456a-86b4-195197a89788" Sep 15 17:32:11.677100 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:11.677051 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:12.071729 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:12.071687 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:12.289271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:12.289238 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:12.477479 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:12.477433 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:12.671036 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:12.671005 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:13.057449 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:13.057415 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:13.272304 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:13.272252 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:13.483300 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:13.483260 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:13.784204 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:13.784116 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:15.016682 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:15.016646 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:15.116390 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:15.116352 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:15.217635 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:15.217604 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:15.318746 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:15.318671 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:15.870735 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:15.870696 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:16.040694 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:16.040660 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:16.140827 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:16.140741 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:16.674002 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:16.673967 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:16.906143 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:16.906110 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ldm4p" Sep 15 17:32:17.272546 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:17.272514 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:17.476747 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:17.476716 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:17.669493 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:17.669456 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:18.076560 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:18.076472 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:18.520250 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:18.520219 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:18.912089 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:18.912044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:18.914494 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:18.914468 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/584dd0af-72b6-4a59-93c9-0a948e9f0e12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nx5fj\" (UID: \"584dd0af-72b6-4a59-93c9-0a948e9f0e12\") " pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:19.075329 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:19.075296 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:19.186039 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:19.185951 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m995r\"" Sep 15 17:32:19.193909 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:19.193881 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nx5fj" Sep 15 17:32:19.465113 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:19.465018 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nx5fj"] Sep 15 17:32:19.468028 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:32:19.467998 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod584dd0af_72b6_4a59_93c9_0a948e9f0e12.slice/crio-19de71772526c4f46507c3d68e3d66ac046148744dee3c51f8761453bca997ac WatchSource:0}: Error finding container 19de71772526c4f46507c3d68e3d66ac046148744dee3c51f8761453bca997ac: Status 404 returned error can't find the container with id 19de71772526c4f46507c3d68e3d66ac046148744dee3c51f8761453bca997ac Sep 15 17:32:19.678936 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:19.678893 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:19.871930 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:19.871895 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:20.060889 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:20.060856 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nx5fj" event={"ID":"584dd0af-72b6-4a59-93c9-0a948e9f0e12","Type":"ContainerStarted","Data":"501ffb7f1245e4d6e50b303d81939def387e507d7075839c3306bc1ba83b2f8a"} Sep 15 17:32:20.061040 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:20.060916 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nx5fj" event={"ID":"584dd0af-72b6-4a59-93c9-0a948e9f0e12","Type":"ContainerStarted","Data":"19de71772526c4f46507c3d68e3d66ac046148744dee3c51f8761453bca997ac"} Sep 15 17:32:20.096229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:20.096204 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:20.272389 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:20.272339 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:21.067434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:21.067398 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nx5fj" event={"ID":"584dd0af-72b6-4a59-93c9-0a948e9f0e12","Type":"ContainerStarted","Data":"144c041aee6bfb778888bb4035f8f453f70b046ab69d1fd428f25676f4344a49"} Sep 15 17:32:22.072832 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.072753 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nx5fj" event={"ID":"584dd0af-72b6-4a59-93c9-0a948e9f0e12","Type":"ContainerStarted","Data":"81b83415bc9d59948dd24d1c8e8af525043a110eb1834b3e7f74287e3a4408f7"} Sep 15 17:32:22.091051 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.090864 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nx5fj" podStartSLOduration=17.981086956 podStartE2EDuration="20.090841614s" totalImagesPullingTime="2.109754658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:32:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:22.089654117 +0000 UTC m=+64.814472407" watchObservedRunningTime="2026-09-15 17:32:22.090841614 +0000 UTC m=+64.815659906" Sep 15 17:32:22.444483 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.444445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret\") pod \"global-pull-secret-syncer-88jzz\" (UID: \"913d5e1b-5e80-4cda-8ceb-600f27b611fe\") " pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:32:22.444700 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.444629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs\") pod \"network-metrics-daemon-k7k2q\" (UID: \"dd17968b-99b4-4dcf-afd3-33e5bc160e72\") " pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:32:22.446915 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.446889 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 15 17:32:22.447048 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.446930 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 15 17:32:22.456936 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.456899 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd17968b-99b4-4dcf-afd3-33e5bc160e72-metrics-certs\") pod \"network-metrics-daemon-k7k2q\" (UID: \"dd17968b-99b4-4dcf-afd3-33e5bc160e72\") " pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:32:22.457072 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.456946 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/913d5e1b-5e80-4cda-8ceb-600f27b611fe-original-pull-secret\") pod \"global-pull-secret-syncer-88jzz\" (UID: \"913d5e1b-5e80-4cda-8ceb-600f27b611fe\") " pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:32:22.458944 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.458924 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-88jzz" Sep 15 17:32:22.467177 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.467155 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-296mp\"" Sep 15 17:32:22.475162 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.475137 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7k2q" Sep 15 17:32:22.545522 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.545487 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsr9r\" (UniqueName: \"kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r\") pod \"network-check-target-q6n92\" (UID: \"fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b\") " pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:32:22.550121 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.550036 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsr9r\" (UniqueName: \"kubernetes.io/projected/fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b-kube-api-access-tsr9r\") pod \"network-check-target-q6n92\" (UID: \"fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b\") " pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:32:22.660871 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.660842 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-db4xp\"" Sep 15 17:32:22.669665 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.669637 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:32:22.761173 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.760935 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-88jzz"] Sep 15 17:32:22.763452 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:32:22.763424 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod913d5e1b_5e80_4cda_8ceb_600f27b611fe.slice/crio-46fe6ab504061434cff5a9cc7573731dfc92568ec6ed6d544265ac35d39130a3 WatchSource:0}: Error finding container 46fe6ab504061434cff5a9cc7573731dfc92568ec6ed6d544265ac35d39130a3: Status 404 returned error can't find the container with id 46fe6ab504061434cff5a9cc7573731dfc92568ec6ed6d544265ac35d39130a3 Sep 15 17:32:22.771514 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.771489 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k7k2q"] Sep 15 17:32:22.777949 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:32:22.777922 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd17968b_99b4_4dcf_afd3_33e5bc160e72.slice/crio-66d7b2d12b15f96a622e0ebcd9c4edeb688446d3f2aa41a093f1ff3cee49ba0c WatchSource:0}: Error finding container 66d7b2d12b15f96a622e0ebcd9c4edeb688446d3f2aa41a093f1ff3cee49ba0c: Status 404 returned error can't find the container with id 66d7b2d12b15f96a622e0ebcd9c4edeb688446d3f2aa41a093f1ff3cee49ba0c Sep 15 17:32:22.939206 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:22.939182 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q6n92"] Sep 15 17:32:22.941859 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:32:22.941836 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7b9ab5_e04f_4c9e_b8b3_4f01d087bf1b.slice/crio-d37b9e9abe7b6ed4a51c41e1e4426a6dbe51f96a155da1716c4b3895e90e7540 WatchSource:0}: Error finding container d37b9e9abe7b6ed4a51c41e1e4426a6dbe51f96a155da1716c4b3895e90e7540: Status 404 returned error can't find the container with id d37b9e9abe7b6ed4a51c41e1e4426a6dbe51f96a155da1716c4b3895e90e7540 Sep 15 17:32:23.049780 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.049741 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:32:23.049780 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.049782 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:32:23.050059 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.049805 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-f4kdl\" (UID: \"df742678-4924-49d7-a502-f2a24850b318\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" Sep 15 17:32:23.050059 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.049839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:32:23.050059 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.049862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rzbrw\" (UID: \"553d3f2c-4029-44be-a0ca-8e26b8cf6478\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" Sep 15 17:32:23.050059 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.049926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:32:23.050059 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.049961 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-574jg\" (UID: \"472f8dc7-89fb-4761-b5cb-a114e0037550\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:32:23.050705 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.050677 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d83e4858-93c2-45eb-9bd5-b70be1b0b965-service-ca-bundle\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:32:23.052475 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.052444 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/553d3f2c-4029-44be-a0ca-8e26b8cf6478-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rzbrw\" (UID: \"553d3f2c-4029-44be-a0ca-8e26b8cf6478\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" Sep 15 17:32:23.052587 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.052537 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d83e4858-93c2-45eb-9bd5-b70be1b0b965-metrics-certs\") pod \"router-default-76b4c8ff46-4fdtq\" (UID: \"d83e4858-93c2-45eb-9bd5-b70be1b0b965\") " pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:32:23.052740 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.052721 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df742678-4924-49d7-a502-f2a24850b318-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-f4kdl\" (UID: \"df742678-4924-49d7-a502-f2a24850b318\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" Sep 15 17:32:23.052825 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.052802 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/472f8dc7-89fb-4761-b5cb-a114e0037550-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-574jg\" (UID: \"472f8dc7-89fb-4761-b5cb-a114e0037550\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:32:23.052950 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.052932 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls\") pod \"image-registry-777b6b5f6d-g8cb2\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:32:23.053173 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.053157 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bcf3a972-2bdd-4ead-8482-0485ffb1101d-metrics-tls\") pod \"dns-default-qvf8k\" (UID: \"bcf3a972-2bdd-4ead-8482-0485ffb1101d\") " pod="openshift-dns/dns-default-qvf8k" Sep 15 17:32:23.077590 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.077558 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q6n92" event={"ID":"fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b","Type":"ContainerStarted","Data":"1ae19540cb9537a3435e87de7e2efd2da6ad0be8635c7da3b3f13fd1c7c52464"} Sep 15 17:32:23.078007 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.077612 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q6n92" event={"ID":"fe7b9ab5-e04f-4c9e-b8b3-4f01d087bf1b","Type":"ContainerStarted","Data":"d37b9e9abe7b6ed4a51c41e1e4426a6dbe51f96a155da1716c4b3895e90e7540"} Sep 15 17:32:23.078007 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.077709 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:32:23.078760 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.078736 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k7k2q" event={"ID":"dd17968b-99b4-4dcf-afd3-33e5bc160e72","Type":"ContainerStarted","Data":"66d7b2d12b15f96a622e0ebcd9c4edeb688446d3f2aa41a093f1ff3cee49ba0c"} Sep 15 17:32:23.079765 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.079743 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-88jzz" event={"ID":"913d5e1b-5e80-4cda-8ceb-600f27b611fe","Type":"ContainerStarted","Data":"46fe6ab504061434cff5a9cc7573731dfc92568ec6ed6d544265ac35d39130a3"} Sep 15 17:32:23.091539 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.091478 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q6n92" podStartSLOduration=65.091457849 podStartE2EDuration="1m5.091457849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:23.091139109 +0000 UTC m=+65.815957403" watchObservedRunningTime="2026-09-15 17:32:23.091457849 +0000 UTC m=+65.816276142" Sep 15 17:32:23.255860 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.255772 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fkvsx\"" Sep 15 17:32:23.263634 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.263602 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:32:23.311455 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.311405 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5kn9b\"" Sep 15 17:32:23.317449 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.317424 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4tjpg\"" Sep 15 17:32:23.318936 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.318920 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" Sep 15 17:32:23.325818 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.325716 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:32:23.332413 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.332363 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v2qkh\"" Sep 15 17:32:23.339359 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.339336 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rbtn9\"" Sep 15 17:32:23.340350 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.340324 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qvf8k" Sep 15 17:32:23.347905 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.347879 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" Sep 15 17:32:23.349069 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.349049 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7q7rz\"" Sep 15 17:32:23.357462 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.357431 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" Sep 15 17:32:23.542873 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.542801 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-777b6b5f6d-g8cb2"] Sep 15 17:32:23.546248 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:32:23.546205 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010e5abf_f2d3_4060_97dc_21ce1136d961.slice/crio-4e7704746df7cd023cab93d38f51c7d40edb4b96d599cf7ec3971605e98e812a WatchSource:0}: Error finding container 4e7704746df7cd023cab93d38f51c7d40edb4b96d599cf7ec3971605e98e812a: Status 404 returned error can't find the container with id 4e7704746df7cd023cab93d38f51c7d40edb4b96d599cf7ec3971605e98e812a Sep 15 17:32:23.608440 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.608356 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl"] Sep 15 17:32:23.612015 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.611943 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76b4c8ff46-4fdtq"] Sep 15 17:32:23.615642 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:32:23.615608 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83e4858_93c2_45eb_9bd5_b70be1b0b965.slice/crio-3fe975002ddf095c032492dad075d35308edca5a5d16e26cddfb0b637906bcaf WatchSource:0}: Error finding container 3fe975002ddf095c032492dad075d35308edca5a5d16e26cddfb0b637906bcaf: Status 404 returned error can't find the container with id 3fe975002ddf095c032492dad075d35308edca5a5d16e26cddfb0b637906bcaf Sep 15 17:32:23.654667 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.654594 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw"] Sep 15 17:32:23.658817 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.658013 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qvf8k"] Sep 15 17:32:23.662343 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:23.660473 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg"] Sep 15 17:32:23.671495 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:32:23.671435 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod472f8dc7_89fb_4761_b5cb_a114e0037550.slice/crio-14b144f756fea5d420b6a7fa5b3801604e672b50bb738bf5f7d6e6eb9fa5a511 WatchSource:0}: Error finding container 14b144f756fea5d420b6a7fa5b3801604e672b50bb738bf5f7d6e6eb9fa5a511: Status 404 returned error can't find the container with id 14b144f756fea5d420b6a7fa5b3801604e672b50bb738bf5f7d6e6eb9fa5a511 Sep 15 17:32:24.088204 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:24.088121 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" event={"ID":"553d3f2c-4029-44be-a0ca-8e26b8cf6478","Type":"ContainerStarted","Data":"482a4c0125b47b15931a2e8cafd68d6e34146771aa1965edff6f2e4c8e60a942"} Sep 15 17:32:24.090996 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:24.090478 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" event={"ID":"010e5abf-f2d3-4060-97dc-21ce1136d961","Type":"ContainerStarted","Data":"07343e4d6c17c3a7b350c0eebc3c8ca746f6b5ff13b981326e01b13778cdf02c"} Sep 15 17:32:24.090996 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:24.090528 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" event={"ID":"010e5abf-f2d3-4060-97dc-21ce1136d961","Type":"ContainerStarted","Data":"4e7704746df7cd023cab93d38f51c7d40edb4b96d599cf7ec3971605e98e812a"} Sep 15 17:32:24.090996 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:24.090599 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:32:24.092096 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:24.092053 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" event={"ID":"472f8dc7-89fb-4761-b5cb-a114e0037550","Type":"ContainerStarted","Data":"14b144f756fea5d420b6a7fa5b3801604e672b50bb738bf5f7d6e6eb9fa5a511"} Sep 15 17:32:24.093764 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:24.093738 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" event={"ID":"df742678-4924-49d7-a502-f2a24850b318","Type":"ContainerStarted","Data":"bdc0ced203f7838bd55ac5454401b1196a2b7305e382ce3a917b325da1fea708"} Sep 15 17:32:24.095218 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:24.095190 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qvf8k" event={"ID":"bcf3a972-2bdd-4ead-8482-0485ffb1101d","Type":"ContainerStarted","Data":"6a5d78605b74aed6edc543f300d72e0ce82a0d57cc0dd0039295d20090449d02"} Sep 15 17:32:24.097435 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:24.097409 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" event={"ID":"d83e4858-93c2-45eb-9bd5-b70be1b0b965","Type":"ContainerStarted","Data":"bb36ef0785675103dcd3c29b6cf9c4dfa263b25a5fd3b858e3b6cd10aca89a8f"} Sep 15 17:32:24.097521 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:24.097456 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" event={"ID":"d83e4858-93c2-45eb-9bd5-b70be1b0b965","Type":"ContainerStarted","Data":"3fe975002ddf095c032492dad075d35308edca5a5d16e26cddfb0b637906bcaf"} Sep 15 17:32:24.109377 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:24.109312 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" podStartSLOduration=66.109288671 podStartE2EDuration="1m6.109288671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:24.108701492 +0000 UTC m=+66.833519795" watchObservedRunningTime="2026-09-15 17:32:24.109288671 +0000 UTC m=+66.834106963" Sep 15 17:32:24.125829 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:24.125620 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" podStartSLOduration=65.125595357 podStartE2EDuration="1m5.125595357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:24.124855082 +0000 UTC m=+66.849673373" watchObservedRunningTime="2026-09-15 17:32:24.125595357 +0000 UTC m=+66.850413648" Sep 15 17:32:24.199868 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:24.199827 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:24.300345 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:24.300279 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:24.326488 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:24.326208 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:32:24.336015 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:24.335780 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:32:25.106882 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:25.106790 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k7k2q" event={"ID":"dd17968b-99b4-4dcf-afd3-33e5bc160e72","Type":"ContainerStarted","Data":"2030685cbcd7bdfa59b1703d1ebcbc2e15bd58d60e033ae92b792cce3fcfea49"} Sep 15 17:32:25.107337 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:25.106917 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k7k2q" event={"ID":"dd17968b-99b4-4dcf-afd3-33e5bc160e72","Type":"ContainerStarted","Data":"6bad5074bb9601051451b623e7435829e26e7f0b3d88fc987f65490f506a59cc"} Sep 15 17:32:25.107337 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:25.106952 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:32:25.108691 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:25.108646 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-76b4c8ff46-4fdtq" Sep 15 17:32:25.124422 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:25.123845 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k7k2q" podStartSLOduration=65.720652275 podStartE2EDuration="1m7.123821196s" totalImagesPullingTime="1.403168921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:25.122041587 +0000 UTC m=+67.846859880" watchObservedRunningTime="2026-09-15 17:32:25.123821196 +0000 UTC m=+67.848639490" Sep 15 17:32:25.747229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:25.747181 2581 scope.go:117] "RemoveContainer" containerID="1861c6e3b0b3b86b8df243e569f160b78696144757386a77ddf972ad439d33e5" Sep 15 17:32:27.979406 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:27.979366 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:28.089313 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:28.089267 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:28.209652 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:28.209567 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:28.307949 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:28.307913 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:28.911266 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:28.911217 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:28.982467 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:28.982430 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:29.072679 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.072608 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:29.074929 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.074902 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mpdhd"] Sep 15 17:32:29.084437 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.084407 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mpdhd" Sep 15 17:32:29.086904 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.086877 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 15 17:32:29.087161 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.087139 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mpdhd"] Sep 15 17:32:29.087254 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.087206 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-v8wm6\"" Sep 15 17:32:29.123858 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.123754 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-88jzz" event={"ID":"913d5e1b-5e80-4cda-8ceb-600f27b611fe","Type":"ContainerStarted","Data":"faf2a03c8691d436427e9570927e23889edabe353b84553f0ddcb0240a0a92ca"} Sep 15 17:32:29.125910 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.125885 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qvf8k" event={"ID":"bcf3a972-2bdd-4ead-8482-0485ffb1101d","Type":"ContainerStarted","Data":"d8b3b6b38502f31fe882c8357998bb5bbce77797d9a6e5dbcd74b872e6105d0e"} Sep 15 17:32:29.126063 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.125937 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qvf8k" event={"ID":"bcf3a972-2bdd-4ead-8482-0485ffb1101d","Type":"ContainerStarted","Data":"b03fb386b0e86bd1d59ef077d4c7e1fbfe11a710d271061a1af4ed453eb717fd"} Sep 15 17:32:29.126063 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.126014 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qvf8k" Sep 15 17:32:29.127866 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.127842 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" event={"ID":"553d3f2c-4029-44be-a0ca-8e26b8cf6478","Type":"ContainerStarted","Data":"4d78842a7a20eb34c7f399b3bddff32e0eae8149a1901cd5c3d6e02b3b182594"} Sep 15 17:32:29.129908 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.129889 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qzlwj_ff23d4ac-6b19-456a-86b4-195197a89788/console-operator/1.log" Sep 15 17:32:29.130024 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.129969 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" event={"ID":"ff23d4ac-6b19-456a-86b4-195197a89788","Type":"ContainerStarted","Data":"d051495d920b2611cc32008be42058babf76a5f6ba8cc711a6c25e5f8c937843"} Sep 15 17:32:29.130441 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.130422 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:32:29.133720 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.132077 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" event={"ID":"472f8dc7-89fb-4761-b5cb-a114e0037550","Type":"ContainerStarted","Data":"30047f695be255eac3cebd65fc8bab6dd3d27b8cc261c4ac871a3c412885d2fa"} Sep 15 17:32:29.134496 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.134030 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" event={"ID":"df742678-4924-49d7-a502-f2a24850b318","Type":"ContainerStarted","Data":"a5ae7ec42a1f0a08041c9d3e538e9d4fb491156e941cb1ecc2551397ff294f4f"} Sep 15 17:32:29.134496 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.134073 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" event={"ID":"df742678-4924-49d7-a502-f2a24850b318","Type":"ContainerStarted","Data":"3ff2f47eef25ffe67697a02deef9b5a2f736b3fe4c8a226bfa573f048d871c52"} Sep 15 17:32:29.137712 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.137671 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-88jzz" podStartSLOduration=65.034643818 podStartE2EDuration="1m11.13765879s" totalImagesPullingTime="6.103014972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:29.13737486 +0000 UTC m=+71.862193224" watchObservedRunningTime="2026-09-15 17:32:29.13765879 +0000 UTC m=+71.862477071" Sep 15 17:32:29.152711 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.152648 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-574jg" podStartSLOduration=65.306125905 podStartE2EDuration="1m10.152632094s" totalImagesPullingTime="4.846506189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:29.152068025 +0000 UTC m=+71.876886311" watchObservedRunningTime="2026-09-15 17:32:29.152632094 +0000 UTC m=+71.877450382" Sep 15 17:32:29.166825 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.166772 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-f4kdl" podStartSLOduration=65.308842059 podStartE2EDuration="1m10.166752611s" totalImagesPullingTime="4.857910552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:29.166103798 +0000 UTC m=+71.890922089" watchObservedRunningTime="2026-09-15 17:32:29.166752611 +0000 UTC m=+71.891570901" Sep 15 17:32:29.180814 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.180753 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rzbrw" podStartSLOduration=60.326891659 podStartE2EDuration="1m5.180731737s" totalImagesPullingTime="4.853840078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:29.180073634 +0000 UTC m=+71.904891926" watchObservedRunningTime="2026-09-15 17:32:29.180731737 +0000 UTC m=+71.905550027" Sep 15 17:32:29.203529 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.203467 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" podStartSLOduration=62.569652714 podStartE2EDuration="1m10.203444165s" totalImagesPullingTime="7.633791451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:29.202641976 +0000 UTC m=+71.927460267" watchObservedRunningTime="2026-09-15 17:32:29.203444165 +0000 UTC m=+71.928262457" Sep 15 17:32:29.209124 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.209069 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3bed477f-ec85-4f99-b461-55e07e4cebeb-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-mpdhd\" (UID: \"3bed477f-ec85-4f99-b461-55e07e4cebeb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mpdhd" Sep 15 17:32:29.218557 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.218499 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qvf8k" podStartSLOduration=33.363607079 podStartE2EDuration="38.218478706s" totalImagesPullingTime="4.854871627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:31:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:29.218157689 +0000 UTC m=+71.942975983" watchObservedRunningTime="2026-09-15 17:32:29.218478706 +0000 UTC m=+71.943296998" Sep 15 17:32:29.245966 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.245936 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-qzlwj" Sep 15 17:32:29.283168 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.283132 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:29.309844 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.309804 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3bed477f-ec85-4f99-b461-55e07e4cebeb-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-mpdhd\" (UID: \"3bed477f-ec85-4f99-b461-55e07e4cebeb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mpdhd" Sep 15 17:32:29.310654 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:29.310624 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 15 17:32:29.310782 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:29.310716 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bed477f-ec85-4f99-b461-55e07e4cebeb-tls-certificates podName:3bed477f-ec85-4f99-b461-55e07e4cebeb nodeName:}" failed. No retries permitted until 2026-09-15 17:32:29.810695357 +0000 UTC m=+72.535513639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/3bed477f-ec85-4f99-b461-55e07e4cebeb-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-mpdhd" (UID: "3bed477f-ec85-4f99-b461-55e07e4cebeb") : secret "prometheus-operator-admission-webhook-tls" not found Sep 15 17:32:29.425510 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.425417 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:29.524111 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.524072 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:29.624596 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.624559 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:29.684268 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.684163 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:29.744060 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.744022 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:29.814839 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.814795 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3bed477f-ec85-4f99-b461-55e07e4cebeb-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-mpdhd\" (UID: \"3bed477f-ec85-4f99-b461-55e07e4cebeb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mpdhd" Sep 15 17:32:29.817405 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.817374 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3bed477f-ec85-4f99-b461-55e07e4cebeb-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-mpdhd\" (UID: \"3bed477f-ec85-4f99-b461-55e07e4cebeb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mpdhd" Sep 15 17:32:29.997465 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:29.997373 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mpdhd" Sep 15 17:32:30.098566 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:30.098527 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:30.154074 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:30.154039 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:30.306669 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:30.306509 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mpdhd"] Sep 15 17:32:30.309192 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:32:30.309157 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bed477f_ec85_4f99_b461_55e07e4cebeb.slice/crio-826203066ec40b482ddf9e91747b2e5f1442e02c8e96396c61da1b3238319b0f WatchSource:0}: Error finding container 826203066ec40b482ddf9e91747b2e5f1442e02c8e96396c61da1b3238319b0f: Status 404 returned error can't find the container with id 826203066ec40b482ddf9e91747b2e5f1442e02c8e96396c61da1b3238319b0f Sep 15 17:32:30.324921 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:30.324894 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:30.379147 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:30.379107 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:30.503535 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:30.503500 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:30.731359 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:30.731327 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:30.832342 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:30.832307 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:31.112762 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:31.112701 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:31.145153 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:31.145116 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mpdhd" event={"ID":"3bed477f-ec85-4f99-b461-55e07e4cebeb","Type":"ContainerStarted","Data":"826203066ec40b482ddf9e91747b2e5f1442e02c8e96396c61da1b3238319b0f"} Sep 15 17:32:31.304393 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:31.304357 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:31.358245 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:31.358208 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:32.133893 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:32.133854 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:32.234572 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:32.234538 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:32.930897 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:32.930866 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:32.994106 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:32.994055 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:33.154515 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:33.154482 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mpdhd" event={"ID":"3bed477f-ec85-4f99-b461-55e07e4cebeb","Type":"ContainerStarted","Data":"4c80f2f00e25307766c98e2bb2348f26e8f8551c8611c5e7eecbfe12255c5bfb"} Sep 15 17:32:33.154967 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:33.154679 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mpdhd" Sep 15 17:32:33.159618 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:33.159591 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mpdhd" Sep 15 17:32:33.170136 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:33.170070 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-mpdhd" podStartSLOduration=2.342746063 podStartE2EDuration="4.170053648s" totalImagesPullingTime="1.827307585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:33.168779687 +0000 UTC m=+75.893597994" watchObservedRunningTime="2026-09-15 17:32:33.170053648 +0000 UTC m=+75.894871939" Sep 15 17:32:34.097392 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:34.097354 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:34.177615 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:34.177578 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:34.748123 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:34.748069 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:35.886108 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:35.886064 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:36.940265 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:36.940238 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:37.040209 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:37.040172 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:37.247258 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:37.247174 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:37.348231 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:37.348201 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:39.141493 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.141460 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qvf8k" Sep 15 17:32:39.264296 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.264252 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:39.504606 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.504521 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:39.585836 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.585806 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x99kc"] Sep 15 17:32:39.589321 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.589301 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.591970 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.591947 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/751a9207-b3d5-437e-9830-1284e95c2fbd-root\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.592129 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.591975 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.592129 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.592013 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-tls\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.592225 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.592131 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/751a9207-b3d5-437e-9830-1284e95c2fbd-sys\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.592225 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.592165 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-wtmp\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.592225 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.592203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/751a9207-b3d5-437e-9830-1284e95c2fbd-metrics-client-ca\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.592511 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.592225 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-accelerators-collector-config\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.592511 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.592251 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9zkr\" (UniqueName: \"kubernetes.io/projected/751a9207-b3d5-437e-9830-1284e95c2fbd-kube-api-access-r9zkr\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.592511 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.592301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-textfile\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.594848 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.594824 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 15 17:32:39.595271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.595256 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 15 17:32:39.595535 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.595520 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-47d2r\"" Sep 15 17:32:39.596174 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.596140 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 15 17:32:39.598893 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.598830 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 15 17:32:39.619313 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.619282 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4"] Sep 15 17:32:39.622785 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.622763 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.630768 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.630747 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 15 17:32:39.631174 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.631159 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 15 17:32:39.631701 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.631684 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 15 17:32:39.631772 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.631710 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-r5m5g\"" Sep 15 17:32:39.639785 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.639759 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4"] Sep 15 17:32:39.658224 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.658190 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:39.693380 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.693341 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2038a5b6-96fa-4a05-814e-bed4c0321bab-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.693380 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.693383 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2038a5b6-96fa-4a05-814e-bed4c0321bab-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.693572 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.693421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-wtmp\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.693572 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.693459 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/751a9207-b3d5-437e-9830-1284e95c2fbd-metrics-client-ca\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.693572 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.693484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-accelerators-collector-config\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.693743 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.693604 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-wtmp\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.693743 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.693611 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9zkr\" (UniqueName: \"kubernetes.io/projected/751a9207-b3d5-437e-9830-1284e95c2fbd-kube-api-access-r9zkr\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.693743 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.693665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-textfile\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.693743 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.693704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/751a9207-b3d5-437e-9830-1284e95c2fbd-root\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.693743 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.693737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.693961 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.693762 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2038a5b6-96fa-4a05-814e-bed4c0321bab-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.693961 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.693812 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-tls\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.693961 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.693825 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/751a9207-b3d5-437e-9830-1284e95c2fbd-root\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.693961 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.693873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/751a9207-b3d5-437e-9830-1284e95c2fbd-sys\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.693961 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:39.693903 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 15 17:32:39.693961 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.693912 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-textfile\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.693961 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.693955 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/751a9207-b3d5-437e-9830-1284e95c2fbd-sys\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.694250 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:39.693999 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-tls podName:751a9207-b3d5-437e-9830-1284e95c2fbd nodeName:}" failed. No retries permitted until 2026-09-15 17:32:40.193979315 +0000 UTC m=+82.918797585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-tls") pod "node-exporter-x99kc" (UID: "751a9207-b3d5-437e-9830-1284e95c2fbd") : secret "node-exporter-tls" not found Sep 15 17:32:39.694250 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.694118 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-accelerators-collector-config\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.694250 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.694242 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/751a9207-b3d5-437e-9830-1284e95c2fbd-metrics-client-ca\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.696029 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.696008 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.711162 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.711134 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9zkr\" (UniqueName: \"kubernetes.io/projected/751a9207-b3d5-437e-9830-1284e95c2fbd-kube-api-access-r9zkr\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:39.754926 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.754738 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:39.794838 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.794806 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2038a5b6-96fa-4a05-814e-bed4c0321bab-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.795038 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.794886 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2038a5b6-96fa-4a05-814e-bed4c0321bab-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.795038 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.794915 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2038a5b6-96fa-4a05-814e-bed4c0321bab-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.795038 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.794984 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2038a5b6-96fa-4a05-814e-bed4c0321bab-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.795038 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.795026 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2038a5b6-96fa-4a05-814e-bed4c0321bab-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.795258 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.795106 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqk9t\" (UniqueName: \"kubernetes.io/projected/2038a5b6-96fa-4a05-814e-bed4c0321bab-kube-api-access-rqk9t\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.795435 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.795412 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2038a5b6-96fa-4a05-814e-bed4c0321bab-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.795664 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.795644 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2038a5b6-96fa-4a05-814e-bed4c0321bab-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.797467 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.797449 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2038a5b6-96fa-4a05-814e-bed4c0321bab-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.857910 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.857864 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:39.896060 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.896023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqk9t\" (UniqueName: \"kubernetes.io/projected/2038a5b6-96fa-4a05-814e-bed4c0321bab-kube-api-access-rqk9t\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.896243 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.896072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2038a5b6-96fa-4a05-814e-bed4c0321bab-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.896243 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.896168 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2038a5b6-96fa-4a05-814e-bed4c0321bab-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.896725 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.896700 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2038a5b6-96fa-4a05-814e-bed4c0321bab-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.898625 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.898599 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2038a5b6-96fa-4a05-814e-bed4c0321bab-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.904714 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.904686 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqk9t\" (UniqueName: \"kubernetes.io/projected/2038a5b6-96fa-4a05-814e-bed4c0321bab-kube-api-access-rqk9t\") pod \"kube-state-metrics-59fbdd77d-fxfw4\" (UID: \"2038a5b6-96fa-4a05-814e-bed4c0321bab\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.931595 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.931562 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" Sep 15 17:32:39.953716 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:39.953686 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:40.057565 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.057401 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:40.196403 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.196374 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:40.198541 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.198508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-tls\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:40.198652 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:40.198640 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 15 17:32:40.198709 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:40.198699 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-tls podName:751a9207-b3d5-437e-9830-1284e95c2fbd nodeName:}" failed. No retries permitted until 2026-09-15 17:32:41.198682924 +0000 UTC m=+83.923501193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-tls") pod "node-exporter-x99kc" (UID: "751a9207-b3d5-437e-9830-1284e95c2fbd") : secret "node-exporter-tls" not found Sep 15 17:32:40.205291 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.205246 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4"] Sep 15 17:32:40.208200 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:32:40.208166 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2038a5b6_96fa_4a05_814e_bed4c0321bab.slice/crio-4edcfb6b2da03429de15a683fc07f07da97d7ad8495c7d9e1dc889f029b90a39 WatchSource:0}: Error finding container 4edcfb6b2da03429de15a683fc07f07da97d7ad8495c7d9e1dc889f029b90a39: Status 404 returned error can't find the container with id 4edcfb6b2da03429de15a683fc07f07da97d7ad8495c7d9e1dc889f029b90a39 Sep 15 17:32:40.423321 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.423291 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:40.524363 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.524321 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:40.591362 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.591318 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 17:32:40.596151 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.596127 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.598753 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.598715 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 15 17:32:40.598753 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.598738 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 15 17:32:40.598956 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.598836 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 15 17:32:40.599015 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.598979 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 15 17:32:40.599015 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.599001 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 15 17:32:40.599134 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.599054 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 15 17:32:40.599257 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.599241 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 15 17:32:40.599437 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.599420 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gv7df\"" Sep 15 17:32:40.599532 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.599457 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 15 17:32:40.600064 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.600046 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 15 17:32:40.601109 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.601063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.601200 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.601176 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-config-volume\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.601200 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.601198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.601343 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.601217 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-config-out\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.601343 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.601249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.601343 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.601298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.601343 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.601318 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-web-config\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.601512 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.601357 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.601512 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.601410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.601512 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.601433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7q6v\" (UniqueName: \"kubernetes.io/projected/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-kube-api-access-q7q6v\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.601512 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.601467 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.601512 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.601495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.601670 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.601515 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.613543 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.613514 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 17:32:40.630380 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.630342 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:40.702580 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.702490 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.702580 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.702566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-config-volume\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.702799 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.702594 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.702799 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.702625 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-config-out\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.702799 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.702668 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.702799 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.702695 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.702799 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.702720 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-web-config\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.702799 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.702753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.703220 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.703189 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.703320 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.703232 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7q6v\" (UniqueName: \"kubernetes.io/projected/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-kube-api-access-q7q6v\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.703320 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.703274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.703320 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.703316 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.703474 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.703353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.703573 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.703547 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.703781 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:40.703763 2581 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 15 17:32:40.703856 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:40.703829 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-main-tls podName:ad3789aa-32ca-4160-9d2e-998fbfb0aa67 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:41.203809554 +0000 UTC m=+83.928627837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ad3789aa-32ca-4160-9d2e-998fbfb0aa67") : secret "alertmanager-main-tls" not found Sep 15 17:32:40.703951 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:40.703935 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-alertmanager-trusted-ca-bundle podName:ad3789aa-32ca-4160-9d2e-998fbfb0aa67 nodeName:}" failed. No retries permitted until 2026-09-15 17:32:41.203918301 +0000 UTC m=+83.928736577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ad3789aa-32ca-4160-9d2e-998fbfb0aa67") : configmap references non-existent config key: ca-bundle.crt Sep 15 17:32:40.704605 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.704582 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.705585 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.705558 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-config-out\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.705871 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.705848 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.706378 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.706353 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.706712 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.706687 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.707387 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.707360 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-web-config\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.707674 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.707653 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-config-volume\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.707858 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.707829 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.708469 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.708453 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:40.711522 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:40.711504 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7q6v\" (UniqueName: \"kubernetes.io/projected/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-kube-api-access-q7q6v\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:41.026333 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:41.026241 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:41.187769 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:41.187690 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" event={"ID":"2038a5b6-96fa-4a05-814e-bed4c0321bab","Type":"ContainerStarted","Data":"4edcfb6b2da03429de15a683fc07f07da97d7ad8495c7d9e1dc889f029b90a39"} Sep 15 17:32:41.208117 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:41.207519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-tls\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:41.208117 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:41.207574 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:41.208117 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:41.207626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:41.209796 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:41.209737 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:41.211599 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:41.211568 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:41.212422 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:41.212398 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/751a9207-b3d5-437e-9830-1284e95c2fbd-node-exporter-tls\") pod \"node-exporter-x99kc\" (UID: \"751a9207-b3d5-437e-9830-1284e95c2fbd\") " pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:41.213628 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:41.213597 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:41.312364 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:41.312280 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:41.398643 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:41.398601 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x99kc" Sep 15 17:32:41.506914 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:41.506878 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:32:41.639167 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:32:41.639134 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751a9207_b3d5_437e_9830_1284e95c2fbd.slice/crio-9ad2c89cda5af6eb795775ecfd517d4d31b56911965c9351a77b173225d4d200 WatchSource:0}: Error finding container 9ad2c89cda5af6eb795775ecfd517d4d31b56911965c9351a77b173225d4d200: Status 404 returned error can't find the container with id 9ad2c89cda5af6eb795775ecfd517d4d31b56911965c9351a77b173225d4d200 Sep 15 17:32:41.919763 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:41.919728 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 17:32:41.924583 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:32:41.924537 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3789aa_32ca_4160_9d2e_998fbfb0aa67.slice/crio-e59dcffa1cb7fd290fe366cbb186cca4e7e4fa56706fb706e2dae70f40dcf5c4 WatchSource:0}: Error finding container e59dcffa1cb7fd290fe366cbb186cca4e7e4fa56706fb706e2dae70f40dcf5c4: Status 404 returned error can't find the container with id e59dcffa1cb7fd290fe366cbb186cca4e7e4fa56706fb706e2dae70f40dcf5c4 Sep 15 17:32:42.193808 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:42.193663 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x99kc" event={"ID":"751a9207-b3d5-437e-9830-1284e95c2fbd","Type":"ContainerStarted","Data":"9ad2c89cda5af6eb795775ecfd517d4d31b56911965c9351a77b173225d4d200"} Sep 15 17:32:42.196007 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:42.195967 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad3789aa-32ca-4160-9d2e-998fbfb0aa67","Type":"ContainerStarted","Data":"e59dcffa1cb7fd290fe366cbb186cca4e7e4fa56706fb706e2dae70f40dcf5c4"} Sep 15 17:32:42.199432 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:42.199395 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" event={"ID":"2038a5b6-96fa-4a05-814e-bed4c0321bab","Type":"ContainerStarted","Data":"99c37e02138d1c25d216062d2367e23b5ca70b0ab51aea0db0c1b38e68ee48ea"} Sep 15 17:32:42.199568 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:42.199459 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" event={"ID":"2038a5b6-96fa-4a05-814e-bed4c0321bab","Type":"ContainerStarted","Data":"093692d9a890c6f6fac2b6f097457cc86a1b8879cc474381a16e47d2c2a3e2f6"} Sep 15 17:32:42.199568 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:42.199488 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" event={"ID":"2038a5b6-96fa-4a05-814e-bed4c0321bab","Type":"ContainerStarted","Data":"1ac13b1a53547de38490b84faaf443fd69cc24db69579cbffea1429c925297f9"} Sep 15 17:32:42.219748 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:42.219684 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-fxfw4" podStartSLOduration=1.747366975 podStartE2EDuration="3.219662203s" totalImagesPullingTime="1.472295228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:42.217799163 +0000 UTC m=+84.942617464" watchObservedRunningTime="2026-09-15 17:32:42.219662203 +0000 UTC m=+84.944480494" Sep 15 17:32:42.546711 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:42.546599 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:42.642898 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:42.642870 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:42.841928 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:42.841896 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:42.948611 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:42.948567 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:43.205860 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:43.205769 2581 generic.go:356] "Generic (PLEG): container finished" podID="751a9207-b3d5-437e-9830-1284e95c2fbd" containerID="dd199f84952eaf87fd470a9aee32377ec64407a360dbb382af3fd7b74e86fc19" exitCode=0 Sep 15 17:32:43.205860 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:43.205845 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x99kc" event={"ID":"751a9207-b3d5-437e-9830-1284e95c2fbd","Type":"ContainerDied","Data":"dd199f84952eaf87fd470a9aee32377ec64407a360dbb382af3fd7b74e86fc19"} Sep 15 17:32:44.213157 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.213118 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x99kc" event={"ID":"751a9207-b3d5-437e-9830-1284e95c2fbd","Type":"ContainerStarted","Data":"d2803af7fec8368adca87b497b0e65eeff6fa0a2d63de88dfb555bc5d78aa80e"} Sep 15 17:32:44.213694 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.213183 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x99kc" event={"ID":"751a9207-b3d5-437e-9830-1284e95c2fbd","Type":"ContainerStarted","Data":"87fa28b0c7a576fd0f519169a04d7b98932ed95a5d9e8b089e45a1b49520a374"} Sep 15 17:32:44.215017 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.214988 2581 generic.go:356] "Generic (PLEG): container finished" podID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerID="a41e406bd557b0810e388b93966970d010397c90f899aa6270f8f5e6b9e012b2" exitCode=0 Sep 15 17:32:44.215166 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.215026 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad3789aa-32ca-4160-9d2e-998fbfb0aa67","Type":"ContainerDied","Data":"a41e406bd557b0810e388b93966970d010397c90f899aa6270f8f5e6b9e012b2"} Sep 15 17:32:44.236783 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.236716 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x99kc" podStartSLOduration=4.184651352 podStartE2EDuration="5.236695561s" totalImagesPullingTime="984.619626ms" totalInitContainerRuntime="67.424583ms" isStatefulPod=true podCreationTimestamp="2026-09-15 17:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:44.235613204 +0000 UTC m=+86.960431497" watchObservedRunningTime="2026-09-15 17:32:44.236695561 +0000 UTC m=+86.961513853" Sep 15 17:32:44.267358 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.267326 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:44.274841 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.274809 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn"] Sep 15 17:32:44.278263 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.278237 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn" Sep 15 17:32:44.280375 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.280342 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 15 17:32:44.280514 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.280387 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-b5vb8\"" Sep 15 17:32:44.290605 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.290578 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn"] Sep 15 17:32:44.337291 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.337242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncr6k\" (UniqueName: \"kubernetes.io/projected/93dfb136-f81b-4602-825e-0c1ba00b3bbb-kube-api-access-ncr6k\") pod \"monitoring-plugin-5d85778b9d-jhhpn\" (UID: \"93dfb136-f81b-4602-825e-0c1ba00b3bbb\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn" Sep 15 17:32:44.337467 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.337323 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93dfb136-f81b-4602-825e-0c1ba00b3bbb-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-jhhpn\" (UID: \"93dfb136-f81b-4602-825e-0c1ba00b3bbb\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn" Sep 15 17:32:44.367566 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.367527 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:44.437736 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.437695 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncr6k\" (UniqueName: \"kubernetes.io/projected/93dfb136-f81b-4602-825e-0c1ba00b3bbb-kube-api-access-ncr6k\") pod \"monitoring-plugin-5d85778b9d-jhhpn\" (UID: \"93dfb136-f81b-4602-825e-0c1ba00b3bbb\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn" Sep 15 17:32:44.437895 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.437765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93dfb136-f81b-4602-825e-0c1ba00b3bbb-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-jhhpn\" (UID: \"93dfb136-f81b-4602-825e-0c1ba00b3bbb\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn" Sep 15 17:32:44.437895 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:44.437877 2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 15 17:32:44.437983 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:32:44.437934 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93dfb136-f81b-4602-825e-0c1ba00b3bbb-monitoring-plugin-cert podName:93dfb136-f81b-4602-825e-0c1ba00b3bbb nodeName:}" failed. No retries permitted until 2026-09-15 17:32:44.937916387 +0000 UTC m=+87.662734656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/93dfb136-f81b-4602-825e-0c1ba00b3bbb-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-jhhpn" (UID: "93dfb136-f81b-4602-825e-0c1ba00b3bbb") : secret "monitoring-plugin-cert" not found Sep 15 17:32:44.446131 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.446078 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncr6k\" (UniqueName: \"kubernetes.io/projected/93dfb136-f81b-4602-825e-0c1ba00b3bbb-kube-api-access-ncr6k\") pod \"monitoring-plugin-5d85778b9d-jhhpn\" (UID: \"93dfb136-f81b-4602-825e-0c1ba00b3bbb\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn" Sep 15 17:32:44.680346 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.680275 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:44.768911 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.768879 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-56f68b6ff9-vthbs"] Sep 15 17:32:44.772526 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.772504 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.774908 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.774881 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 15 17:32:44.775070 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.775051 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 15 17:32:44.775244 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.775099 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 15 17:32:44.775244 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.775143 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 15 17:32:44.775521 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.775504 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-dp5cq\"" Sep 15 17:32:44.775696 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.775683 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 15 17:32:44.781920 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.781891 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 15 17:32:44.786818 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.786778 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56f68b6ff9-vthbs"] Sep 15 17:32:44.841632 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.841588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-federate-client-tls\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.841829 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.841648 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.841829 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.841737 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-serving-certs-ca-bundle\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.841829 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.841807 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-secret-telemeter-client\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.841975 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.841891 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.841975 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.841932 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-metrics-client-ca\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.841975 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.841954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w6fn\" (UniqueName: \"kubernetes.io/projected/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-kube-api-access-5w6fn\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.842137 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.841991 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-telemeter-client-tls\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.942899 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.942802 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-federate-client-tls\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.942899 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.942856 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.942899 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.942889 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-serving-certs-ca-bundle\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.943218 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.942925 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-secret-telemeter-client\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.943218 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.942973 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93dfb136-f81b-4602-825e-0c1ba00b3bbb-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-jhhpn\" (UID: \"93dfb136-f81b-4602-825e-0c1ba00b3bbb\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn" Sep 15 17:32:44.943218 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.943009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.943218 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.943048 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-metrics-client-ca\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.943218 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.943070 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w6fn\" (UniqueName: \"kubernetes.io/projected/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-kube-api-access-5w6fn\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.943218 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.943127 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-telemeter-client-tls\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.943947 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.943872 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-metrics-client-ca\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.944072 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.943948 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.944163 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.944104 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-serving-certs-ca-bundle\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.945847 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.945818 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/93dfb136-f81b-4602-825e-0c1ba00b3bbb-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-jhhpn\" (UID: \"93dfb136-f81b-4602-825e-0c1ba00b3bbb\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn" Sep 15 17:32:44.945973 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.945879 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-telemeter-client-tls\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.945973 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.945897 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-federate-client-tls\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.946121 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.946069 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.946174 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.946156 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-secret-telemeter-client\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:44.951223 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:44.951196 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w6fn\" (UniqueName: \"kubernetes.io/projected/0ba5d08b-75b3-4a02-b6f6-f90a38969d7b-kube-api-access-5w6fn\") pod \"telemeter-client-56f68b6ff9-vthbs\" (UID: \"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b\") " pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:45.082669 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.082631 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" Sep 15 17:32:45.112123 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.112058 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:32:45.188248 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.188214 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn" Sep 15 17:32:45.374967 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.374886 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56f68b6ff9-vthbs"] Sep 15 17:32:45.379114 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:32:45.379063 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba5d08b_75b3_4a02_b6f6_f90a38969d7b.slice/crio-6f45412eb4a0558280377691ea9ac2f22fdd4a0e567b2fd258f169e5b69b188b WatchSource:0}: Error finding container 6f45412eb4a0558280377691ea9ac2f22fdd4a0e567b2fd258f169e5b69b188b: Status 404 returned error can't find the container with id 6f45412eb4a0558280377691ea9ac2f22fdd4a0e567b2fd258f169e5b69b188b Sep 15 17:32:45.389969 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.389902 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:45.462540 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.462498 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn"] Sep 15 17:32:45.464537 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.464505 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:45.465652 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:32:45.465622 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93dfb136_f81b_4602_825e_0c1ba00b3bbb.slice/crio-d7f7b4663f1d1254a66c91f92b9042b90303397b1a4fba969fc828e899b8ddb0 WatchSource:0}: Error finding container d7f7b4663f1d1254a66c91f92b9042b90303397b1a4fba969fc828e899b8ddb0: Status 404 returned error can't find the container with id d7f7b4663f1d1254a66c91f92b9042b90303397b1a4fba969fc828e899b8ddb0 Sep 15 17:32:45.778218 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.778134 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:32:45.782184 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.782156 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:45.782624 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.782607 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.785170 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.785143 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 15 17:32:45.785285 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.785263 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 15 17:32:45.785285 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.785271 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 15 17:32:45.785397 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.785332 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-apoi1i28rg727\"" Sep 15 17:32:45.785687 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.785672 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 15 17:32:45.785756 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.785745 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 15 17:32:45.785821 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.785798 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 15 17:32:45.786370 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.786062 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 15 17:32:45.786370 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.786113 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 15 17:32:45.786370 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.786140 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 15 17:32:45.786370 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.786163 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 15 17:32:45.786370 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.786163 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jjgjc\"" Sep 15 17:32:45.786370 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.786255 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 15 17:32:45.786370 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.786276 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 15 17:32:45.786752 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.786513 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 15 17:32:45.786752 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.786518 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 15 17:32:45.790414 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.790381 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 15 17:32:45.800289 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.800256 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:32:45.853753 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.853705 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/715225e9-64b5-4377-9c88-4b1501f661c6-config-out\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.853966 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.853796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.853966 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.853829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.853966 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.853860 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.853966 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.853930 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-web-config\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.854200 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.853984 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.854200 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.854012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.854200 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.854072 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.854200 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.854164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.854385 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.854210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/715225e9-64b5-4377-9c88-4b1501f661c6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.854385 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.854246 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.854385 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.854268 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqbm9\" (UniqueName: \"kubernetes.io/projected/715225e9-64b5-4377-9c88-4b1501f661c6-kube-api-access-pqbm9\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.854385 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.854302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.854385 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.854329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.854385 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.854360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.854635 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.854389 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.854635 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.854429 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.854635 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.854472 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-config\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.854635 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.854519 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.854635 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.854557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.955497 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.955497 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955500 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.955745 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.955745 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.955745 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/715225e9-64b5-4377-9c88-4b1501f661c6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.955745 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.955745 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955670 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqbm9\" (UniqueName: \"kubernetes.io/projected/715225e9-64b5-4377-9c88-4b1501f661c6-kube-api-access-pqbm9\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.955745 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.955745 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955724 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.955745 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955748 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.956167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.956167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955802 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.956167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955827 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-config\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.956167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.956167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955893 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.956167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955922 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/715225e9-64b5-4377-9c88-4b1501f661c6-config-out\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.956167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.955970 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.956167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.956001 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.956167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.956033 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.956167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.956121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-web-config\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.956634 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.956279 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.956742 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.956682 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.956956 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.956926 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.957378 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.957348 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.957378 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.957370 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.959982 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.959953 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.960101 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.960032 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.960178 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.960152 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/715225e9-64b5-4377-9c88-4b1501f661c6-config-out\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.960533 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.960487 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/715225e9-64b5-4377-9c88-4b1501f661c6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.960619 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.960543 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.961341 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.960983 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.961341 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.961250 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.961341 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.961287 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.961909 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.961877 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.962315 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.962286 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.963143 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.963077 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-config\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.963231 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.963195 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.963437 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.963414 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.964204 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.964184 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-web-config\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:45.965483 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:45.965465 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqbm9\" (UniqueName: \"kubernetes.io/projected/715225e9-64b5-4377-9c88-4b1501f661c6-kube-api-access-pqbm9\") pod \"prometheus-k8s-0\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:46.094559 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:46.094529 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:32:46.234031 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:46.233987 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn" event={"ID":"93dfb136-f81b-4602-825e-0c1ba00b3bbb","Type":"ContainerStarted","Data":"d7f7b4663f1d1254a66c91f92b9042b90303397b1a4fba969fc828e899b8ddb0"} Sep 15 17:32:46.235283 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:46.235248 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" event={"ID":"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b","Type":"ContainerStarted","Data":"6f45412eb4a0558280377691ea9ac2f22fdd4a0e567b2fd258f169e5b69b188b"} Sep 15 17:32:46.237174 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:46.237150 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad3789aa-32ca-4160-9d2e-998fbfb0aa67","Type":"ContainerStarted","Data":"43aa46cc9af41651d48f92f8399bd086b92dae5b4c757715264b96f66c5b0421"} Sep 15 17:32:46.381225 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:46.381191 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:32:46.383884 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:46.383548 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:46.384460 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:32:46.384432 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod715225e9_64b5_4377_9c88_4b1501f661c6.slice/crio-dc5082f0388247266caa83e8a67aa629b60382676c8a7a38cd2492f6e6b19fb9 WatchSource:0}: Error finding container dc5082f0388247266caa83e8a67aa629b60382676c8a7a38cd2492f6e6b19fb9: Status 404 returned error can't find the container with id dc5082f0388247266caa83e8a67aa629b60382676c8a7a38cd2492f6e6b19fb9 Sep 15 17:32:46.434363 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:46.434326 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:47.247763 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:47.247720 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad3789aa-32ca-4160-9d2e-998fbfb0aa67","Type":"ContainerStarted","Data":"f417455fecfb4f9e81e22301b855808c5ebf0961e12f7e5f8d9b83354819c859"} Sep 15 17:32:47.247962 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:47.247814 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad3789aa-32ca-4160-9d2e-998fbfb0aa67","Type":"ContainerStarted","Data":"9c8e3a5d4932e6e793693481105af3f23034eb115f96aa7765450513010a4a08"} Sep 15 17:32:47.247962 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:47.247846 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad3789aa-32ca-4160-9d2e-998fbfb0aa67","Type":"ContainerStarted","Data":"3d570c442f1fb008178422a09dc574ab537e544598b08933e008e695fd28b6f3"} Sep 15 17:32:47.247962 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:47.247902 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad3789aa-32ca-4160-9d2e-998fbfb0aa67","Type":"ContainerStarted","Data":"c213e2b89e299f8013e860f71393dadf4350f8d976d593d8cb4e32a9e0fba8b5"} Sep 15 17:32:47.250248 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:47.250180 2581 generic.go:356] "Generic (PLEG): container finished" podID="715225e9-64b5-4377-9c88-4b1501f661c6" containerID="bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89" exitCode=0 Sep 15 17:32:47.250248 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:47.250223 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"715225e9-64b5-4377-9c88-4b1501f661c6","Type":"ContainerDied","Data":"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89"} Sep 15 17:32:47.250424 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:47.250288 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"715225e9-64b5-4377-9c88-4b1501f661c6","Type":"ContainerStarted","Data":"dc5082f0388247266caa83e8a67aa629b60382676c8a7a38cd2492f6e6b19fb9"} Sep 15 17:32:48.259817 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:48.259721 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:48.264934 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:48.264896 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn" event={"ID":"93dfb136-f81b-4602-825e-0c1ba00b3bbb","Type":"ContainerStarted","Data":"75069e91ba392a51a6da5fa3e84b558477cd1ef10d96aa422d5d84ac2f53c8bc"} Sep 15 17:32:48.265264 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:48.265243 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn" Sep 15 17:32:48.268048 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:48.268019 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" event={"ID":"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b","Type":"ContainerStarted","Data":"cd84407e28d7e5c123dbdb59d25ffc9caed12edbfb378cb200a3ba1bbfa71fc9"} Sep 15 17:32:48.268208 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:48.268102 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" event={"ID":"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b","Type":"ContainerStarted","Data":"5a35869498bddde1d99ada6c0a9f86c0badde9fd7fcf0e5f54ffc092631aadc3"} Sep 15 17:32:48.268208 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:48.268136 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" event={"ID":"0ba5d08b-75b3-4a02-b6f6-f90a38969d7b","Type":"ContainerStarted","Data":"ce3795713330202444932a3d69dc25ba0e3120a91e1d0935d5bc98ef70f3e990"} Sep 15 17:32:48.271236 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:48.271209 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn" Sep 15 17:32:48.272626 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:48.272600 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad3789aa-32ca-4160-9d2e-998fbfb0aa67","Type":"ContainerStarted","Data":"2adb15921939eafb361381d00cf36e4f5cda5dde740ce4f0a52824f94441ae0c"} Sep 15 17:32:48.283975 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:48.283924 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jhhpn" podStartSLOduration=2.09814009 podStartE2EDuration="4.283907685s" totalImagesPullingTime="2.185767595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:48.282356582 +0000 UTC m=+91.007174875" watchObservedRunningTime="2026-09-15 17:32:48.283907685 +0000 UTC m=+91.008725976" Sep 15 17:32:48.311122 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:48.310715 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.459817584 podStartE2EDuration="8.310692148s" totalImagesPullingTime="4.831622086s" totalInitContainerRuntime="19.252478ms" isStatefulPod=false podCreationTimestamp="2026-09-15 17:32:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:48.310177999 +0000 UTC m=+91.034996291" watchObservedRunningTime="2026-09-15 17:32:48.310692148 +0000 UTC m=+91.035510440" Sep 15 17:32:48.341750 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:48.341712 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:48.349748 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:48.349667 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-56f68b6ff9-vthbs" podStartSLOduration=1.902769759 podStartE2EDuration="4.349646801s" totalImagesPullingTime="2.446877042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:48.348642879 +0000 UTC m=+91.073461183" watchObservedRunningTime="2026-09-15 17:32:48.349646801 +0000 UTC m=+91.074465095" Sep 15 17:32:50.705811 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:50.705774 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-777b6b5f6d-g8cb2"] Sep 15 17:32:50.797315 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:50.797271 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:50.897236 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:50.897205 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:50.998879 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:50.998793 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:51.098063 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:51.098017 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:51.295534 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:51.295446 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"715225e9-64b5-4377-9c88-4b1501f661c6","Type":"ContainerStarted","Data":"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458"} Sep 15 17:32:51.295689 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:51.295549 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"715225e9-64b5-4377-9c88-4b1501f661c6","Type":"ContainerStarted","Data":"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58"} Sep 15 17:32:53.309764 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:53.309727 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"715225e9-64b5-4377-9c88-4b1501f661c6","Type":"ContainerStarted","Data":"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6"} Sep 15 17:32:53.310183 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:53.309794 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"715225e9-64b5-4377-9c88-4b1501f661c6","Type":"ContainerStarted","Data":"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157"} Sep 15 17:32:53.310183 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:53.309821 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"715225e9-64b5-4377-9c88-4b1501f661c6","Type":"ContainerStarted","Data":"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf"} Sep 15 17:32:53.310183 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:53.309846 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"715225e9-64b5-4377-9c88-4b1501f661c6","Type":"ContainerStarted","Data":"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11"} Sep 15 17:32:53.338929 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:53.338872 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.290712635 podStartE2EDuration="8.338852163s" totalImagesPullingTime="5.019153188s" totalInitContainerRuntime="28.98634ms" isStatefulPod=false podCreationTimestamp="2026-09-15 17:32:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:32:53.336141066 +0000 UTC m=+96.060959356" watchObservedRunningTime="2026-09-15 17:32:53.338852163 +0000 UTC m=+96.063670453" Sep 15 17:32:54.101077 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:54.101043 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q6n92" Sep 15 17:32:55.121647 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:55.121604 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:55.342891 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:55.342837 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:32:56.095039 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:32:56.094999 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:33:00.537440 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:00.537404 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:00.599068 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:00.599032 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:01.535562 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:01.535527 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:01.636599 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:01.636570 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:06.000442 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:06.000403 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:06.057367 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:06.057317 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:06.128972 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:06.128931 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:09.192466 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:09.192431 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:09.245782 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:09.245746 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:15.726210 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:15.726162 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" podUID="010e5abf-f2d3-4060-97dc-21ce1136d961" containerName="registry" containerID="cri-o://07343e4d6c17c3a7b350c0eebc3c8ca746f6b5ff13b981326e01b13778cdf02c" gracePeriod=30 Sep 15 17:33:15.973697 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:15.973674 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:33:16.153344 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.153307 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-bound-sa-token\") pod \"010e5abf-f2d3-4060-97dc-21ce1136d961\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " Sep 15 17:33:16.153344 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.153347 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-certificates\") pod \"010e5abf-f2d3-4060-97dc-21ce1136d961\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " Sep 15 17:33:16.153593 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.153377 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/010e5abf-f2d3-4060-97dc-21ce1136d961-image-registry-private-configuration\") pod \"010e5abf-f2d3-4060-97dc-21ce1136d961\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " Sep 15 17:33:16.153593 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.153405 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/010e5abf-f2d3-4060-97dc-21ce1136d961-ca-trust-extracted\") pod \"010e5abf-f2d3-4060-97dc-21ce1136d961\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " Sep 15 17:33:16.153593 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.153472 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/010e5abf-f2d3-4060-97dc-21ce1136d961-trusted-ca\") pod \"010e5abf-f2d3-4060-97dc-21ce1136d961\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " Sep 15 17:33:16.153593 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.153503 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmkvl\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-kube-api-access-qmkvl\") pod \"010e5abf-f2d3-4060-97dc-21ce1136d961\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " Sep 15 17:33:16.153593 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.153537 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls\") pod \"010e5abf-f2d3-4060-97dc-21ce1136d961\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " Sep 15 17:33:16.153848 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.153598 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/010e5abf-f2d3-4060-97dc-21ce1136d961-installation-pull-secrets\") pod \"010e5abf-f2d3-4060-97dc-21ce1136d961\" (UID: \"010e5abf-f2d3-4060-97dc-21ce1136d961\") " Sep 15 17:33:16.153940 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.153902 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "010e5abf-f2d3-4060-97dc-21ce1136d961" (UID: "010e5abf-f2d3-4060-97dc-21ce1136d961"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:33:16.154073 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.154040 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010e5abf-f2d3-4060-97dc-21ce1136d961-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "010e5abf-f2d3-4060-97dc-21ce1136d961" (UID: "010e5abf-f2d3-4060-97dc-21ce1136d961"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:33:16.156528 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.156473 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-kube-api-access-qmkvl" (OuterVolumeSpecName: "kube-api-access-qmkvl") pod "010e5abf-f2d3-4060-97dc-21ce1136d961" (UID: "010e5abf-f2d3-4060-97dc-21ce1136d961"). InnerVolumeSpecName "kube-api-access-qmkvl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:33:16.156778 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.156565 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "010e5abf-f2d3-4060-97dc-21ce1136d961" (UID: "010e5abf-f2d3-4060-97dc-21ce1136d961"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:33:16.156778 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.156604 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/010e5abf-f2d3-4060-97dc-21ce1136d961-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "010e5abf-f2d3-4060-97dc-21ce1136d961" (UID: "010e5abf-f2d3-4060-97dc-21ce1136d961"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:33:16.156778 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.156674 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "010e5abf-f2d3-4060-97dc-21ce1136d961" (UID: "010e5abf-f2d3-4060-97dc-21ce1136d961"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:33:16.156778 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.156689 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/010e5abf-f2d3-4060-97dc-21ce1136d961-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "010e5abf-f2d3-4060-97dc-21ce1136d961" (UID: "010e5abf-f2d3-4060-97dc-21ce1136d961"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:33:16.162638 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.162610 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/010e5abf-f2d3-4060-97dc-21ce1136d961-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "010e5abf-f2d3-4060-97dc-21ce1136d961" (UID: "010e5abf-f2d3-4060-97dc-21ce1136d961"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 17:33:16.255182 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.255143 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-bound-sa-token\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:33:16.255182 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.255176 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-certificates\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:33:16.255182 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.255189 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/010e5abf-f2d3-4060-97dc-21ce1136d961-image-registry-private-configuration\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:33:16.255428 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.255199 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/010e5abf-f2d3-4060-97dc-21ce1136d961-ca-trust-extracted\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:33:16.255428 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.255208 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/010e5abf-f2d3-4060-97dc-21ce1136d961-trusted-ca\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:33:16.255428 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.255216 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmkvl\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-kube-api-access-qmkvl\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:33:16.255428 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.255225 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/010e5abf-f2d3-4060-97dc-21ce1136d961-registry-tls\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:33:16.255428 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.255233 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/010e5abf-f2d3-4060-97dc-21ce1136d961-installation-pull-secrets\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:33:16.409237 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.409151 2581 generic.go:356] "Generic (PLEG): container finished" podID="010e5abf-f2d3-4060-97dc-21ce1136d961" containerID="07343e4d6c17c3a7b350c0eebc3c8ca746f6b5ff13b981326e01b13778cdf02c" exitCode=0 Sep 15 17:33:16.409237 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.409208 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" Sep 15 17:33:16.409422 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.409212 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" event={"ID":"010e5abf-f2d3-4060-97dc-21ce1136d961","Type":"ContainerDied","Data":"07343e4d6c17c3a7b350c0eebc3c8ca746f6b5ff13b981326e01b13778cdf02c"} Sep 15 17:33:16.409422 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.409339 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-777b6b5f6d-g8cb2" event={"ID":"010e5abf-f2d3-4060-97dc-21ce1136d961","Type":"ContainerDied","Data":"4e7704746df7cd023cab93d38f51c7d40edb4b96d599cf7ec3971605e98e812a"} Sep 15 17:33:16.409422 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.409360 2581 scope.go:117] "RemoveContainer" containerID="07343e4d6c17c3a7b350c0eebc3c8ca746f6b5ff13b981326e01b13778cdf02c" Sep 15 17:33:16.419341 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.419294 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:16.422176 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.422158 2581 scope.go:117] "RemoveContainer" containerID="07343e4d6c17c3a7b350c0eebc3c8ca746f6b5ff13b981326e01b13778cdf02c" Sep 15 17:33:16.422475 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:33:16.422451 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07343e4d6c17c3a7b350c0eebc3c8ca746f6b5ff13b981326e01b13778cdf02c\": container with ID starting with 07343e4d6c17c3a7b350c0eebc3c8ca746f6b5ff13b981326e01b13778cdf02c not found: ID does not exist" containerID="07343e4d6c17c3a7b350c0eebc3c8ca746f6b5ff13b981326e01b13778cdf02c" Sep 15 17:33:16.422567 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.422482 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07343e4d6c17c3a7b350c0eebc3c8ca746f6b5ff13b981326e01b13778cdf02c"} err="failed to get container status \"07343e4d6c17c3a7b350c0eebc3c8ca746f6b5ff13b981326e01b13778cdf02c\": rpc error: code = NotFound desc = could not find container \"07343e4d6c17c3a7b350c0eebc3c8ca746f6b5ff13b981326e01b13778cdf02c\": container with ID starting with 07343e4d6c17c3a7b350c0eebc3c8ca746f6b5ff13b981326e01b13778cdf02c not found: ID does not exist" Sep 15 17:33:16.430422 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.430400 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-777b6b5f6d-g8cb2"] Sep 15 17:33:16.434163 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.434138 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-777b6b5f6d-g8cb2"] Sep 15 17:33:16.521116 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.521069 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:16.575504 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:16.575467 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:17.414532 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:17.414501 2581 generic.go:356] "Generic (PLEG): container finished" podID="7625f3fc-9afb-4a69-87d1-4978d83ffad8" containerID="c922cb03cf73ae8775d2a90ccc88ec886e44a17a1712a0dd89536788c5bec41a" exitCode=0 Sep 15 17:33:17.414963 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:17.414574 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-x96rj" event={"ID":"7625f3fc-9afb-4a69-87d1-4978d83ffad8","Type":"ContainerDied","Data":"c922cb03cf73ae8775d2a90ccc88ec886e44a17a1712a0dd89536788c5bec41a"} Sep 15 17:33:17.415050 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:17.414988 2581 scope.go:117] "RemoveContainer" containerID="c922cb03cf73ae8775d2a90ccc88ec886e44a17a1712a0dd89536788c5bec41a" Sep 15 17:33:17.753466 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:17.753377 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="010e5abf-f2d3-4060-97dc-21ce1136d961" path="/var/lib/kubelet/pods/010e5abf-f2d3-4060-97dc-21ce1136d961/volumes" Sep 15 17:33:18.422238 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:18.422203 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-x96rj" event={"ID":"7625f3fc-9afb-4a69-87d1-4978d83ffad8","Type":"ContainerStarted","Data":"29f2ada04fa2c9138729068753c8d1cfefc022c51b7a1d05991f427d29aaa5c5"} Sep 15 17:33:24.194598 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:24.194560 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:24.252695 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:24.252662 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:27.460566 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:27.460480 2581 generic.go:356] "Generic (PLEG): container finished" podID="616628e3-7f4d-477e-9a66-29c031761648" containerID="fab46da205b25e235abef91e305185de93af7566c1f6333d3cac1d09f953fe3f" exitCode=0 Sep 15 17:33:27.460909 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:27.460554 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph" event={"ID":"616628e3-7f4d-477e-9a66-29c031761648","Type":"ContainerDied","Data":"fab46da205b25e235abef91e305185de93af7566c1f6333d3cac1d09f953fe3f"} Sep 15 17:33:27.460948 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:27.460925 2581 scope.go:117] "RemoveContainer" containerID="fab46da205b25e235abef91e305185de93af7566c1f6333d3cac1d09f953fe3f" Sep 15 17:33:28.467116 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:28.467047 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-sfcph" event={"ID":"616628e3-7f4d-477e-9a66-29c031761648","Type":"ContainerStarted","Data":"c0358073fdc0781179c3b89b3e3d323d7b91e5ea982d0b4235881d001fdf280e"} Sep 15 17:33:33.488941 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:33.488907 2581 generic.go:356] "Generic (PLEG): container finished" podID="b9605bf3-fd4f-4659-b69d-b4698683fbad" containerID="7d85252998880ed4579f73cefa269129651a51a0cd3e7ec047355bdf7b17a09e" exitCode=0 Sep 15 17:33:33.489398 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:33.488990 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6" event={"ID":"b9605bf3-fd4f-4659-b69d-b4698683fbad","Type":"ContainerDied","Data":"7d85252998880ed4579f73cefa269129651a51a0cd3e7ec047355bdf7b17a09e"} Sep 15 17:33:33.489398 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:33.489361 2581 scope.go:117] "RemoveContainer" containerID="7d85252998880ed4579f73cefa269129651a51a0cd3e7ec047355bdf7b17a09e" Sep 15 17:33:34.495278 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:34.495241 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-59jf6" event={"ID":"b9605bf3-fd4f-4659-b69d-b4698683fbad","Type":"ContainerStarted","Data":"f3efe743bd8956a4d6c19c4f48f4e58e3eed2e648dfb482fde0bdabf6efb439d"} Sep 15 17:33:40.944699 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:40.944662 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:46.094953 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:46.094913 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:33:46.111625 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:46.111596 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:33:46.562698 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:46.562622 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:33:49.917330 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:49.917294 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:55.618863 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:55.618823 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:55.676374 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:55.676340 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:33:59.874271 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:59.874234 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 17:33:59.874689 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:59.874528 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="alertmanager" containerID="cri-o://43aa46cc9af41651d48f92f8399bd086b92dae5b4c757715264b96f66c5b0421" gracePeriod=120 Sep 15 17:33:59.874689 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:59.874590 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="kube-rbac-proxy-web" containerID="cri-o://3d570c442f1fb008178422a09dc574ab537e544598b08933e008e695fd28b6f3" gracePeriod=120 Sep 15 17:33:59.874689 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:59.874583 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="kube-rbac-proxy-metric" containerID="cri-o://f417455fecfb4f9e81e22301b855808c5ebf0961e12f7e5f8d9b83354819c859" gracePeriod=120 Sep 15 17:33:59.874689 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:59.874639 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="kube-rbac-proxy" containerID="cri-o://9c8e3a5d4932e6e793693481105af3f23034eb115f96aa7765450513010a4a08" gracePeriod=120 Sep 15 17:33:59.874689 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:59.874662 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="config-reloader" containerID="cri-o://c213e2b89e299f8013e860f71393dadf4350f8d976d593d8cb4e32a9e0fba8b5" gracePeriod=120 Sep 15 17:33:59.874960 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:33:59.874702 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="prom-label-proxy" containerID="cri-o://2adb15921939eafb361381d00cf36e4f5cda5dde740ce4f0a52824f94441ae0c" gracePeriod=120 Sep 15 17:34:00.613134 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:00.613070 2581 generic.go:356] "Generic (PLEG): container finished" podID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerID="2adb15921939eafb361381d00cf36e4f5cda5dde740ce4f0a52824f94441ae0c" exitCode=0 Sep 15 17:34:00.613134 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:00.613123 2581 generic.go:356] "Generic (PLEG): container finished" podID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerID="f417455fecfb4f9e81e22301b855808c5ebf0961e12f7e5f8d9b83354819c859" exitCode=0 Sep 15 17:34:00.613134 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:00.613130 2581 generic.go:356] "Generic (PLEG): container finished" podID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerID="9c8e3a5d4932e6e793693481105af3f23034eb115f96aa7765450513010a4a08" exitCode=0 Sep 15 17:34:00.613134 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:00.613135 2581 generic.go:356] "Generic (PLEG): container finished" podID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerID="c213e2b89e299f8013e860f71393dadf4350f8d976d593d8cb4e32a9e0fba8b5" exitCode=0 Sep 15 17:34:00.613134 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:00.613141 2581 generic.go:356] "Generic (PLEG): container finished" podID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerID="43aa46cc9af41651d48f92f8399bd086b92dae5b4c757715264b96f66c5b0421" exitCode=0 Sep 15 17:34:00.613421 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:00.613146 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad3789aa-32ca-4160-9d2e-998fbfb0aa67","Type":"ContainerDied","Data":"2adb15921939eafb361381d00cf36e4f5cda5dde740ce4f0a52824f94441ae0c"} Sep 15 17:34:00.613421 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:00.613212 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad3789aa-32ca-4160-9d2e-998fbfb0aa67","Type":"ContainerDied","Data":"f417455fecfb4f9e81e22301b855808c5ebf0961e12f7e5f8d9b83354819c859"} Sep 15 17:34:00.613421 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:00.613240 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad3789aa-32ca-4160-9d2e-998fbfb0aa67","Type":"ContainerDied","Data":"9c8e3a5d4932e6e793693481105af3f23034eb115f96aa7765450513010a4a08"} Sep 15 17:34:00.613421 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:00.613265 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad3789aa-32ca-4160-9d2e-998fbfb0aa67","Type":"ContainerDied","Data":"c213e2b89e299f8013e860f71393dadf4350f8d976d593d8cb4e32a9e0fba8b5"} Sep 15 17:34:00.613421 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:00.613289 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad3789aa-32ca-4160-9d2e-998fbfb0aa67","Type":"ContainerDied","Data":"43aa46cc9af41651d48f92f8399bd086b92dae5b4c757715264b96f66c5b0421"} Sep 15 17:34:01.132862 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.132834 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.254123 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254006 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-alertmanager-main-db\") pod \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " Sep 15 17:34:01.254123 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254048 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " Sep 15 17:34:01.254123 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254077 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-tls-assets\") pod \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " Sep 15 17:34:01.254409 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254128 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy-web\") pod \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " Sep 15 17:34:01.254409 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254163 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-alertmanager-trusted-ca-bundle\") pod \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " Sep 15 17:34:01.254409 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254186 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-cluster-tls-config\") pod \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " Sep 15 17:34:01.254409 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254258 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy\") pod \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " Sep 15 17:34:01.254409 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254366 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-web-config\") pod \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " Sep 15 17:34:01.254409 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254408 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-config-out\") pod \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " Sep 15 17:34:01.254722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254438 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7q6v\" (UniqueName: \"kubernetes.io/projected/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-kube-api-access-q7q6v\") pod \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " Sep 15 17:34:01.254722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254449 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ad3789aa-32ca-4160-9d2e-998fbfb0aa67" (UID: "ad3789aa-32ca-4160-9d2e-998fbfb0aa67"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 17:34:01.254722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254466 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-main-tls\") pod \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " Sep 15 17:34:01.254722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254499 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-config-volume\") pod \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " Sep 15 17:34:01.254722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254548 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-metrics-client-ca\") pod \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\" (UID: \"ad3789aa-32ca-4160-9d2e-998fbfb0aa67\") " Sep 15 17:34:01.254722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254578 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ad3789aa-32ca-4160-9d2e-998fbfb0aa67" (UID: "ad3789aa-32ca-4160-9d2e-998fbfb0aa67"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:34:01.255043 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254849 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-alertmanager-main-db\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:01.255043 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.254873 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:01.255570 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.255539 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ad3789aa-32ca-4160-9d2e-998fbfb0aa67" (UID: "ad3789aa-32ca-4160-9d2e-998fbfb0aa67"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:34:01.257329 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.257287 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ad3789aa-32ca-4160-9d2e-998fbfb0aa67" (UID: "ad3789aa-32ca-4160-9d2e-998fbfb0aa67"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:34:01.257756 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.257577 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ad3789aa-32ca-4160-9d2e-998fbfb0aa67" (UID: "ad3789aa-32ca-4160-9d2e-998fbfb0aa67"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:34:01.257756 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.257623 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ad3789aa-32ca-4160-9d2e-998fbfb0aa67" (UID: "ad3789aa-32ca-4160-9d2e-998fbfb0aa67"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:34:01.257756 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.257743 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ad3789aa-32ca-4160-9d2e-998fbfb0aa67" (UID: "ad3789aa-32ca-4160-9d2e-998fbfb0aa67"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:34:01.258014 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.257986 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ad3789aa-32ca-4160-9d2e-998fbfb0aa67" (UID: "ad3789aa-32ca-4160-9d2e-998fbfb0aa67"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:34:01.258014 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.257999 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-config-volume" (OuterVolumeSpecName: "config-volume") pod "ad3789aa-32ca-4160-9d2e-998fbfb0aa67" (UID: "ad3789aa-32ca-4160-9d2e-998fbfb0aa67"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:34:01.259285 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.259262 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-kube-api-access-q7q6v" (OuterVolumeSpecName: "kube-api-access-q7q6v") pod "ad3789aa-32ca-4160-9d2e-998fbfb0aa67" (UID: "ad3789aa-32ca-4160-9d2e-998fbfb0aa67"). InnerVolumeSpecName "kube-api-access-q7q6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:34:01.259285 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.259267 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-config-out" (OuterVolumeSpecName: "config-out") pod "ad3789aa-32ca-4160-9d2e-998fbfb0aa67" (UID: "ad3789aa-32ca-4160-9d2e-998fbfb0aa67"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 17:34:01.261699 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.261663 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ad3789aa-32ca-4160-9d2e-998fbfb0aa67" (UID: "ad3789aa-32ca-4160-9d2e-998fbfb0aa67"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:34:01.272927 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.269586 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-web-config" (OuterVolumeSpecName: "web-config") pod "ad3789aa-32ca-4160-9d2e-998fbfb0aa67" (UID: "ad3789aa-32ca-4160-9d2e-998fbfb0aa67"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:34:01.355898 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.355856 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-web-config\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:01.355898 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.355891 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-config-out\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:01.355898 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.355902 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7q6v\" (UniqueName: \"kubernetes.io/projected/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-kube-api-access-q7q6v\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:01.355898 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.355911 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-main-tls\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:01.356200 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.355920 2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-config-volume\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:01.356200 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.355929 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-metrics-client-ca\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:01.356200 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.355939 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:01.356200 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.355950 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-tls-assets\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:01.356200 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.355958 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:01.356200 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.355967 2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-cluster-tls-config\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:01.356200 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.355975 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad3789aa-32ca-4160-9d2e-998fbfb0aa67-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:01.620970 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.620931 2581 generic.go:356] "Generic (PLEG): container finished" podID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerID="3d570c442f1fb008178422a09dc574ab537e544598b08933e008e695fd28b6f3" exitCode=0 Sep 15 17:34:01.621190 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.621015 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad3789aa-32ca-4160-9d2e-998fbfb0aa67","Type":"ContainerDied","Data":"3d570c442f1fb008178422a09dc574ab537e544598b08933e008e695fd28b6f3"} Sep 15 17:34:01.621190 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.621038 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.621190 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.621138 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad3789aa-32ca-4160-9d2e-998fbfb0aa67","Type":"ContainerDied","Data":"e59dcffa1cb7fd290fe366cbb186cca4e7e4fa56706fb706e2dae70f40dcf5c4"} Sep 15 17:34:01.621190 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.621172 2581 scope.go:117] "RemoveContainer" containerID="2adb15921939eafb361381d00cf36e4f5cda5dde740ce4f0a52824f94441ae0c" Sep 15 17:34:01.629266 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.629248 2581 scope.go:117] "RemoveContainer" containerID="f417455fecfb4f9e81e22301b855808c5ebf0961e12f7e5f8d9b83354819c859" Sep 15 17:34:01.636822 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.636803 2581 scope.go:117] "RemoveContainer" containerID="9c8e3a5d4932e6e793693481105af3f23034eb115f96aa7765450513010a4a08" Sep 15 17:34:01.643920 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.643892 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 17:34:01.645737 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.645708 2581 scope.go:117] "RemoveContainer" containerID="3d570c442f1fb008178422a09dc574ab537e544598b08933e008e695fd28b6f3" Sep 15 17:34:01.647993 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.647975 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 17:34:01.653218 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.653196 2581 scope.go:117] "RemoveContainer" containerID="c213e2b89e299f8013e860f71393dadf4350f8d976d593d8cb4e32a9e0fba8b5" Sep 15 17:34:01.660656 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.660638 2581 scope.go:117] "RemoveContainer" containerID="43aa46cc9af41651d48f92f8399bd086b92dae5b4c757715264b96f66c5b0421" Sep 15 17:34:01.668520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.668500 2581 scope.go:117] "RemoveContainer" containerID="a41e406bd557b0810e388b93966970d010397c90f899aa6270f8f5e6b9e012b2" Sep 15 17:34:01.671141 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671058 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 17:34:01.671435 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671422 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="alertmanager" Sep 15 17:34:01.671472 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671437 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="alertmanager" Sep 15 17:34:01.671472 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671446 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="prom-label-proxy" Sep 15 17:34:01.671472 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671453 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="prom-label-proxy" Sep 15 17:34:01.671472 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671464 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="init-config-reloader" Sep 15 17:34:01.671472 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671469 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="init-config-reloader" Sep 15 17:34:01.671617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671478 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="kube-rbac-proxy-web" Sep 15 17:34:01.671617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671483 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="kube-rbac-proxy-web" Sep 15 17:34:01.671617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671492 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="kube-rbac-proxy" Sep 15 17:34:01.671617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671497 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="kube-rbac-proxy" Sep 15 17:34:01.671617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671508 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="config-reloader" Sep 15 17:34:01.671617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671513 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="config-reloader" Sep 15 17:34:01.671617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671521 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010e5abf-f2d3-4060-97dc-21ce1136d961" containerName="registry" Sep 15 17:34:01.671617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671526 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="010e5abf-f2d3-4060-97dc-21ce1136d961" containerName="registry" Sep 15 17:34:01.671617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671533 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="kube-rbac-proxy-metric" Sep 15 17:34:01.671617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671539 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="kube-rbac-proxy-metric" Sep 15 17:34:01.671617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671597 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="alertmanager" Sep 15 17:34:01.671617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671604 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="kube-rbac-proxy-web" Sep 15 17:34:01.671617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671612 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="kube-rbac-proxy-metric" Sep 15 17:34:01.671617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671618 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="prom-label-proxy" Sep 15 17:34:01.672013 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671626 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="kube-rbac-proxy" Sep 15 17:34:01.672013 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671632 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" containerName="config-reloader" Sep 15 17:34:01.672013 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.671637 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="010e5abf-f2d3-4060-97dc-21ce1136d961" containerName="registry" Sep 15 17:34:01.676505 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.676487 2581 scope.go:117] "RemoveContainer" containerID="2adb15921939eafb361381d00cf36e4f5cda5dde740ce4f0a52824f94441ae0c" Sep 15 17:34:01.677203 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:34:01.677182 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2adb15921939eafb361381d00cf36e4f5cda5dde740ce4f0a52824f94441ae0c\": container with ID starting with 2adb15921939eafb361381d00cf36e4f5cda5dde740ce4f0a52824f94441ae0c not found: ID does not exist" containerID="2adb15921939eafb361381d00cf36e4f5cda5dde740ce4f0a52824f94441ae0c" Sep 15 17:34:01.677290 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.677216 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2adb15921939eafb361381d00cf36e4f5cda5dde740ce4f0a52824f94441ae0c"} err="failed to get container status \"2adb15921939eafb361381d00cf36e4f5cda5dde740ce4f0a52824f94441ae0c\": rpc error: code = NotFound desc = could not find container \"2adb15921939eafb361381d00cf36e4f5cda5dde740ce4f0a52824f94441ae0c\": container with ID starting with 2adb15921939eafb361381d00cf36e4f5cda5dde740ce4f0a52824f94441ae0c not found: ID does not exist" Sep 15 17:34:01.677290 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.677241 2581 scope.go:117] "RemoveContainer" containerID="f417455fecfb4f9e81e22301b855808c5ebf0961e12f7e5f8d9b83354819c859" Sep 15 17:34:01.677290 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.677280 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.677601 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:34:01.677552 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f417455fecfb4f9e81e22301b855808c5ebf0961e12f7e5f8d9b83354819c859\": container with ID starting with f417455fecfb4f9e81e22301b855808c5ebf0961e12f7e5f8d9b83354819c859 not found: ID does not exist" containerID="f417455fecfb4f9e81e22301b855808c5ebf0961e12f7e5f8d9b83354819c859" Sep 15 17:34:01.677679 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.677622 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f417455fecfb4f9e81e22301b855808c5ebf0961e12f7e5f8d9b83354819c859"} err="failed to get container status \"f417455fecfb4f9e81e22301b855808c5ebf0961e12f7e5f8d9b83354819c859\": rpc error: code = NotFound desc = could not find container \"f417455fecfb4f9e81e22301b855808c5ebf0961e12f7e5f8d9b83354819c859\": container with ID starting with f417455fecfb4f9e81e22301b855808c5ebf0961e12f7e5f8d9b83354819c859 not found: ID does not exist" Sep 15 17:34:01.677679 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.677663 2581 scope.go:117] "RemoveContainer" containerID="9c8e3a5d4932e6e793693481105af3f23034eb115f96aa7765450513010a4a08" Sep 15 17:34:01.677961 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:34:01.677943 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c8e3a5d4932e6e793693481105af3f23034eb115f96aa7765450513010a4a08\": container with ID starting with 9c8e3a5d4932e6e793693481105af3f23034eb115f96aa7765450513010a4a08 not found: ID does not exist" containerID="9c8e3a5d4932e6e793693481105af3f23034eb115f96aa7765450513010a4a08" Sep 15 17:34:01.678012 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.677966 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c8e3a5d4932e6e793693481105af3f23034eb115f96aa7765450513010a4a08"} err="failed to get container status \"9c8e3a5d4932e6e793693481105af3f23034eb115f96aa7765450513010a4a08\": rpc error: code = NotFound desc = could not find container \"9c8e3a5d4932e6e793693481105af3f23034eb115f96aa7765450513010a4a08\": container with ID starting with 9c8e3a5d4932e6e793693481105af3f23034eb115f96aa7765450513010a4a08 not found: ID does not exist" Sep 15 17:34:01.678012 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.677981 2581 scope.go:117] "RemoveContainer" containerID="3d570c442f1fb008178422a09dc574ab537e544598b08933e008e695fd28b6f3" Sep 15 17:34:01.678311 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:34:01.678292 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d570c442f1fb008178422a09dc574ab537e544598b08933e008e695fd28b6f3\": container with ID starting with 3d570c442f1fb008178422a09dc574ab537e544598b08933e008e695fd28b6f3 not found: ID does not exist" containerID="3d570c442f1fb008178422a09dc574ab537e544598b08933e008e695fd28b6f3" Sep 15 17:34:01.678416 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.678314 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d570c442f1fb008178422a09dc574ab537e544598b08933e008e695fd28b6f3"} err="failed to get container status \"3d570c442f1fb008178422a09dc574ab537e544598b08933e008e695fd28b6f3\": rpc error: code = NotFound desc = could not find container \"3d570c442f1fb008178422a09dc574ab537e544598b08933e008e695fd28b6f3\": container with ID starting with 3d570c442f1fb008178422a09dc574ab537e544598b08933e008e695fd28b6f3 not found: ID does not exist" Sep 15 17:34:01.678416 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.678329 2581 scope.go:117] "RemoveContainer" containerID="c213e2b89e299f8013e860f71393dadf4350f8d976d593d8cb4e32a9e0fba8b5" Sep 15 17:34:01.678583 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:34:01.678567 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c213e2b89e299f8013e860f71393dadf4350f8d976d593d8cb4e32a9e0fba8b5\": container with ID starting with c213e2b89e299f8013e860f71393dadf4350f8d976d593d8cb4e32a9e0fba8b5 not found: ID does not exist" containerID="c213e2b89e299f8013e860f71393dadf4350f8d976d593d8cb4e32a9e0fba8b5" Sep 15 17:34:01.678638 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.678585 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c213e2b89e299f8013e860f71393dadf4350f8d976d593d8cb4e32a9e0fba8b5"} err="failed to get container status \"c213e2b89e299f8013e860f71393dadf4350f8d976d593d8cb4e32a9e0fba8b5\": rpc error: code = NotFound desc = could not find container \"c213e2b89e299f8013e860f71393dadf4350f8d976d593d8cb4e32a9e0fba8b5\": container with ID starting with c213e2b89e299f8013e860f71393dadf4350f8d976d593d8cb4e32a9e0fba8b5 not found: ID does not exist" Sep 15 17:34:01.678638 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.678598 2581 scope.go:117] "RemoveContainer" containerID="43aa46cc9af41651d48f92f8399bd086b92dae5b4c757715264b96f66c5b0421" Sep 15 17:34:01.678868 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:34:01.678849 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43aa46cc9af41651d48f92f8399bd086b92dae5b4c757715264b96f66c5b0421\": container with ID starting with 43aa46cc9af41651d48f92f8399bd086b92dae5b4c757715264b96f66c5b0421 not found: ID does not exist" containerID="43aa46cc9af41651d48f92f8399bd086b92dae5b4c757715264b96f66c5b0421" Sep 15 17:34:01.678932 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.678875 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43aa46cc9af41651d48f92f8399bd086b92dae5b4c757715264b96f66c5b0421"} err="failed to get container status \"43aa46cc9af41651d48f92f8399bd086b92dae5b4c757715264b96f66c5b0421\": rpc error: code = NotFound desc = could not find container \"43aa46cc9af41651d48f92f8399bd086b92dae5b4c757715264b96f66c5b0421\": container with ID starting with 43aa46cc9af41651d48f92f8399bd086b92dae5b4c757715264b96f66c5b0421 not found: ID does not exist" Sep 15 17:34:01.678932 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.678895 2581 scope.go:117] "RemoveContainer" containerID="a41e406bd557b0810e388b93966970d010397c90f899aa6270f8f5e6b9e012b2" Sep 15 17:34:01.679187 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:34:01.679167 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a41e406bd557b0810e388b93966970d010397c90f899aa6270f8f5e6b9e012b2\": container with ID starting with a41e406bd557b0810e388b93966970d010397c90f899aa6270f8f5e6b9e012b2 not found: ID does not exist" containerID="a41e406bd557b0810e388b93966970d010397c90f899aa6270f8f5e6b9e012b2" Sep 15 17:34:01.679263 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.679192 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a41e406bd557b0810e388b93966970d010397c90f899aa6270f8f5e6b9e012b2"} err="failed to get container status \"a41e406bd557b0810e388b93966970d010397c90f899aa6270f8f5e6b9e012b2\": rpc error: code = NotFound desc = could not find container \"a41e406bd557b0810e388b93966970d010397c90f899aa6270f8f5e6b9e012b2\": container with ID starting with a41e406bd557b0810e388b93966970d010397c90f899aa6270f8f5e6b9e012b2 not found: ID does not exist" Sep 15 17:34:01.679477 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.679439 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 15 17:34:01.679477 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.679454 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 15 17:34:01.679625 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.679514 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 15 17:34:01.679625 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.679439 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 15 17:34:01.679625 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.679587 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 15 17:34:01.679625 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.679461 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 15 17:34:01.679997 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.679977 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 15 17:34:01.680337 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.680140 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 15 17:34:01.680337 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.680224 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gv7df\"" Sep 15 17:34:01.684507 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.684486 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 15 17:34:01.690531 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.690510 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 17:34:01.751700 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.751665 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad3789aa-32ca-4160-9d2e-998fbfb0aa67" path="/var/lib/kubelet/pods/ad3789aa-32ca-4160-9d2e-998fbfb0aa67/volumes" Sep 15 17:34:01.861447 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.861408 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.861447 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.861449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c53211f4-9d2c-4319-8c30-60904243e175-config-out\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.861675 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.861485 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c53211f4-9d2c-4319-8c30-60904243e175-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.861675 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.861607 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-web-config\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.861675 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.861634 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-config-volume\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.861675 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.861652 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.861880 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.861735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.861880 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.861773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c53211f4-9d2c-4319-8c30-60904243e175-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.861880 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.861805 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c53211f4-9d2c-4319-8c30-60904243e175-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.861880 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.861864 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.862060 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.861924 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh65c\" (UniqueName: \"kubernetes.io/projected/c53211f4-9d2c-4319-8c30-60904243e175-kube-api-access-jh65c\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.862060 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.861962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.862060 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.862021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c53211f4-9d2c-4319-8c30-60904243e175-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.962491 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.962449 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c53211f4-9d2c-4319-8c30-60904243e175-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.962491 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.962496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.962694 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.962517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c53211f4-9d2c-4319-8c30-60904243e175-config-out\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.962694 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.962544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c53211f4-9d2c-4319-8c30-60904243e175-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.962694 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.962567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-web-config\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.962694 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.962586 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-config-volume\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.962694 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.962601 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.962694 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.962626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.962694 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.962655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c53211f4-9d2c-4319-8c30-60904243e175-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.963140 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.962874 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c53211f4-9d2c-4319-8c30-60904243e175-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.963140 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.962923 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c53211f4-9d2c-4319-8c30-60904243e175-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.963140 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.962956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.963140 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.963000 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh65c\" (UniqueName: \"kubernetes.io/projected/c53211f4-9d2c-4319-8c30-60904243e175-kube-api-access-jh65c\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.963140 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.963056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.963866 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.963832 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c53211f4-9d2c-4319-8c30-60904243e175-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.964896 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.964804 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c53211f4-9d2c-4319-8c30-60904243e175-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.965634 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.965608 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c53211f4-9d2c-4319-8c30-60904243e175-config-out\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.965728 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.965693 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.965930 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.965899 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.965930 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.965928 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.966337 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.966316 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c53211f4-9d2c-4319-8c30-60904243e175-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.966400 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.966340 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-config-volume\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.967152 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.967130 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-web-config\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.967427 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.967409 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.967806 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.967789 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c53211f4-9d2c-4319-8c30-60904243e175-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.973743 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.973719 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh65c\" (UniqueName: \"kubernetes.io/projected/c53211f4-9d2c-4319-8c30-60904243e175-kube-api-access-jh65c\") pod \"alertmanager-main-0\" (UID: \"c53211f4-9d2c-4319-8c30-60904243e175\") " pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:01.989606 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:01.989576 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 15 17:34:02.270836 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:02.270810 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 15 17:34:02.272309 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:34:02.272279 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc53211f4_9d2c_4319_8c30_60904243e175.slice/crio-c53f09bff6ce55e91035eabb042c4fbc4b4cd8cc237f4f575b9aba77f6ac71cb WatchSource:0}: Error finding container c53f09bff6ce55e91035eabb042c4fbc4b4cd8cc237f4f575b9aba77f6ac71cb: Status 404 returned error can't find the container with id c53f09bff6ce55e91035eabb042c4fbc4b4cd8cc237f4f575b9aba77f6ac71cb Sep 15 17:34:02.627681 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:02.627644 2581 generic.go:356] "Generic (PLEG): container finished" podID="c53211f4-9d2c-4319-8c30-60904243e175" containerID="29ed2e18799b3cface10fe363eef06c6f5d709654b6e9d3f51778e2abf5a77fb" exitCode=0 Sep 15 17:34:02.627861 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:02.627734 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c53211f4-9d2c-4319-8c30-60904243e175","Type":"ContainerDied","Data":"29ed2e18799b3cface10fe363eef06c6f5d709654b6e9d3f51778e2abf5a77fb"} Sep 15 17:34:02.627861 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:02.627799 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c53211f4-9d2c-4319-8c30-60904243e175","Type":"ContainerStarted","Data":"c53f09bff6ce55e91035eabb042c4fbc4b4cd8cc237f4f575b9aba77f6ac71cb"} Sep 15 17:34:03.635636 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:03.635600 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c53211f4-9d2c-4319-8c30-60904243e175","Type":"ContainerStarted","Data":"50fd8b8b324526674a31b8e219813fb0602ce89e56908e1e6cd8f097d7998d18"} Sep 15 17:34:03.636013 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:03.635673 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c53211f4-9d2c-4319-8c30-60904243e175","Type":"ContainerStarted","Data":"35ae4bc241b306b4a8e61361881c25dd6fa21ed4b89fd248f1544e9d24c31ad7"} Sep 15 17:34:03.636013 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:03.635702 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c53211f4-9d2c-4319-8c30-60904243e175","Type":"ContainerStarted","Data":"16c77b06bf7637e03831494a5e95efe8332f3f995b46194b13c77959fe9e5c5f"} Sep 15 17:34:03.636013 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:03.635738 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c53211f4-9d2c-4319-8c30-60904243e175","Type":"ContainerStarted","Data":"845cb0647f5f435b8cb5c7232a2bef2b2eda9f19bfb15040472142ee440a9483"} Sep 15 17:34:03.636013 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:03.635764 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c53211f4-9d2c-4319-8c30-60904243e175","Type":"ContainerStarted","Data":"f3747916286543108019116aa7f2fbaaf93f4d580455b0d7f0151cf2ab898208"} Sep 15 17:34:03.636013 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:03.635787 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c53211f4-9d2c-4319-8c30-60904243e175","Type":"ContainerStarted","Data":"e48248c233b268ef59f189a968f3b445e9389dbbe05a41f13ffb03c4e179a96f"} Sep 15 17:34:03.670450 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:03.668112 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.651948278 podStartE2EDuration="2.668059613s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.111335ms" isStatefulPod=false podCreationTimestamp="2026-09-15 17:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:34:03.663525203 +0000 UTC m=+166.388343507" watchObservedRunningTime="2026-09-15 17:34:03.668059613 +0000 UTC m=+166.392877904" Sep 15 17:34:04.092642 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.092609 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:34:04.092953 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.092922 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="prometheus" containerID="cri-o://5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58" gracePeriod=600 Sep 15 17:34:04.093035 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.092951 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="kube-rbac-proxy" containerID="cri-o://43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157" gracePeriod=600 Sep 15 17:34:04.093035 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.092963 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="thanos-sidecar" containerID="cri-o://fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11" gracePeriod=600 Sep 15 17:34:04.093183 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.092958 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="kube-rbac-proxy-web" containerID="cri-o://453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf" gracePeriod=600 Sep 15 17:34:04.093183 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.092974 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="config-reloader" containerID="cri-o://d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458" gracePeriod=600 Sep 15 17:34:04.093282 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.092934 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6" gracePeriod=600 Sep 15 17:34:04.333154 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.333122 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.487957 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.487861 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-2\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.487957 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.487904 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-trusted-ca-bundle\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.487957 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.487931 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-tls\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.487957 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.487951 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-serving-certs-ca-bundle\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.488321 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.487982 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-config\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.488321 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488008 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-kube-rbac-proxy\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.488321 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488038 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqbm9\" (UniqueName: \"kubernetes.io/projected/715225e9-64b5-4377-9c88-4b1501f661c6-kube-api-access-pqbm9\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.488321 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488076 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-grpc-tls\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.488321 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488130 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-db\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.488321 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488153 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-kubelet-serving-ca-bundle\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.488321 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488181 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.488321 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488225 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/715225e9-64b5-4377-9c88-4b1501f661c6-config-out\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.488321 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488254 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-1\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.488321 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488284 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.488784 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488337 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-metrics-client-certs\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.488784 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488364 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-thanos-prometheus-http-client-file\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.488784 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488429 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-0\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.488784 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488452 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/715225e9-64b5-4377-9c88-4b1501f661c6-tls-assets\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.488784 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488454 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:34:04.488784 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488476 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-web-config\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.488784 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488484 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:34:04.488784 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488499 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-metrics-client-ca\") pod \"715225e9-64b5-4377-9c88-4b1501f661c6\" (UID: \"715225e9-64b5-4377-9c88-4b1501f661c6\") " Sep 15 17:34:04.489207 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488834 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:34:04.489207 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488852 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:34:04.489207 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488881 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.489207 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.488903 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.490466 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.489973 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:34:04.490466 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.490069 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 17:34:04.490466 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.490432 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:34:04.490924 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.490898 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:34:04.491221 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.491190 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:34:04.491333 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.491287 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-config" (OuterVolumeSpecName: "config") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:34:04.491405 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.491366 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/715225e9-64b5-4377-9c88-4b1501f661c6-kube-api-access-pqbm9" (OuterVolumeSpecName: "kube-api-access-pqbm9") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "kube-api-access-pqbm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:34:04.492723 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.492685 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:34:04.492822 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.492752 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:34:04.492822 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.492813 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:34:04.492928 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.492843 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:34:04.492978 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.492949 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:34:04.493114 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.493067 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:34:04.493163 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.493113 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/715225e9-64b5-4377-9c88-4b1501f661c6-config-out" (OuterVolumeSpecName: "config-out") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 17:34:04.493638 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.493620 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/715225e9-64b5-4377-9c88-4b1501f661c6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:34:04.504453 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.504423 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-web-config" (OuterVolumeSpecName: "web-config") pod "715225e9-64b5-4377-9c88-4b1501f661c6" (UID: "715225e9-64b5-4377-9c88-4b1501f661c6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:34:04.590231 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590181 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590231 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590224 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590231 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590234 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-config\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590231 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590243 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-kube-rbac-proxy\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590231 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590252 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqbm9\" (UniqueName: \"kubernetes.io/projected/715225e9-64b5-4377-9c88-4b1501f661c6-kube-api-access-pqbm9\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590261 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-grpc-tls\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590270 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-db\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590280 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590289 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590300 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/715225e9-64b5-4377-9c88-4b1501f661c6-config-out\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590308 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590318 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590326 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-secret-metrics-client-certs\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590334 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590343 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590350 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/715225e9-64b5-4377-9c88-4b1501f661c6-tls-assets\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590358 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/715225e9-64b5-4377-9c88-4b1501f661c6-web-config\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.590520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.590365 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/715225e9-64b5-4377-9c88-4b1501f661c6-configmap-metrics-client-ca\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:34:04.643975 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.643939 2581 generic.go:356] "Generic (PLEG): container finished" podID="715225e9-64b5-4377-9c88-4b1501f661c6" containerID="0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6" exitCode=0 Sep 15 17:34:04.643975 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.643965 2581 generic.go:356] "Generic (PLEG): container finished" podID="715225e9-64b5-4377-9c88-4b1501f661c6" containerID="43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157" exitCode=0 Sep 15 17:34:04.643975 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.643972 2581 generic.go:356] "Generic (PLEG): container finished" podID="715225e9-64b5-4377-9c88-4b1501f661c6" containerID="453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf" exitCode=0 Sep 15 17:34:04.643975 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.643978 2581 generic.go:356] "Generic (PLEG): container finished" podID="715225e9-64b5-4377-9c88-4b1501f661c6" containerID="fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11" exitCode=0 Sep 15 17:34:04.643975 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.643983 2581 generic.go:356] "Generic (PLEG): container finished" podID="715225e9-64b5-4377-9c88-4b1501f661c6" containerID="d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458" exitCode=0 Sep 15 17:34:04.644626 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.643988 2581 generic.go:356] "Generic (PLEG): container finished" podID="715225e9-64b5-4377-9c88-4b1501f661c6" containerID="5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58" exitCode=0 Sep 15 17:34:04.644626 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.644019 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.644626 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.644019 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"715225e9-64b5-4377-9c88-4b1501f661c6","Type":"ContainerDied","Data":"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6"} Sep 15 17:34:04.644626 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.644120 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"715225e9-64b5-4377-9c88-4b1501f661c6","Type":"ContainerDied","Data":"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157"} Sep 15 17:34:04.644626 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.644165 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"715225e9-64b5-4377-9c88-4b1501f661c6","Type":"ContainerDied","Data":"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf"} Sep 15 17:34:04.644626 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.644182 2581 scope.go:117] "RemoveContainer" containerID="0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6" Sep 15 17:34:04.644626 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.644206 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"715225e9-64b5-4377-9c88-4b1501f661c6","Type":"ContainerDied","Data":"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11"} Sep 15 17:34:04.644626 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.644246 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"715225e9-64b5-4377-9c88-4b1501f661c6","Type":"ContainerDied","Data":"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458"} Sep 15 17:34:04.644626 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.644288 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"715225e9-64b5-4377-9c88-4b1501f661c6","Type":"ContainerDied","Data":"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58"} Sep 15 17:34:04.644626 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.644328 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"715225e9-64b5-4377-9c88-4b1501f661c6","Type":"ContainerDied","Data":"dc5082f0388247266caa83e8a67aa629b60382676c8a7a38cd2492f6e6b19fb9"} Sep 15 17:34:04.652458 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.652436 2581 scope.go:117] "RemoveContainer" containerID="43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157" Sep 15 17:34:04.659776 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.659756 2581 scope.go:117] "RemoveContainer" containerID="453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf" Sep 15 17:34:04.667261 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.667238 2581 scope.go:117] "RemoveContainer" containerID="fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11" Sep 15 17:34:04.667959 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.667931 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:34:04.673598 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.673570 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:34:04.678782 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.678761 2581 scope.go:117] "RemoveContainer" containerID="d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458" Sep 15 17:34:04.686554 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.686534 2581 scope.go:117] "RemoveContainer" containerID="5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58" Sep 15 17:34:04.695075 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.695053 2581 scope.go:117] "RemoveContainer" containerID="bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89" Sep 15 17:34:04.700530 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.700506 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:34:04.700837 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.700824 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="thanos-sidecar" Sep 15 17:34:04.700882 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.700839 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="thanos-sidecar" Sep 15 17:34:04.700882 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.700852 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="config-reloader" Sep 15 17:34:04.700882 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.700860 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="config-reloader" Sep 15 17:34:04.700882 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.700878 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="kube-rbac-proxy-web" Sep 15 17:34:04.700997 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.700884 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="kube-rbac-proxy-web" Sep 15 17:34:04.700997 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.700893 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="init-config-reloader" Sep 15 17:34:04.700997 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.700898 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="init-config-reloader" Sep 15 17:34:04.700997 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.700905 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="kube-rbac-proxy" Sep 15 17:34:04.700997 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.700910 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="kube-rbac-proxy" Sep 15 17:34:04.700997 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.700919 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="kube-rbac-proxy-thanos" Sep 15 17:34:04.700997 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.700925 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="kube-rbac-proxy-thanos" Sep 15 17:34:04.700997 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.700941 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="prometheus" Sep 15 17:34:04.700997 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.700947 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="prometheus" Sep 15 17:34:04.701266 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.701001 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="config-reloader" Sep 15 17:34:04.701266 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.701015 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="thanos-sidecar" Sep 15 17:34:04.701266 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.701022 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="kube-rbac-proxy" Sep 15 17:34:04.701266 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.701028 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="kube-rbac-proxy-thanos" Sep 15 17:34:04.701266 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.701035 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="kube-rbac-proxy-web" Sep 15 17:34:04.701266 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.701042 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" containerName="prometheus" Sep 15 17:34:04.703194 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.703173 2581 scope.go:117] "RemoveContainer" containerID="0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6" Sep 15 17:34:04.703517 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:34:04.703490 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6\": container with ID starting with 0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6 not found: ID does not exist" containerID="0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6" Sep 15 17:34:04.703582 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.703528 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6"} err="failed to get container status \"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6\": rpc error: code = NotFound desc = could not find container \"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6\": container with ID starting with 0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6 not found: ID does not exist" Sep 15 17:34:04.703582 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.703551 2581 scope.go:117] "RemoveContainer" containerID="43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157" Sep 15 17:34:04.703844 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:34:04.703825 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157\": container with ID starting with 43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157 not found: ID does not exist" containerID="43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157" Sep 15 17:34:04.703887 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.703850 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157"} err="failed to get container status \"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157\": rpc error: code = NotFound desc = could not find container \"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157\": container with ID starting with 43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157 not found: ID does not exist" Sep 15 17:34:04.703887 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.703867 2581 scope.go:117] "RemoveContainer" containerID="453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf" Sep 15 17:34:04.704165 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:34:04.704142 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf\": container with ID starting with 453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf not found: ID does not exist" containerID="453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf" Sep 15 17:34:04.704221 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.704174 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf"} err="failed to get container status \"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf\": rpc error: code = NotFound desc = could not find container \"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf\": container with ID starting with 453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf not found: ID does not exist" Sep 15 17:34:04.704221 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.704197 2581 scope.go:117] "RemoveContainer" containerID="fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11" Sep 15 17:34:04.704457 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:34:04.704441 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11\": container with ID starting with fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11 not found: ID does not exist" containerID="fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11" Sep 15 17:34:04.704505 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.704459 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11"} err="failed to get container status \"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11\": rpc error: code = NotFound desc = could not find container \"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11\": container with ID starting with fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11 not found: ID does not exist" Sep 15 17:34:04.704505 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.704471 2581 scope.go:117] "RemoveContainer" containerID="d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458" Sep 15 17:34:04.704720 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:34:04.704699 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458\": container with ID starting with d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458 not found: ID does not exist" containerID="d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458" Sep 15 17:34:04.704814 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.704720 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458"} err="failed to get container status \"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458\": rpc error: code = NotFound desc = could not find container \"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458\": container with ID starting with d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458 not found: ID does not exist" Sep 15 17:34:04.704814 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.704734 2581 scope.go:117] "RemoveContainer" containerID="5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58" Sep 15 17:34:04.705056 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:34:04.705033 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58\": container with ID starting with 5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58 not found: ID does not exist" containerID="5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58" Sep 15 17:34:04.705225 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.705064 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58"} err="failed to get container status \"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58\": rpc error: code = NotFound desc = could not find container \"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58\": container with ID starting with 5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58 not found: ID does not exist" Sep 15 17:34:04.705272 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.705233 2581 scope.go:117] "RemoveContainer" containerID="bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89" Sep 15 17:34:04.705497 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:34:04.705478 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89\": container with ID starting with bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89 not found: ID does not exist" containerID="bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89" Sep 15 17:34:04.705576 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.705504 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89"} err="failed to get container status \"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89\": rpc error: code = NotFound desc = could not find container \"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89\": container with ID starting with bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89 not found: ID does not exist" Sep 15 17:34:04.705576 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.705523 2581 scope.go:117] "RemoveContainer" containerID="0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6" Sep 15 17:34:04.705819 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.705802 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6"} err="failed to get container status \"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6\": rpc error: code = NotFound desc = could not find container \"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6\": container with ID starting with 0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6 not found: ID does not exist" Sep 15 17:34:04.705866 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.705820 2581 scope.go:117] "RemoveContainer" containerID="43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157" Sep 15 17:34:04.706107 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.706056 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157"} err="failed to get container status \"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157\": rpc error: code = NotFound desc = could not find container \"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157\": container with ID starting with 43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157 not found: ID does not exist" Sep 15 17:34:04.706107 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.706096 2581 scope.go:117] "RemoveContainer" containerID="453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf" Sep 15 17:34:04.706328 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.706310 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf"} err="failed to get container status \"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf\": rpc error: code = NotFound desc = could not find container \"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf\": container with ID starting with 453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf not found: ID does not exist" Sep 15 17:34:04.706393 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.706328 2581 scope.go:117] "RemoveContainer" containerID="fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11" Sep 15 17:34:04.706444 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.706423 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.706554 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.706536 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11"} err="failed to get container status \"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11\": rpc error: code = NotFound desc = could not find container \"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11\": container with ID starting with fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11 not found: ID does not exist" Sep 15 17:34:04.706554 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.706553 2581 scope.go:117] "RemoveContainer" containerID="d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458" Sep 15 17:34:04.707060 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.707025 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458"} err="failed to get container status \"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458\": rpc error: code = NotFound desc = could not find container \"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458\": container with ID starting with d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458 not found: ID does not exist" Sep 15 17:34:04.707060 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.707052 2581 scope.go:117] "RemoveContainer" containerID="5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58" Sep 15 17:34:04.707353 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.707333 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58"} err="failed to get container status \"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58\": rpc error: code = NotFound desc = could not find container \"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58\": container with ID starting with 5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58 not found: ID does not exist" Sep 15 17:34:04.707404 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.707355 2581 scope.go:117] "RemoveContainer" containerID="bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89" Sep 15 17:34:04.707573 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.707558 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89"} err="failed to get container status \"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89\": rpc error: code = NotFound desc = could not find container \"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89\": container with ID starting with bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89 not found: ID does not exist" Sep 15 17:34:04.707619 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.707573 2581 scope.go:117] "RemoveContainer" containerID="0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6" Sep 15 17:34:04.707817 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.707799 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6"} err="failed to get container status \"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6\": rpc error: code = NotFound desc = could not find container \"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6\": container with ID starting with 0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6 not found: ID does not exist" Sep 15 17:34:04.707863 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.707817 2581 scope.go:117] "RemoveContainer" containerID="43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157" Sep 15 17:34:04.708056 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.708037 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157"} err="failed to get container status \"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157\": rpc error: code = NotFound desc = could not find container \"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157\": container with ID starting with 43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157 not found: ID does not exist" Sep 15 17:34:04.708152 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.708058 2581 scope.go:117] "RemoveContainer" containerID="453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf" Sep 15 17:34:04.708395 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.708377 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf"} err="failed to get container status \"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf\": rpc error: code = NotFound desc = could not find container \"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf\": container with ID starting with 453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf not found: ID does not exist" Sep 15 17:34:04.708454 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.708396 2581 scope.go:117] "RemoveContainer" containerID="fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11" Sep 15 17:34:04.708656 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.708639 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11"} err="failed to get container status \"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11\": rpc error: code = NotFound desc = could not find container \"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11\": container with ID starting with fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11 not found: ID does not exist" Sep 15 17:34:04.708699 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.708656 2581 scope.go:117] "RemoveContainer" containerID="d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458" Sep 15 17:34:04.708929 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.708902 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458"} err="failed to get container status \"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458\": rpc error: code = NotFound desc = could not find container \"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458\": container with ID starting with d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458 not found: ID does not exist" Sep 15 17:34:04.708929 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.708924 2581 scope.go:117] "RemoveContainer" containerID="5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58" Sep 15 17:34:04.709103 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.708936 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 15 17:34:04.709103 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709012 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 15 17:34:04.709103 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709036 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 15 17:34:04.709277 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709225 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58"} err="failed to get container status \"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58\": rpc error: code = NotFound desc = could not find container \"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58\": container with ID starting with 5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58 not found: ID does not exist" Sep 15 17:34:04.709277 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709251 2581 scope.go:117] "RemoveContainer" containerID="bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89" Sep 15 17:34:04.709388 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709356 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 15 17:34:04.709388 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709367 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 15 17:34:04.709617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709394 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 15 17:34:04.709617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709410 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 15 17:34:04.709617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709424 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jjgjc\"" Sep 15 17:34:04.709617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709356 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 15 17:34:04.709617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709523 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89"} err="failed to get container status \"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89\": rpc error: code = NotFound desc = could not find container \"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89\": container with ID starting with bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89 not found: ID does not exist" Sep 15 17:34:04.709617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709546 2581 scope.go:117] "RemoveContainer" containerID="0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6" Sep 15 17:34:04.709617 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709359 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 15 17:34:04.709974 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709654 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 15 17:34:04.709974 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709747 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 15 17:34:04.709974 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709787 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-apoi1i28rg727\"" Sep 15 17:34:04.709974 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709793 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6"} err="failed to get container status \"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6\": rpc error: code = NotFound desc = could not find container \"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6\": container with ID starting with 0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6 not found: ID does not exist" Sep 15 17:34:04.709974 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.709815 2581 scope.go:117] "RemoveContainer" containerID="43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157" Sep 15 17:34:04.710221 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.710063 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 15 17:34:04.710221 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.710062 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157"} err="failed to get container status \"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157\": rpc error: code = NotFound desc = could not find container \"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157\": container with ID starting with 43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157 not found: ID does not exist" Sep 15 17:34:04.710221 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.710097 2581 scope.go:117] "RemoveContainer" containerID="453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf" Sep 15 17:34:04.710221 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.710203 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 15 17:34:04.710423 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.710353 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf"} err="failed to get container status \"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf\": rpc error: code = NotFound desc = could not find container \"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf\": container with ID starting with 453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf not found: ID does not exist" Sep 15 17:34:04.710423 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.710376 2581 scope.go:117] "RemoveContainer" containerID="fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11" Sep 15 17:34:04.710642 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.710618 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11"} err="failed to get container status \"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11\": rpc error: code = NotFound desc = could not find container \"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11\": container with ID starting with fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11 not found: ID does not exist" Sep 15 17:34:04.710717 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.710643 2581 scope.go:117] "RemoveContainer" containerID="d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458" Sep 15 17:34:04.710893 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.710867 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458"} err="failed to get container status \"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458\": rpc error: code = NotFound desc = could not find container \"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458\": container with ID starting with d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458 not found: ID does not exist" Sep 15 17:34:04.710964 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.710895 2581 scope.go:117] "RemoveContainer" containerID="5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58" Sep 15 17:34:04.711217 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.711192 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58"} err="failed to get container status \"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58\": rpc error: code = NotFound desc = could not find container \"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58\": container with ID starting with 5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58 not found: ID does not exist" Sep 15 17:34:04.711217 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.711218 2581 scope.go:117] "RemoveContainer" containerID="bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89" Sep 15 17:34:04.711492 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.711474 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89"} err="failed to get container status \"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89\": rpc error: code = NotFound desc = could not find container \"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89\": container with ID starting with bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89 not found: ID does not exist" Sep 15 17:34:04.711492 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.711493 2581 scope.go:117] "RemoveContainer" containerID="0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6" Sep 15 17:34:04.711743 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.711723 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6"} err="failed to get container status \"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6\": rpc error: code = NotFound desc = could not find container \"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6\": container with ID starting with 0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6 not found: ID does not exist" Sep 15 17:34:04.711786 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.711745 2581 scope.go:117] "RemoveContainer" containerID="43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157" Sep 15 17:34:04.712002 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.711976 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157"} err="failed to get container status \"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157\": rpc error: code = NotFound desc = could not find container \"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157\": container with ID starting with 43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157 not found: ID does not exist" Sep 15 17:34:04.712107 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.712005 2581 scope.go:117] "RemoveContainer" containerID="453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf" Sep 15 17:34:04.712279 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.712257 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf"} err="failed to get container status \"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf\": rpc error: code = NotFound desc = could not find container \"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf\": container with ID starting with 453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf not found: ID does not exist" Sep 15 17:34:04.712346 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.712280 2581 scope.go:117] "RemoveContainer" containerID="fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11" Sep 15 17:34:04.712571 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.712547 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11"} err="failed to get container status \"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11\": rpc error: code = NotFound desc = could not find container \"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11\": container with ID starting with fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11 not found: ID does not exist" Sep 15 17:34:04.712679 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.712574 2581 scope.go:117] "RemoveContainer" containerID="d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458" Sep 15 17:34:04.712872 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.712847 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458"} err="failed to get container status \"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458\": rpc error: code = NotFound desc = could not find container \"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458\": container with ID starting with d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458 not found: ID does not exist" Sep 15 17:34:04.712872 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.712868 2581 scope.go:117] "RemoveContainer" containerID="5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58" Sep 15 17:34:04.713027 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.712953 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 15 17:34:04.713165 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.713138 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58"} err="failed to get container status \"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58\": rpc error: code = NotFound desc = could not find container \"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58\": container with ID starting with 5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58 not found: ID does not exist" Sep 15 17:34:04.713255 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.713166 2581 scope.go:117] "RemoveContainer" containerID="bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89" Sep 15 17:34:04.713439 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.713423 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89"} err="failed to get container status \"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89\": rpc error: code = NotFound desc = could not find container \"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89\": container with ID starting with bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89 not found: ID does not exist" Sep 15 17:34:04.713518 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.713441 2581 scope.go:117] "RemoveContainer" containerID="0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6" Sep 15 17:34:04.713696 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.713679 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6"} err="failed to get container status \"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6\": rpc error: code = NotFound desc = could not find container \"0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6\": container with ID starting with 0518ac68934067bc0e982ff963494ed491384d416749834dd34183ff31954cc6 not found: ID does not exist" Sep 15 17:34:04.713696 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.713694 2581 scope.go:117] "RemoveContainer" containerID="43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157" Sep 15 17:34:04.713955 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.713926 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157"} err="failed to get container status \"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157\": rpc error: code = NotFound desc = could not find container \"43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157\": container with ID starting with 43cf14103464236b00aa016f3b55296ccdc1232c0361460c3493a217279dd157 not found: ID does not exist" Sep 15 17:34:04.714047 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.713955 2581 scope.go:117] "RemoveContainer" containerID="453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf" Sep 15 17:34:04.714294 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.714266 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf"} err="failed to get container status \"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf\": rpc error: code = NotFound desc = could not find container \"453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf\": container with ID starting with 453ee044392a07f134aa699cc202b56ae6e4335bd66bef22ba712d8b85cb9adf not found: ID does not exist" Sep 15 17:34:04.714294 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.714294 2581 scope.go:117] "RemoveContainer" containerID="fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11" Sep 15 17:34:04.714596 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.714570 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11"} err="failed to get container status \"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11\": rpc error: code = NotFound desc = could not find container \"fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11\": container with ID starting with fce7accbfb755989b05f321ad3abd6d08ed938d996f1441ce082b9d3ed022e11 not found: ID does not exist" Sep 15 17:34:04.714667 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.714597 2581 scope.go:117] "RemoveContainer" containerID="d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458" Sep 15 17:34:04.714853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.714835 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458"} err="failed to get container status \"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458\": rpc error: code = NotFound desc = could not find container \"d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458\": container with ID starting with d4df8a96a70d22fd1bf8517e80e747df29ba238257c99d3370cfa127aba72458 not found: ID does not exist" Sep 15 17:34:04.714945 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.714854 2581 scope.go:117] "RemoveContainer" containerID="5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58" Sep 15 17:34:04.715120 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.715102 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58"} err="failed to get container status \"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58\": rpc error: code = NotFound desc = could not find container \"5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58\": container with ID starting with 5cb40a481a6bd5204d32744c2ae3d21a172333f4bf03bfb8905db8c38aa2bf58 not found: ID does not exist" Sep 15 17:34:04.715120 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.715119 2581 scope.go:117] "RemoveContainer" containerID="bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89" Sep 15 17:34:04.715401 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.715375 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89"} err="failed to get container status \"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89\": rpc error: code = NotFound desc = could not find container \"bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89\": container with ID starting with bacb6ad85eacd56fd67e7bc323546d94cd46342619eebeece4b675b2472f3c89 not found: ID does not exist" Sep 15 17:34:04.717076 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.717056 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 15 17:34:04.721292 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.721270 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:34:04.892562 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.892521 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.892757 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.892586 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.892757 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.892622 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.892757 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.892651 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.892757 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.892686 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.892973 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.892754 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.892973 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.892792 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-config-out\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.892973 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.892834 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.892973 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.892882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.892973 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.892927 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.892973 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.892965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.893303 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.893009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jw4m\" (UniqueName: \"kubernetes.io/projected/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-kube-api-access-5jw4m\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.893303 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.893042 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.893303 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.893076 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.893303 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.893147 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.893303 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.893173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-web-config\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.893303 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.893216 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.893303 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.893240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.893303 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.893273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.893303 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.893299 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-config\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.993753 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.993708 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.993753 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.993754 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-web-config\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.993964 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.993781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.993964 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.993796 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.993964 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.993819 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.993964 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.993839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-config\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.993964 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.993868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.994247 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.994103 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.994247 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.994147 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.994247 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.994185 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.994247 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.994218 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.994495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.994258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.994495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.994284 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-config-out\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.994495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.994312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.994495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.994366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.994495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.994401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.994495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.994440 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.994495 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.994469 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jw4m\" (UniqueName: \"kubernetes.io/projected/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-kube-api-access-5jw4m\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.994821 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.994507 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.994821 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.994533 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.994821 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.994646 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.994962 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.994895 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.994962 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.994928 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.996070 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.995217 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.996070 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.995888 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.997068 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.996950 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.997068 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.997008 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-web-config\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.997301 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.997279 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.997391 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.997289 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.997553 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.997513 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-config\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.997670 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.997641 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.998277 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.998252 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.999031 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.999004 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.999147 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.999064 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.999292 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.999273 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.999633 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.999611 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.999710 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.999684 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-config-out\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.999758 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.999748 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:04.999913 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:04.999895 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:05.003592 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:05.003568 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jw4m\" (UniqueName: \"kubernetes.io/projected/18ebe23b-6c3e-4551-b4ca-6f77a048f0fb-kube-api-access-5jw4m\") pod \"prometheus-k8s-0\" (UID: \"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:05.019568 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:05.019542 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:05.300688 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:05.300658 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 15 17:34:05.301983 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:34:05.301951 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ebe23b_6c3e_4551_b4ca_6f77a048f0fb.slice/crio-843e19703e1db0b78d6de56ecca8481b7adbed4f9facfc730259388723f91794 WatchSource:0}: Error finding container 843e19703e1db0b78d6de56ecca8481b7adbed4f9facfc730259388723f91794: Status 404 returned error can't find the container with id 843e19703e1db0b78d6de56ecca8481b7adbed4f9facfc730259388723f91794 Sep 15 17:34:05.654130 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:05.654095 2581 generic.go:356] "Generic (PLEG): container finished" podID="18ebe23b-6c3e-4551-b4ca-6f77a048f0fb" containerID="2e023185a8204ad2d73e25c5a496950c78b1730eac782546c3c16e6b689b4d8c" exitCode=0 Sep 15 17:34:05.654545 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:05.654176 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb","Type":"ContainerDied","Data":"2e023185a8204ad2d73e25c5a496950c78b1730eac782546c3c16e6b689b4d8c"} Sep 15 17:34:05.654545 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:05.654284 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb","Type":"ContainerStarted","Data":"843e19703e1db0b78d6de56ecca8481b7adbed4f9facfc730259388723f91794"} Sep 15 17:34:05.752452 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:05.752390 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="715225e9-64b5-4377-9c88-4b1501f661c6" path="/var/lib/kubelet/pods/715225e9-64b5-4377-9c88-4b1501f661c6/volumes" Sep 15 17:34:06.665058 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:06.665021 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb","Type":"ContainerStarted","Data":"a89aafb3ff4cf86666eaf4d08c1af6fcd390c5ca052c2b173333c780a5c62941"} Sep 15 17:34:06.665547 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:06.665125 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb","Type":"ContainerStarted","Data":"02d0c4ee9934f897950926d71cf22c7509143bc7e503fdc09d436e7d1e8b8f62"} Sep 15 17:34:06.665547 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:06.665173 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb","Type":"ContainerStarted","Data":"c85041d87f5753c112cf3afe6c872828bf5895f21541baaed56a4b7c1d1105ff"} Sep 15 17:34:06.665547 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:06.665219 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb","Type":"ContainerStarted","Data":"80e11c0c2fc0a9acbf58f8bc01bc785f97be0c85d6424251074dc55932431e4e"} Sep 15 17:34:06.665547 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:06.665264 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb","Type":"ContainerStarted","Data":"57911fd3cb0862240c90324d544208cf786f982410e6401ddcf6729d30d45e6b"} Sep 15 17:34:06.665547 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:06.665302 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18ebe23b-6c3e-4551-b4ca-6f77a048f0fb","Type":"ContainerStarted","Data":"610effdcea1560ea67b4c059e79da38ac7c3bf3c15666c8ca6c064f5a9692e45"} Sep 15 17:34:06.692905 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:06.692838 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.668728052 podStartE2EDuration="2.692816007s" totalImagesPullingTime="0s" totalInitContainerRuntime="24.087955ms" isStatefulPod=false podCreationTimestamp="2026-09-15 17:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:34:06.69053315 +0000 UTC m=+169.415351441" watchObservedRunningTime="2026-09-15 17:34:06.692816007 +0000 UTC m=+169.417634298" Sep 15 17:34:07.543993 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:07.543957 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:34:07.644979 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:07.644942 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:34:10.020209 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:10.020125 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:34:24.205826 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:24.205792 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:34:24.306395 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:24.306355 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:34:29.517836 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:29.517799 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:34:29.572656 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:29.572620 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:34:40.350304 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:40.350267 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:34:40.451110 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:40.451049 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:34:40.506026 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:34:40.505991 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:05.019992 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:05.019957 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:05.036005 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:05.035972 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:05.130308 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:05.130270 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:05.271678 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:05.271588 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:05.940543 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:05.940510 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 15 17:35:31.992749 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:31.992706 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:32.983326 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:32.983291 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:35.851340 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:35.851300 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:35.952483 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:35.952448 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:39.235534 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:39.235496 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:39.372210 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:39.372172 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:39.485854 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:39.485766 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:41.791567 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:41.791471 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:41.994464 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:41.994426 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:42.097306 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:42.097256 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:46.830976 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:46.830942 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:46.895124 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:46.895078 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:49.002116 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:49.002059 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:50.079491 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:50.079462 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:50.176276 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:50.176220 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:51.916012 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:51.915971 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75pxq"] Sep 15 17:35:51.919730 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:51.919704 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75pxq" Sep 15 17:35:51.921857 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:51.921834 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 15 17:35:51.922508 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:51.922490 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-p57fg\"" Sep 15 17:35:51.922605 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:51.922513 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 15 17:35:51.925966 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:51.925928 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75pxq"] Sep 15 17:35:51.966353 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:51.966302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b8d07c6-f937-4f15-b457-17762a2c3e28-tmp\") pod \"openshift-lws-operator-fd8ccff4c-75pxq\" (UID: \"2b8d07c6-f937-4f15-b457-17762a2c3e28\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75pxq" Sep 15 17:35:51.966532 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:51.966380 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z742s\" (UniqueName: \"kubernetes.io/projected/2b8d07c6-f937-4f15-b457-17762a2c3e28-kube-api-access-z742s\") pod \"openshift-lws-operator-fd8ccff4c-75pxq\" (UID: \"2b8d07c6-f937-4f15-b457-17762a2c3e28\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75pxq" Sep 15 17:35:52.067402 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:52.067361 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b8d07c6-f937-4f15-b457-17762a2c3e28-tmp\") pod \"openshift-lws-operator-fd8ccff4c-75pxq\" (UID: \"2b8d07c6-f937-4f15-b457-17762a2c3e28\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75pxq" Sep 15 17:35:52.067595 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:52.067429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z742s\" (UniqueName: \"kubernetes.io/projected/2b8d07c6-f937-4f15-b457-17762a2c3e28-kube-api-access-z742s\") pod \"openshift-lws-operator-fd8ccff4c-75pxq\" (UID: \"2b8d07c6-f937-4f15-b457-17762a2c3e28\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75pxq" Sep 15 17:35:52.067764 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:52.067743 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b8d07c6-f937-4f15-b457-17762a2c3e28-tmp\") pod \"openshift-lws-operator-fd8ccff4c-75pxq\" (UID: \"2b8d07c6-f937-4f15-b457-17762a2c3e28\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75pxq" Sep 15 17:35:52.075416 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:52.075385 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z742s\" (UniqueName: \"kubernetes.io/projected/2b8d07c6-f937-4f15-b457-17762a2c3e28-kube-api-access-z742s\") pod \"openshift-lws-operator-fd8ccff4c-75pxq\" (UID: \"2b8d07c6-f937-4f15-b457-17762a2c3e28\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75pxq" Sep 15 17:35:52.239403 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:52.239305 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75pxq" Sep 15 17:35:52.509600 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:52.509449 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75pxq"] Sep 15 17:35:52.512430 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:35:52.512397 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b8d07c6_f937_4f15_b457_17762a2c3e28.slice/crio-16cb7b92b7496f9617089cd7f7d7371d87830d46c3cafeffac12cf0eb850c23f WatchSource:0}: Error finding container 16cb7b92b7496f9617089cd7f7d7371d87830d46c3cafeffac12cf0eb850c23f: Status 404 returned error can't find the container with id 16cb7b92b7496f9617089cd7f7d7371d87830d46c3cafeffac12cf0eb850c23f Sep 15 17:35:53.132417 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:53.132381 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75pxq" event={"ID":"2b8d07c6-f937-4f15-b457-17762a2c3e28","Type":"ContainerStarted","Data":"16cb7b92b7496f9617089cd7f7d7371d87830d46c3cafeffac12cf0eb850c23f"} Sep 15 17:35:56.148931 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:56.148887 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75pxq" event={"ID":"2b8d07c6-f937-4f15-b457-17762a2c3e28","Type":"ContainerStarted","Data":"618b7925e031e98854589c94402ae88950b500264282b995f061a81fa0805a4e"} Sep 15 17:35:56.165431 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:56.165383 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75pxq" podStartSLOduration=2.402631335 podStartE2EDuration="5.165366236s" totalImagesPullingTime="2.762734901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:35:56.163915834 +0000 UTC m=+278.888734128" watchObservedRunningTime="2026-09-15 17:35:56.165366236 +0000 UTC m=+278.890184527" Sep 15 17:35:56.914848 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:56.914813 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:57.012518 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:57.012482 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:35:58.971891 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:35:58.971861 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:12.628963 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:12.628922 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:12.724459 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:12.724424 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:13.252920 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.252880 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:13.356261 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.356219 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:13.538192 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.538104 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:13.639119 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.639068 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:13.661516 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.661481 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b"] Sep 15 17:36:13.669182 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.666071 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:13.670490 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.670464 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 15 17:36:13.670808 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.670786 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 15 17:36:13.670898 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.670813 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 15 17:36:13.670967 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.670890 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 15 17:36:13.671177 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.671161 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qms4x\"" Sep 15 17:36:13.683415 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.683382 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b"] Sep 15 17:36:13.758815 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.758782 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5c8p\" (UniqueName: \"kubernetes.io/projected/670742cf-0992-4add-b7d9-87a8e9f24be2-kube-api-access-b5c8p\") pod \"opendatahub-operator-controller-manager-8444d5474c-4n57b\" (UID: \"670742cf-0992-4add-b7d9-87a8e9f24be2\") " pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:13.758815 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.758819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/670742cf-0992-4add-b7d9-87a8e9f24be2-tmp\") pod \"opendatahub-operator-controller-manager-8444d5474c-4n57b\" (UID: \"670742cf-0992-4add-b7d9-87a8e9f24be2\") " pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:13.759068 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.758841 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/670742cf-0992-4add-b7d9-87a8e9f24be2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8444d5474c-4n57b\" (UID: \"670742cf-0992-4add-b7d9-87a8e9f24be2\") " pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:13.759068 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.758856 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/670742cf-0992-4add-b7d9-87a8e9f24be2-webhook-cert\") pod \"opendatahub-operator-controller-manager-8444d5474c-4n57b\" (UID: \"670742cf-0992-4add-b7d9-87a8e9f24be2\") " pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:13.759068 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.758871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/670742cf-0992-4add-b7d9-87a8e9f24be2-manifests\") pod \"opendatahub-operator-controller-manager-8444d5474c-4n57b\" (UID: \"670742cf-0992-4add-b7d9-87a8e9f24be2\") " pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:13.803476 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.803387 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:13.859480 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.859446 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5c8p\" (UniqueName: \"kubernetes.io/projected/670742cf-0992-4add-b7d9-87a8e9f24be2-kube-api-access-b5c8p\") pod \"opendatahub-operator-controller-manager-8444d5474c-4n57b\" (UID: \"670742cf-0992-4add-b7d9-87a8e9f24be2\") " pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:13.859796 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.859487 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/670742cf-0992-4add-b7d9-87a8e9f24be2-tmp\") pod \"opendatahub-operator-controller-manager-8444d5474c-4n57b\" (UID: \"670742cf-0992-4add-b7d9-87a8e9f24be2\") " pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:13.859796 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.859512 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/670742cf-0992-4add-b7d9-87a8e9f24be2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8444d5474c-4n57b\" (UID: \"670742cf-0992-4add-b7d9-87a8e9f24be2\") " pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:13.859796 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.859537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/670742cf-0992-4add-b7d9-87a8e9f24be2-webhook-cert\") pod \"opendatahub-operator-controller-manager-8444d5474c-4n57b\" (UID: \"670742cf-0992-4add-b7d9-87a8e9f24be2\") " pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:13.859796 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.859641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/670742cf-0992-4add-b7d9-87a8e9f24be2-manifests\") pod \"opendatahub-operator-controller-manager-8444d5474c-4n57b\" (UID: \"670742cf-0992-4add-b7d9-87a8e9f24be2\") " pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:13.860067 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.860043 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/670742cf-0992-4add-b7d9-87a8e9f24be2-manifests\") pod \"opendatahub-operator-controller-manager-8444d5474c-4n57b\" (UID: \"670742cf-0992-4add-b7d9-87a8e9f24be2\") " pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:13.861906 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.861878 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/670742cf-0992-4add-b7d9-87a8e9f24be2-tmp\") pod \"opendatahub-operator-controller-manager-8444d5474c-4n57b\" (UID: \"670742cf-0992-4add-b7d9-87a8e9f24be2\") " pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:13.862206 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.862189 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/670742cf-0992-4add-b7d9-87a8e9f24be2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8444d5474c-4n57b\" (UID: \"670742cf-0992-4add-b7d9-87a8e9f24be2\") " pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:13.862286 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.862207 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/670742cf-0992-4add-b7d9-87a8e9f24be2-webhook-cert\") pod \"opendatahub-operator-controller-manager-8444d5474c-4n57b\" (UID: \"670742cf-0992-4add-b7d9-87a8e9f24be2\") " pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:13.871240 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.871213 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5c8p\" (UniqueName: \"kubernetes.io/projected/670742cf-0992-4add-b7d9-87a8e9f24be2-kube-api-access-b5c8p\") pod \"opendatahub-operator-controller-manager-8444d5474c-4n57b\" (UID: \"670742cf-0992-4add-b7d9-87a8e9f24be2\") " pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:13.916440 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.916408 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:13.977732 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:13.977703 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:14.013235 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:14.013203 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:14.116307 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:14.116276 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:14.214713 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:14.214674 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:14.257772 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:14.257740 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b"] Sep 15 17:36:14.261847 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:36:14.261813 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod670742cf_0992_4add_b7d9_87a8e9f24be2.slice/crio-1a0718901c1ac7535a52a6dac8358858abbbbf0378ae9d58b92307f4c897da88 WatchSource:0}: Error finding container 1a0718901c1ac7535a52a6dac8358858abbbbf0378ae9d58b92307f4c897da88: Status 404 returned error can't find the container with id 1a0718901c1ac7535a52a6dac8358858abbbbf0378ae9d58b92307f4c897da88 Sep 15 17:36:15.236684 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:15.236639 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" event={"ID":"670742cf-0992-4add-b7d9-87a8e9f24be2","Type":"ContainerStarted","Data":"1a0718901c1ac7535a52a6dac8358858abbbbf0378ae9d58b92307f4c897da88"} Sep 15 17:36:17.603059 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:17.603032 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qzlwj_ff23d4ac-6b19-456a-86b4-195197a89788/console-operator/1.log" Sep 15 17:36:17.603645 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:17.603618 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qzlwj_ff23d4ac-6b19-456a-86b4-195197a89788/console-operator/1.log" Sep 15 17:36:17.612349 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:17.612313 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/ovn-acl-logging/0.log" Sep 15 17:36:17.612939 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:17.612921 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/ovn-acl-logging/0.log" Sep 15 17:36:17.616138 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:17.616006 2581 kubelet.go:1648] "Image garbage collection succeeded" Sep 15 17:36:18.253638 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:18.253598 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" event={"ID":"670742cf-0992-4add-b7d9-87a8e9f24be2","Type":"ContainerStarted","Data":"9b1a8efd6ee9587a0ca5ad13a5a0b04e762f172b6c2b52a59c64021fc54c6779"} Sep 15 17:36:19.259987 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:19.259951 2581 generic.go:356] "Generic (PLEG): container finished" podID="670742cf-0992-4add-b7d9-87a8e9f24be2" containerID="9b1a8efd6ee9587a0ca5ad13a5a0b04e762f172b6c2b52a59c64021fc54c6779" exitCode=0 Sep 15 17:36:19.260414 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:19.260018 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" event={"ID":"670742cf-0992-4add-b7d9-87a8e9f24be2","Type":"ContainerDied","Data":"9b1a8efd6ee9587a0ca5ad13a5a0b04e762f172b6c2b52a59c64021fc54c6779"} Sep 15 17:36:19.260554 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:19.260538 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 17:36:19.327448 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:19.327411 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:20.266140 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:20.266068 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" event={"ID":"670742cf-0992-4add-b7d9-87a8e9f24be2","Type":"ContainerStarted","Data":"8dc5777f06a82a5c2c1778fe6f316df3c3cab88301626a6d4146ffa25836a2d8"} Sep 15 17:36:20.266548 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:20.266270 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:20.285653 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:20.285570 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" podStartSLOduration=2.667306612 podStartE2EDuration="7.285553951s" totalImagesPullingTime="3.582687569s" totalInitContainerRuntime="1.03555977s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:36:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:36:20.284355373 +0000 UTC m=+303.009173665" watchObservedRunningTime="2026-09-15 17:36:20.285553951 +0000 UTC m=+303.010372241" Sep 15 17:36:25.208232 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:25.208195 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:26.426523 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:26.426485 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:31.276050 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:31.276017 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8444d5474c-4n57b" Sep 15 17:36:33.590334 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:33.590300 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:33.727220 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:33.727184 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:39.251724 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.251691 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:39.303756 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.303717 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p"] Sep 15 17:36:39.317553 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.317514 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p"] Sep 15 17:36:39.317721 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.317632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p" Sep 15 17:36:39.319932 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.319903 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 15 17:36:39.320101 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.319982 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4thw5\"" Sep 15 17:36:39.320101 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.320007 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 15 17:36:39.392223 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.392184 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f860ab3-34be-4353-9ca9-70f402fbf1e0-tmp\") pod \"kube-auth-proxy-58595d97fd-zlc9p\" (UID: \"8f860ab3-34be-4353-9ca9-70f402fbf1e0\") " pod="openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p" Sep 15 17:36:39.392413 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.392248 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x5zl\" (UniqueName: \"kubernetes.io/projected/8f860ab3-34be-4353-9ca9-70f402fbf1e0-kube-api-access-5x5zl\") pod \"kube-auth-proxy-58595d97fd-zlc9p\" (UID: \"8f860ab3-34be-4353-9ca9-70f402fbf1e0\") " pod="openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p" Sep 15 17:36:39.392413 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.392310 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f860ab3-34be-4353-9ca9-70f402fbf1e0-tls-certs\") pod \"kube-auth-proxy-58595d97fd-zlc9p\" (UID: \"8f860ab3-34be-4353-9ca9-70f402fbf1e0\") " pod="openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p" Sep 15 17:36:39.493674 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.493638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f860ab3-34be-4353-9ca9-70f402fbf1e0-tmp\") pod \"kube-auth-proxy-58595d97fd-zlc9p\" (UID: \"8f860ab3-34be-4353-9ca9-70f402fbf1e0\") " pod="openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p" Sep 15 17:36:39.493858 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.493695 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x5zl\" (UniqueName: \"kubernetes.io/projected/8f860ab3-34be-4353-9ca9-70f402fbf1e0-kube-api-access-5x5zl\") pod \"kube-auth-proxy-58595d97fd-zlc9p\" (UID: \"8f860ab3-34be-4353-9ca9-70f402fbf1e0\") " pod="openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p" Sep 15 17:36:39.493858 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.493720 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f860ab3-34be-4353-9ca9-70f402fbf1e0-tls-certs\") pod \"kube-auth-proxy-58595d97fd-zlc9p\" (UID: \"8f860ab3-34be-4353-9ca9-70f402fbf1e0\") " pod="openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p" Sep 15 17:36:39.493858 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:36:39.493811 2581 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 15 17:36:39.493999 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:36:39.493873 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f860ab3-34be-4353-9ca9-70f402fbf1e0-tls-certs podName:8f860ab3-34be-4353-9ca9-70f402fbf1e0 nodeName:}" failed. No retries permitted until 2026-09-15 17:36:39.993856049 +0000 UTC m=+322.718674343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8f860ab3-34be-4353-9ca9-70f402fbf1e0-tls-certs") pod "kube-auth-proxy-58595d97fd-zlc9p" (UID: "8f860ab3-34be-4353-9ca9-70f402fbf1e0") : secret "kube-auth-proxy-tls" not found Sep 15 17:36:39.495894 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.495867 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f860ab3-34be-4353-9ca9-70f402fbf1e0-tmp\") pod \"kube-auth-proxy-58595d97fd-zlc9p\" (UID: \"8f860ab3-34be-4353-9ca9-70f402fbf1e0\") " pod="openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p" Sep 15 17:36:39.504138 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.504066 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x5zl\" (UniqueName: \"kubernetes.io/projected/8f860ab3-34be-4353-9ca9-70f402fbf1e0-kube-api-access-5x5zl\") pod \"kube-auth-proxy-58595d97fd-zlc9p\" (UID: \"8f860ab3-34be-4353-9ca9-70f402fbf1e0\") " pod="openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p" Sep 15 17:36:39.552969 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.552930 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:39.998312 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:39.998268 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f860ab3-34be-4353-9ca9-70f402fbf1e0-tls-certs\") pod \"kube-auth-proxy-58595d97fd-zlc9p\" (UID: \"8f860ab3-34be-4353-9ca9-70f402fbf1e0\") " pod="openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p" Sep 15 17:36:40.000983 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.000954 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f860ab3-34be-4353-9ca9-70f402fbf1e0-tls-certs\") pod \"kube-auth-proxy-58595d97fd-zlc9p\" (UID: \"8f860ab3-34be-4353-9ca9-70f402fbf1e0\") " pod="openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p" Sep 15 17:36:40.228998 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.228963 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p" Sep 15 17:36:40.281681 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.281649 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:40.289229 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.289203 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c"] Sep 15 17:36:40.293024 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.293001 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.295267 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.295124 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 15 17:36:40.295392 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.295271 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 15 17:36:40.295630 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.295456 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 15 17:36:40.295630 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.295489 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9rbtv\"" Sep 15 17:36:40.295630 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.295537 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 15 17:36:40.302673 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.302643 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c"] Sep 15 17:36:40.346696 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.346660 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:40.402200 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.402164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d2e49ad-2942-4756-95b4-7700cf5ea596-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.402377 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.402210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.402377 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.402260 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.402377 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.402293 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.402377 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.402341 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.402527 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.402393 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q4r4\" (UniqueName: \"kubernetes.io/projected/0d2e49ad-2942-4756-95b4-7700cf5ea596-kube-api-access-4q4r4\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.402527 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.402418 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.503451 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.503415 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q4r4\" (UniqueName: \"kubernetes.io/projected/0d2e49ad-2942-4756-95b4-7700cf5ea596-kube-api-access-4q4r4\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.503645 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.503465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.503645 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.503511 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d2e49ad-2942-4756-95b4-7700cf5ea596-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.503645 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.503554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.503645 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.503597 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.503645 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.503639 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.503912 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.503684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.504742 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.504631 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p"] Sep 15 17:36:40.504991 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.504963 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.506303 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.506279 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d2e49ad-2942-4756-95b4-7700cf5ea596-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.506303 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.506291 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.506536 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.506514 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.507525 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.507498 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.507635 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:36:40.507615 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f860ab3_34be_4353_9ca9_70f402fbf1e0.slice/crio-94a8dcc54a6cfada46b487b4e19152a6b3966ea25d10819448cebf31ddfb8e64 WatchSource:0}: Error finding container 94a8dcc54a6cfada46b487b4e19152a6b3966ea25d10819448cebf31ddfb8e64: Status 404 returned error can't find the container with id 94a8dcc54a6cfada46b487b4e19152a6b3966ea25d10819448cebf31ddfb8e64 Sep 15 17:36:40.510878 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.510858 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.511440 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.511413 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q4r4\" (UniqueName: \"kubernetes.io/projected/0d2e49ad-2942-4756-95b4-7700cf5ea596-kube-api-access-4q4r4\") pod \"istiod-openshift-gateway-7b7995d5cd-l6w5c\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.607454 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.607428 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:40.882791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:40.882765 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c"] Sep 15 17:36:40.884868 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:36:40.884839 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d2e49ad_2942_4756_95b4_7700cf5ea596.slice/crio-5147544ee9a500b190fadedc012e7146ad08b46f71fb0add861dd86c85b8ef86 WatchSource:0}: Error finding container 5147544ee9a500b190fadedc012e7146ad08b46f71fb0add861dd86c85b8ef86: Status 404 returned error can't find the container with id 5147544ee9a500b190fadedc012e7146ad08b46f71fb0add861dd86c85b8ef86 Sep 15 17:36:41.125664 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:41.125631 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:41.367897 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:41.367806 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" event={"ID":"0d2e49ad-2942-4756-95b4-7700cf5ea596","Type":"ContainerStarted","Data":"5147544ee9a500b190fadedc012e7146ad08b46f71fb0add861dd86c85b8ef86"} Sep 15 17:36:41.369493 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:41.369433 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p" event={"ID":"8f860ab3-34be-4353-9ca9-70f402fbf1e0","Type":"ContainerStarted","Data":"94a8dcc54a6cfada46b487b4e19152a6b3966ea25d10819448cebf31ddfb8e64"} Sep 15 17:36:44.532760 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:44.532717 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 17:36:44.533077 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:44.532792 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 17:36:44.572303 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:44.572266 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:44.639441 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:44.639408 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:44.738408 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:44.738376 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:44.966212 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:44.966175 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:45.153632 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:45.153599 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:45.282400 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:45.282312 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:45.382747 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:45.382713 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:45.395396 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:45.395363 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" event={"ID":"0d2e49ad-2942-4756-95b4-7700cf5ea596","Type":"ContainerStarted","Data":"d8e2cfc3b926830d118b5510e0a4a2ed9d9bb9bda15e7e8cf263c23b77953a9c"} Sep 15 17:36:45.395571 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:45.395526 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:45.397276 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:45.397244 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p" event={"ID":"8f860ab3-34be-4353-9ca9-70f402fbf1e0","Type":"ContainerStarted","Data":"c8057731064117e0ba3e08cb3de777a13b0e90dfebb7d425d03c965c091fdee9"} Sep 15 17:36:45.397497 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:45.397467 2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-l6w5c container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 15 17:36:45.397601 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:45.397528 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" podUID="0d2e49ad-2942-4756-95b4-7700cf5ea596" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 15 17:36:45.415868 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:45.415816 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" podStartSLOduration=1.7704275680000001 podStartE2EDuration="5.415800076s" totalImagesPullingTime="3.645372508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:36:45.414460056 +0000 UTC m=+328.139278349" watchObservedRunningTime="2026-09-15 17:36:45.415800076 +0000 UTC m=+328.140618364" Sep 15 17:36:45.433219 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:45.433168 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-58595d97fd-zlc9p" podStartSLOduration=2.409192284 podStartE2EDuration="6.433151027s" totalImagesPullingTime="4.023958743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:36:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:36:45.432248645 +0000 UTC m=+328.157066939" watchObservedRunningTime="2026-09-15 17:36:45.433151027 +0000 UTC m=+328.157969317" Sep 15 17:36:45.861182 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:45.861152 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:46.121816 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:46.121730 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:46.298958 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:46.298917 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:46.402384 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:46.402309 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:48.282400 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:48.282369 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:48.343441 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:48.343413 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:50.027494 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:50.027455 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:54.110634 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.110602 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:54.160884 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.160843 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-887zc"] Sep 15 17:36:54.164937 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.164913 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-887zc" Sep 15 17:36:54.167194 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.167167 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 15 17:36:54.167316 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.167276 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-766px\"" Sep 15 17:36:54.174129 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.174074 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm"] Sep 15 17:36:54.178238 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.178212 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-887zc"] Sep 15 17:36:54.178382 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.178306 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm" Sep 15 17:36:54.180382 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.180343 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 15 17:36:54.180512 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.180466 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-bxdlk\"" Sep 15 17:36:54.189066 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.189040 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm"] Sep 15 17:36:54.201454 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.201424 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:54.334853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.334813 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fh5nm\" (UID: \"ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm" Sep 15 17:36:54.335032 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.334860 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbcgk\" (UniqueName: \"kubernetes.io/projected/defc24c0-9272-4801-a2d0-8ae2e8559be8-kube-api-access-xbcgk\") pod \"kserve-controller-manager-d6f4b65b8-887zc\" (UID: \"defc24c0-9272-4801-a2d0-8ae2e8559be8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-887zc" Sep 15 17:36:54.335032 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.334921 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrnjs\" (UniqueName: \"kubernetes.io/projected/ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac-kube-api-access-mrnjs\") pod \"llmisvc-controller-manager-777c6bd7d5-fh5nm\" (UID: \"ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm" Sep 15 17:36:54.335032 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.334949 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/defc24c0-9272-4801-a2d0-8ae2e8559be8-cert\") pod \"kserve-controller-manager-d6f4b65b8-887zc\" (UID: \"defc24c0-9272-4801-a2d0-8ae2e8559be8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-887zc" Sep 15 17:36:54.368863 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.368762 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:54.436307 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.436269 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fh5nm\" (UID: \"ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm" Sep 15 17:36:54.436487 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.436321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbcgk\" (UniqueName: \"kubernetes.io/projected/defc24c0-9272-4801-a2d0-8ae2e8559be8-kube-api-access-xbcgk\") pod \"kserve-controller-manager-d6f4b65b8-887zc\" (UID: \"defc24c0-9272-4801-a2d0-8ae2e8559be8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-887zc" Sep 15 17:36:54.436487 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.436379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrnjs\" (UniqueName: \"kubernetes.io/projected/ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac-kube-api-access-mrnjs\") pod \"llmisvc-controller-manager-777c6bd7d5-fh5nm\" (UID: \"ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm" Sep 15 17:36:54.436487 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.436419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/defc24c0-9272-4801-a2d0-8ae2e8559be8-cert\") pod \"kserve-controller-manager-d6f4b65b8-887zc\" (UID: \"defc24c0-9272-4801-a2d0-8ae2e8559be8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-887zc" Sep 15 17:36:54.436487 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:36:54.436423 2581 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Sep 15 17:36:54.436974 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:36:54.436940 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac-cert podName:ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac nodeName:}" failed. No retries permitted until 2026-09-15 17:36:54.93690874 +0000 UTC m=+337.661727018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac-cert") pod "llmisvc-controller-manager-777c6bd7d5-fh5nm" (UID: "ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac") : secret "llmisvc-webhook-server-cert" not found Sep 15 17:36:54.440285 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.440253 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/defc24c0-9272-4801-a2d0-8ae2e8559be8-cert\") pod \"kserve-controller-manager-d6f4b65b8-887zc\" (UID: \"defc24c0-9272-4801-a2d0-8ae2e8559be8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-887zc" Sep 15 17:36:54.452765 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.452727 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbcgk\" (UniqueName: \"kubernetes.io/projected/defc24c0-9272-4801-a2d0-8ae2e8559be8-kube-api-access-xbcgk\") pod \"kserve-controller-manager-d6f4b65b8-887zc\" (UID: \"defc24c0-9272-4801-a2d0-8ae2e8559be8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-887zc" Sep 15 17:36:54.456144 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.456112 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrnjs\" (UniqueName: \"kubernetes.io/projected/ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac-kube-api-access-mrnjs\") pod \"llmisvc-controller-manager-777c6bd7d5-fh5nm\" (UID: \"ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm" Sep 15 17:36:54.476483 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.476430 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-887zc" Sep 15 17:36:54.544897 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.544840 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:54.762660 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.762597 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-887zc"] Sep 15 17:36:54.765680 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:36:54.765649 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddefc24c0_9272_4801_a2d0_8ae2e8559be8.slice/crio-24ae0a80cec4e18ab9d64e39852debff9e2cadf5c7054b95d38be6b4807d249d WatchSource:0}: Error finding container 24ae0a80cec4e18ab9d64e39852debff9e2cadf5c7054b95d38be6b4807d249d: Status 404 returned error can't find the container with id 24ae0a80cec4e18ab9d64e39852debff9e2cadf5c7054b95d38be6b4807d249d Sep 15 17:36:54.941615 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.941570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fh5nm\" (UID: \"ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm" Sep 15 17:36:54.944011 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:54.943988 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fh5nm\" (UID: \"ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm" Sep 15 17:36:55.089279 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:55.089250 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm" Sep 15 17:36:55.367682 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:55.367654 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm"] Sep 15 17:36:55.369514 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:36:55.369482 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podff47d4aa_fc1b_48fa_b3d3_cdabf2f65cac.slice/crio-ae1bc1167c20e5a517375ddc1fd24ee95dd61b8286d37eb220e4e627dc7e6edd WatchSource:0}: Error finding container ae1bc1167c20e5a517375ddc1fd24ee95dd61b8286d37eb220e4e627dc7e6edd: Status 404 returned error can't find the container with id ae1bc1167c20e5a517375ddc1fd24ee95dd61b8286d37eb220e4e627dc7e6edd Sep 15 17:36:55.386791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:55.386760 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:55.456643 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:55.456603 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm" event={"ID":"ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac","Type":"ContainerStarted","Data":"ae1bc1167c20e5a517375ddc1fd24ee95dd61b8286d37eb220e4e627dc7e6edd"} Sep 15 17:36:55.458032 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:55.457991 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-887zc" event={"ID":"defc24c0-9272-4801-a2d0-8ae2e8559be8","Type":"ContainerStarted","Data":"24ae0a80cec4e18ab9d64e39852debff9e2cadf5c7054b95d38be6b4807d249d"} Sep 15 17:36:55.503184 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:55.503144 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:36:56.180389 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:56.180353 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c"] Sep 15 17:36:56.181136 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:56.180702 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" podUID="0d2e49ad-2942-4756-95b4-7700cf5ea596" containerName="discovery" containerID="cri-o://d8e2cfc3b926830d118b5510e0a4a2ed9d9bb9bda15e7e8cf263c23b77953a9c" gracePeriod=30 Sep 15 17:36:56.467159 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:56.467073 2581 generic.go:356] "Generic (PLEG): container finished" podID="0d2e49ad-2942-4756-95b4-7700cf5ea596" containerID="d8e2cfc3b926830d118b5510e0a4a2ed9d9bb9bda15e7e8cf263c23b77953a9c" exitCode=0 Sep 15 17:36:56.467159 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:56.467129 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" event={"ID":"0d2e49ad-2942-4756-95b4-7700cf5ea596","Type":"ContainerDied","Data":"d8e2cfc3b926830d118b5510e0a4a2ed9d9bb9bda15e7e8cf263c23b77953a9c"} Sep 15 17:36:57.046939 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.046913 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:57.162525 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.162490 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4q4r4\" (UniqueName: \"kubernetes.io/projected/0d2e49ad-2942-4756-95b4-7700cf5ea596-kube-api-access-4q4r4\") pod \"0d2e49ad-2942-4756-95b4-7700cf5ea596\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " Sep 15 17:36:57.162693 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.162546 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-token\") pod \"0d2e49ad-2942-4756-95b4-7700cf5ea596\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " Sep 15 17:36:57.162693 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.162588 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-cacerts\") pod \"0d2e49ad-2942-4756-95b4-7700cf5ea596\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " Sep 15 17:36:57.162693 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.162609 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-kubeconfig\") pod \"0d2e49ad-2942-4756-95b4-7700cf5ea596\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " Sep 15 17:36:57.162693 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.162646 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-csr-ca-configmap\") pod \"0d2e49ad-2942-4756-95b4-7700cf5ea596\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " Sep 15 17:36:57.162693 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.162678 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d2e49ad-2942-4756-95b4-7700cf5ea596-local-certs\") pod \"0d2e49ad-2942-4756-95b4-7700cf5ea596\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " Sep 15 17:36:57.162945 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.162725 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-csr-dns-cert\") pod \"0d2e49ad-2942-4756-95b4-7700cf5ea596\" (UID: \"0d2e49ad-2942-4756-95b4-7700cf5ea596\") " Sep 15 17:36:57.163852 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.163788 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "0d2e49ad-2942-4756-95b4-7700cf5ea596" (UID: "0d2e49ad-2942-4756-95b4-7700cf5ea596"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:36:57.165490 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.165456 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-token" (OuterVolumeSpecName: "istio-token") pod "0d2e49ad-2942-4756-95b4-7700cf5ea596" (UID: "0d2e49ad-2942-4756-95b4-7700cf5ea596"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:36:57.165618 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.165499 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-cacerts" (OuterVolumeSpecName: "cacerts") pod "0d2e49ad-2942-4756-95b4-7700cf5ea596" (UID: "0d2e49ad-2942-4756-95b4-7700cf5ea596"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:36:57.165618 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.165506 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "0d2e49ad-2942-4756-95b4-7700cf5ea596" (UID: "0d2e49ad-2942-4756-95b4-7700cf5ea596"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:36:57.165618 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.165550 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "0d2e49ad-2942-4756-95b4-7700cf5ea596" (UID: "0d2e49ad-2942-4756-95b4-7700cf5ea596"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:36:57.165854 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.165835 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d2e49ad-2942-4756-95b4-7700cf5ea596-kube-api-access-4q4r4" (OuterVolumeSpecName: "kube-api-access-4q4r4") pod "0d2e49ad-2942-4756-95b4-7700cf5ea596" (UID: "0d2e49ad-2942-4756-95b4-7700cf5ea596"). InnerVolumeSpecName "kube-api-access-4q4r4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:36:57.165964 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.165945 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d2e49ad-2942-4756-95b4-7700cf5ea596-local-certs" (OuterVolumeSpecName: "local-certs") pod "0d2e49ad-2942-4756-95b4-7700cf5ea596" (UID: "0d2e49ad-2942-4756-95b4-7700cf5ea596"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 17:36:57.263552 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.263518 2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-cacerts\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:36:57.263552 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.263552 2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-kubeconfig\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:36:57.263783 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.263567 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-csr-ca-configmap\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:36:57.263783 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.263581 2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d2e49ad-2942-4756-95b4-7700cf5ea596-local-certs\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:36:57.263783 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.263593 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-csr-dns-cert\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:36:57.263783 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.263603 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q4r4\" (UniqueName: \"kubernetes.io/projected/0d2e49ad-2942-4756-95b4-7700cf5ea596-kube-api-access-4q4r4\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:36:57.263783 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.263615 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d2e49ad-2942-4756-95b4-7700cf5ea596-istio-token\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:36:57.474537 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.474498 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" event={"ID":"0d2e49ad-2942-4756-95b4-7700cf5ea596","Type":"ContainerDied","Data":"5147544ee9a500b190fadedc012e7146ad08b46f71fb0add861dd86c85b8ef86"} Sep 15 17:36:57.474537 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.474526 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c" Sep 15 17:36:57.475072 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.474558 2581 scope.go:117] "RemoveContainer" containerID="d8e2cfc3b926830d118b5510e0a4a2ed9d9bb9bda15e7e8cf263c23b77953a9c" Sep 15 17:36:57.497470 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.497436 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c"] Sep 15 17:36:57.501236 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.501210 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-l6w5c"] Sep 15 17:36:57.754243 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:57.754207 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d2e49ad-2942-4756-95b4-7700cf5ea596" path="/var/lib/kubelet/pods/0d2e49ad-2942-4756-95b4-7700cf5ea596/volumes" Sep 15 17:36:58.480553 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:58.480518 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-887zc" event={"ID":"defc24c0-9272-4801-a2d0-8ae2e8559be8","Type":"ContainerStarted","Data":"07a05cfca398caeb78f6ac9c3fbc03fdffedb890ec9ceb90ba68a02045dd29af"} Sep 15 17:36:58.480994 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:58.480584 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-887zc" Sep 15 17:36:58.495472 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:36:58.495425 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-887zc" podStartSLOduration=1.971565158 podStartE2EDuration="4.49540943s" totalImagesPullingTime="2.523844272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:36:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:36:58.49453747 +0000 UTC m=+341.219355762" watchObservedRunningTime="2026-09-15 17:36:58.49540943 +0000 UTC m=+341.220227722" Sep 15 17:37:00.493188 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:37:00.493154 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm" event={"ID":"ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac","Type":"ContainerStarted","Data":"45d1d8b254e8a46a336be8f56561e61aaae87b3a6b69da6dd07e4d1b86fcfeb9"} Sep 15 17:37:00.493616 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:37:00.493230 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm" Sep 15 17:37:00.510838 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:37:00.510784 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm" podStartSLOduration=2.191734249 podStartE2EDuration="6.510767852s" totalImagesPullingTime="4.319033603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:36:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:37:00.510333268 +0000 UTC m=+343.235151571" watchObservedRunningTime="2026-09-15 17:37:00.510767852 +0000 UTC m=+343.235586143" Sep 15 17:37:29.492028 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:37:29.491995 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-887zc" Sep 15 17:37:31.500138 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:37:31.500108 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fh5nm" Sep 15 17:37:45.821062 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:37:45.821000 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:37:45.917845 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:37:45.917807 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:37:59.150240 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:37:59.150207 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:37:59.944990 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:37:59.944956 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:00.742356 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:00.742319 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:01.934233 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:01.934202 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:03.025161 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:03.025125 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:03.897244 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:03.897208 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4"] Sep 15 17:38:03.897592 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:03.897579 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d2e49ad-2942-4756-95b4-7700cf5ea596" containerName="discovery" Sep 15 17:38:03.897592 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:03.897593 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d2e49ad-2942-4756-95b4-7700cf5ea596" containerName="discovery" Sep 15 17:38:03.897694 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:03.897684 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d2e49ad-2942-4756-95b4-7700cf5ea596" containerName="discovery" Sep 15 17:38:03.900718 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:03.900697 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:03.903144 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:03.903121 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 15 17:38:03.903291 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:03.903188 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8hpbk\"" Sep 15 17:38:03.903411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:03.903395 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 15 17:38:03.915736 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:03.915707 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4"] Sep 15 17:38:03.952418 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:03.952380 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1baff4c-8f3b-4987-8044-4d69920a0df6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" (UID: \"b1baff4c-8f3b-4987-8044-4d69920a0df6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:03.952566 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:03.952445 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8jpg\" (UniqueName: \"kubernetes.io/projected/b1baff4c-8f3b-4987-8044-4d69920a0df6-kube-api-access-g8jpg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" (UID: \"b1baff4c-8f3b-4987-8044-4d69920a0df6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:03.973415 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:03.973379 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:04.053923 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:04.053883 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1baff4c-8f3b-4987-8044-4d69920a0df6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" (UID: \"b1baff4c-8f3b-4987-8044-4d69920a0df6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:04.054347 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:04.053946 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8jpg\" (UniqueName: \"kubernetes.io/projected/b1baff4c-8f3b-4987-8044-4d69920a0df6-kube-api-access-g8jpg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" (UID: \"b1baff4c-8f3b-4987-8044-4d69920a0df6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:04.054347 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:04.054328 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1baff4c-8f3b-4987-8044-4d69920a0df6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" (UID: \"b1baff4c-8f3b-4987-8044-4d69920a0df6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:04.069643 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:04.069616 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8jpg\" (UniqueName: \"kubernetes.io/projected/b1baff4c-8f3b-4987-8044-4d69920a0df6-kube-api-access-g8jpg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" (UID: \"b1baff4c-8f3b-4987-8044-4d69920a0df6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:04.211557 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:04.211457 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:04.364509 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:04.364468 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:04.498579 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:04.498552 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4"] Sep 15 17:38:04.501478 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:38:04.501439 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1baff4c_8f3b_4987_8044_4d69920a0df6.slice/crio-a90ce3901e6e2fc8611490200aed9d497342d484f5369a5415eab603137942b2 WatchSource:0}: Error finding container a90ce3901e6e2fc8611490200aed9d497342d484f5369a5415eab603137942b2: Status 404 returned error can't find the container with id a90ce3901e6e2fc8611490200aed9d497342d484f5369a5415eab603137942b2 Sep 15 17:38:04.607196 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:04.607160 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:04.797688 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:04.797599 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" event={"ID":"b1baff4c-8f3b-4987-8044-4d69920a0df6","Type":"ContainerStarted","Data":"a90ce3901e6e2fc8611490200aed9d497342d484f5369a5415eab603137942b2"} Sep 15 17:38:06.334619 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:06.334576 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-jf4dl"] Sep 15 17:38:06.341831 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:06.341803 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-jf4dl" Sep 15 17:38:06.344269 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:06.344241 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-phdh9\"" Sep 15 17:38:06.349586 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:06.349556 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-jf4dl"] Sep 15 17:38:06.384026 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:06.383985 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l7ps\" (UniqueName: \"kubernetes.io/projected/a2859f41-902e-4a3a-8541-89a1ce8080a9-kube-api-access-7l7ps\") pod \"authorino-operator-76b478bd78-jf4dl\" (UID: \"a2859f41-902e-4a3a-8541-89a1ce8080a9\") " pod="kuadrant-system/authorino-operator-76b478bd78-jf4dl" Sep 15 17:38:06.485458 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:06.485409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l7ps\" (UniqueName: \"kubernetes.io/projected/a2859f41-902e-4a3a-8541-89a1ce8080a9-kube-api-access-7l7ps\") pod \"authorino-operator-76b478bd78-jf4dl\" (UID: \"a2859f41-902e-4a3a-8541-89a1ce8080a9\") " pod="kuadrant-system/authorino-operator-76b478bd78-jf4dl" Sep 15 17:38:06.500270 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:06.500203 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l7ps\" (UniqueName: \"kubernetes.io/projected/a2859f41-902e-4a3a-8541-89a1ce8080a9-kube-api-access-7l7ps\") pod \"authorino-operator-76b478bd78-jf4dl\" (UID: \"a2859f41-902e-4a3a-8541-89a1ce8080a9\") " pod="kuadrant-system/authorino-operator-76b478bd78-jf4dl" Sep 15 17:38:06.600433 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:06.600335 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:06.659637 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:06.659601 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-jf4dl" Sep 15 17:38:06.750468 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:06.750433 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:06.844862 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:06.844817 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:06.970879 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:06.970758 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:07.290194 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:07.290112 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:07.301876 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:07.301843 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-jf4dl"] Sep 15 17:38:07.304159 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:38:07.304127 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2859f41_902e_4a3a_8541_89a1ce8080a9.slice/crio-d865bdd7bf2f5fd4eeb15abfbc87037125d33a9c32c8094c701bfb2ea4c71c62 WatchSource:0}: Error finding container d865bdd7bf2f5fd4eeb15abfbc87037125d33a9c32c8094c701bfb2ea4c71c62: Status 404 returned error can't find the container with id d865bdd7bf2f5fd4eeb15abfbc87037125d33a9c32c8094c701bfb2ea4c71c62 Sep 15 17:38:07.391776 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:07.391743 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:07.821149 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:07.821101 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-jf4dl" event={"ID":"a2859f41-902e-4a3a-8541-89a1ce8080a9","Type":"ContainerStarted","Data":"d865bdd7bf2f5fd4eeb15abfbc87037125d33a9c32c8094c701bfb2ea4c71c62"} Sep 15 17:38:08.328253 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:08.328213 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-98cml"] Sep 15 17:38:08.332324 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:08.332297 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-98cml" Sep 15 17:38:08.334692 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:08.334665 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 15 17:38:08.334836 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:08.334666 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-96z8d\"" Sep 15 17:38:08.343299 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:08.343253 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-98cml"] Sep 15 17:38:08.403485 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:08.403441 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7jc4\" (UniqueName: \"kubernetes.io/projected/48272a33-8f62-42a9-9308-fae1b3b88bd9-kube-api-access-h7jc4\") pod \"dns-operator-controller-manager-7b84cd7c9c-98cml\" (UID: \"48272a33-8f62-42a9-9308-fae1b3b88bd9\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-98cml" Sep 15 17:38:08.504289 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:08.504250 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7jc4\" (UniqueName: \"kubernetes.io/projected/48272a33-8f62-42a9-9308-fae1b3b88bd9-kube-api-access-h7jc4\") pod \"dns-operator-controller-manager-7b84cd7c9c-98cml\" (UID: \"48272a33-8f62-42a9-9308-fae1b3b88bd9\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-98cml" Sep 15 17:38:08.514811 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:08.514777 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7jc4\" (UniqueName: \"kubernetes.io/projected/48272a33-8f62-42a9-9308-fae1b3b88bd9-kube-api-access-h7jc4\") pod \"dns-operator-controller-manager-7b84cd7c9c-98cml\" (UID: \"48272a33-8f62-42a9-9308-fae1b3b88bd9\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-98cml" Sep 15 17:38:08.646629 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:08.646588 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-98cml" Sep 15 17:38:08.834635 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:08.834595 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" event={"ID":"b1baff4c-8f3b-4987-8044-4d69920a0df6","Type":"ContainerStarted","Data":"0085b8b0d542eaebfd835467a66e533d54dabf4f988325fde32d4f54291795dc"} Sep 15 17:38:08.834831 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:08.834673 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:08.868375 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:08.868336 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:08.874539 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:08.874489 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" podStartSLOduration=1.710398213 podStartE2EDuration="5.874468611s" totalImagesPullingTime="4.164070398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:38:08.871131095 +0000 UTC m=+411.595949383" watchObservedRunningTime="2026-09-15 17:38:08.874468611 +0000 UTC m=+411.599286964" Sep 15 17:38:08.948043 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:08.947459 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-98cml"] Sep 15 17:38:08.952920 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:38:08.952882 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48272a33_8f62_42a9_9308_fae1b3b88bd9.slice/crio-ed0f27a9176ceb05acb16523c0c63af4faf5fe3762b7415c03c0a8a8987716b0 WatchSource:0}: Error finding container ed0f27a9176ceb05acb16523c0c63af4faf5fe3762b7415c03c0a8a8987716b0: Status 404 returned error can't find the container with id ed0f27a9176ceb05acb16523c0c63af4faf5fe3762b7415c03c0a8a8987716b0 Sep 15 17:38:09.008154 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:09.008106 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:09.841688 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:09.841655 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-98cml" event={"ID":"48272a33-8f62-42a9-9308-fae1b3b88bd9","Type":"ContainerStarted","Data":"ed0f27a9176ceb05acb16523c0c63af4faf5fe3762b7415c03c0a8a8987716b0"} Sep 15 17:38:09.843437 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:09.843406 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-jf4dl" event={"ID":"a2859f41-902e-4a3a-8541-89a1ce8080a9","Type":"ContainerStarted","Data":"e93d9b416c665cb77c4dc36df7afa07a86b465ce61d5699e1eb1a859b94a34cf"} Sep 15 17:38:09.843598 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:09.843586 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-jf4dl" Sep 15 17:38:09.860734 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:09.860675 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-jf4dl" podStartSLOduration=1.7313628140000001 podStartE2EDuration="3.860657989s" totalImagesPullingTime="2.129295175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:38:09.859239097 +0000 UTC m=+412.584057402" watchObservedRunningTime="2026-09-15 17:38:09.860657989 +0000 UTC m=+412.585476280" Sep 15 17:38:10.190394 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:10.190275 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:10.509461 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:10.509376 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh"] Sep 15 17:38:10.513032 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:10.513010 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:10.515311 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:10.515289 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7bdsd\"" Sep 15 17:38:10.522660 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:10.522637 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh"] Sep 15 17:38:10.632276 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:10.632236 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrhx9\" (UniqueName: \"kubernetes.io/projected/b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5-kube-api-access-nrhx9\") pod \"limitador-operator-controller-manager-74495c69f8-z82kh\" (UID: \"b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:10.733578 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:10.733534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrhx9\" (UniqueName: \"kubernetes.io/projected/b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5-kube-api-access-nrhx9\") pod \"limitador-operator-controller-manager-74495c69f8-z82kh\" (UID: \"b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:10.741715 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:10.741684 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrhx9\" (UniqueName: \"kubernetes.io/projected/b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5-kube-api-access-nrhx9\") pod \"limitador-operator-controller-manager-74495c69f8-z82kh\" (UID: \"b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:10.825445 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:10.825354 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:11.107044 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:11.107021 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh"] Sep 15 17:38:11.109166 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:38:11.109134 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb02ec4d9_31ff_4e61_9627_f1c0cdf94ee5.slice/crio-e86d525e11dfe9f41cb4288280705b21fc6d41c6b5d35e56f87a44460ae60390 WatchSource:0}: Error finding container e86d525e11dfe9f41cb4288280705b21fc6d41c6b5d35e56f87a44460ae60390: Status 404 returned error can't find the container with id e86d525e11dfe9f41cb4288280705b21fc6d41c6b5d35e56f87a44460ae60390 Sep 15 17:38:11.522437 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:11.522351 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:11.717984 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:11.717951 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:11.862460 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:11.862379 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" event={"ID":"b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5","Type":"ContainerStarted","Data":"e86d525e11dfe9f41cb4288280705b21fc6d41c6b5d35e56f87a44460ae60390"} Sep 15 17:38:12.870613 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:12.870582 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-98cml" event={"ID":"48272a33-8f62-42a9-9308-fae1b3b88bd9","Type":"ContainerStarted","Data":"b684fb62fb550b940fb4589483ca2b09fad49b8efce2e4281adfb4e43cb96fe4"} Sep 15 17:38:12.871068 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:12.870787 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-98cml" Sep 15 17:38:12.888812 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:12.888738 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-98cml" podStartSLOduration=1.6700632720000002 podStartE2EDuration="4.88872097s" totalImagesPullingTime="3.218657698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:38:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:38:12.887455859 +0000 UTC m=+415.612274148" watchObservedRunningTime="2026-09-15 17:38:12.88872097 +0000 UTC m=+415.613539261" Sep 15 17:38:13.877687 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:13.877653 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" event={"ID":"b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5","Type":"ContainerStarted","Data":"9af6a2b6ff3ad74863cc221687fb024606ae4cacc973cb1e503547f73e0079ae"} Sep 15 17:38:13.893476 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:13.893408 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" podStartSLOduration=2.064349922 podStartE2EDuration="3.893389027s" totalImagesPullingTime="1.829039105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:38:13.891735949 +0000 UTC m=+416.616554263" watchObservedRunningTime="2026-09-15 17:38:13.893389027 +0000 UTC m=+416.618207317" Sep 15 17:38:14.159707 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:14.159625 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:14.220674 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:14.220630 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:14.554949 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:14.554863 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:14.609613 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:14.609580 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:14.882634 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:14.882599 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:14.956541 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:14.956509 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:15.056513 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:15.056470 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:17.393356 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:17.393322 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:17.494656 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:17.494624 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:17.608020 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:17.607991 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:19.846069 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:19.846035 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:20.851316 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:20.851287 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-jf4dl" Sep 15 17:38:21.921757 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:21.921720 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2"] Sep 15 17:38:21.927215 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:21.927194 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2" Sep 15 17:38:21.941300 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:21.941271 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2"] Sep 15 17:38:22.059337 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.059290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ksbk\" (UniqueName: \"kubernetes.io/projected/02aecf83-9e86-4a68-b49c-3465191d1989-kube-api-access-8ksbk\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-ghgh2\" (UID: \"02aecf83-9e86-4a68-b49c-3465191d1989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2" Sep 15 17:38:22.059536 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.059360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02aecf83-9e86-4a68-b49c-3465191d1989-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-ghgh2\" (UID: \"02aecf83-9e86-4a68-b49c-3465191d1989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2" Sep 15 17:38:22.160009 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.159970 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ksbk\" (UniqueName: \"kubernetes.io/projected/02aecf83-9e86-4a68-b49c-3465191d1989-kube-api-access-8ksbk\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-ghgh2\" (UID: \"02aecf83-9e86-4a68-b49c-3465191d1989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2" Sep 15 17:38:22.160211 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.160032 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02aecf83-9e86-4a68-b49c-3465191d1989-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-ghgh2\" (UID: \"02aecf83-9e86-4a68-b49c-3465191d1989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2" Sep 15 17:38:22.160438 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.160419 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02aecf83-9e86-4a68-b49c-3465191d1989-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-ghgh2\" (UID: \"02aecf83-9e86-4a68-b49c-3465191d1989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2" Sep 15 17:38:22.172790 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.172709 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ksbk\" (UniqueName: \"kubernetes.io/projected/02aecf83-9e86-4a68-b49c-3465191d1989-kube-api-access-8ksbk\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-ghgh2\" (UID: \"02aecf83-9e86-4a68-b49c-3465191d1989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2" Sep 15 17:38:22.238583 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.238539 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2" Sep 15 17:38:22.426641 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.426550 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4"] Sep 15 17:38:22.426803 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.426735 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" podUID="b1baff4c-8f3b-4987-8044-4d69920a0df6" containerName="manager" containerID="cri-o://0085b8b0d542eaebfd835467a66e533d54dabf4f988325fde32d4f54291795dc" gracePeriod=2 Sep 15 17:38:22.428824 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.428776 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b1baff4c-8f3b-4987-8044-4d69920a0df6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:22.429963 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.429876 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4"] Sep 15 17:38:22.452347 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.452219 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2"] Sep 15 17:38:22.464841 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.461688 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb"] Sep 15 17:38:22.464841 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.462671 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1baff4c-8f3b-4987-8044-4d69920a0df6" containerName="manager" Sep 15 17:38:22.464841 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.462692 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1baff4c-8f3b-4987-8044-4d69920a0df6" containerName="manager" Sep 15 17:38:22.464841 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.462957 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1baff4c-8f3b-4987-8044-4d69920a0df6" containerName="manager" Sep 15 17:38:22.469814 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.469776 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2"] Sep 15 17:38:22.469981 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.469855 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" Sep 15 17:38:22.473726 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.473697 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh"] Sep 15 17:38:22.474037 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.473968 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" podUID="b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5" containerName="manager" containerID="cri-o://9af6a2b6ff3ad74863cc221687fb024606ae4cacc973cb1e503547f73e0079ae" gracePeriod=2 Sep 15 17:38:22.476011 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.475982 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:22.487571 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.487537 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb"] Sep 15 17:38:22.490196 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.490171 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc"] Sep 15 17:38:22.495934 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.495904 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh"] Sep 15 17:38:22.496061 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.496029 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" Sep 15 17:38:22.502295 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.502270 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-zjh9t"] Sep 15 17:38:22.502728 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.502712 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5" containerName="manager" Sep 15 17:38:22.502812 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.502731 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5" containerName="manager" Sep 15 17:38:22.502867 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.502838 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5" containerName="manager" Sep 15 17:38:22.506436 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.506411 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zjh9t" Sep 15 17:38:22.507396 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.507372 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc"] Sep 15 17:38:22.517510 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.517477 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b1baff4c-8f3b-4987-8044-4d69920a0df6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:22.519860 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.519833 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-zjh9t"] Sep 15 17:38:22.539010 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.538964 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b1baff4c-8f3b-4987-8044-4d69920a0df6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:22.540940 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.540910 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-z82kh\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:22.545585 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:38:22.545550 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02aecf83_9e86_4a68_b49c_3465191d1989.slice/crio-36a4bd153a1a041a25bfa916daed65315953063c1a1cc0d860be034e007e4932 WatchSource:0}: Error finding container 36a4bd153a1a041a25bfa916daed65315953063c1a1cc0d860be034e007e4932: Status 404 returned error can't find the container with id 36a4bd153a1a041a25bfa916daed65315953063c1a1cc0d860be034e007e4932 Sep 15 17:38:22.566385 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.566356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1076754-f6d1-4056-be61-aeccdb239c2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-t4gnb\" (UID: \"e1076754-f6d1-4056-be61-aeccdb239c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" Sep 15 17:38:22.566552 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.566402 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnq8m\" (UniqueName: \"kubernetes.io/projected/e1076754-f6d1-4056-be61-aeccdb239c2e-kube-api-access-pnq8m\") pod \"kuadrant-operator-controller-manager-76f8f686bf-t4gnb\" (UID: \"e1076754-f6d1-4056-be61-aeccdb239c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" Sep 15 17:38:22.667820 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.667779 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1076754-f6d1-4056-be61-aeccdb239c2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-t4gnb\" (UID: \"e1076754-f6d1-4056-be61-aeccdb239c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" Sep 15 17:38:22.667992 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.667845 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnq8m\" (UniqueName: \"kubernetes.io/projected/e1076754-f6d1-4056-be61-aeccdb239c2e-kube-api-access-pnq8m\") pod \"kuadrant-operator-controller-manager-76f8f686bf-t4gnb\" (UID: \"e1076754-f6d1-4056-be61-aeccdb239c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" Sep 15 17:38:22.667992 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.667940 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6310a3cd-a825-485d-9a51-915c950ef436-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-dp2lc\" (UID: \"6310a3cd-a825-485d-9a51-915c950ef436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" Sep 15 17:38:22.667992 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.667975 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnhfd\" (UniqueName: \"kubernetes.io/projected/6310a3cd-a825-485d-9a51-915c950ef436-kube-api-access-rnhfd\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-dp2lc\" (UID: \"6310a3cd-a825-485d-9a51-915c950ef436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" Sep 15 17:38:22.668204 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.668011 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npjlb\" (UniqueName: \"kubernetes.io/projected/b4a1ae92-a9b9-4846-b865-f18d8efa1dbf-kube-api-access-npjlb\") pod \"limitador-operator-controller-manager-74495c69f8-zjh9t\" (UID: \"b4a1ae92-a9b9-4846-b865-f18d8efa1dbf\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zjh9t" Sep 15 17:38:22.668265 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.668225 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1076754-f6d1-4056-be61-aeccdb239c2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-t4gnb\" (UID: \"e1076754-f6d1-4056-be61-aeccdb239c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" Sep 15 17:38:22.682656 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.682570 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnq8m\" (UniqueName: \"kubernetes.io/projected/e1076754-f6d1-4056-be61-aeccdb239c2e-kube-api-access-pnq8m\") pod \"kuadrant-operator-controller-manager-76f8f686bf-t4gnb\" (UID: \"e1076754-f6d1-4056-be61-aeccdb239c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" Sep 15 17:38:22.714313 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.714291 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:22.720245 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.720214 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b1baff4c-8f3b-4987-8044-4d69920a0df6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:22.721573 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.721551 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:22.722400 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.722376 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-z82kh\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:22.724522 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.724494 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b1baff4c-8f3b-4987-8044-4d69920a0df6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:22.727276 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.727250 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-z82kh\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:22.769211 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.769169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6310a3cd-a825-485d-9a51-915c950ef436-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-dp2lc\" (UID: \"6310a3cd-a825-485d-9a51-915c950ef436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" Sep 15 17:38:22.769211 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.769217 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnhfd\" (UniqueName: \"kubernetes.io/projected/6310a3cd-a825-485d-9a51-915c950ef436-kube-api-access-rnhfd\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-dp2lc\" (UID: \"6310a3cd-a825-485d-9a51-915c950ef436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" Sep 15 17:38:22.769427 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.769334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npjlb\" (UniqueName: \"kubernetes.io/projected/b4a1ae92-a9b9-4846-b865-f18d8efa1dbf-kube-api-access-npjlb\") pod \"limitador-operator-controller-manager-74495c69f8-zjh9t\" (UID: \"b4a1ae92-a9b9-4846-b865-f18d8efa1dbf\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zjh9t" Sep 15 17:38:22.769573 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.769555 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6310a3cd-a825-485d-9a51-915c950ef436-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-dp2lc\" (UID: \"6310a3cd-a825-485d-9a51-915c950ef436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" Sep 15 17:38:22.800350 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.800316 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnhfd\" (UniqueName: \"kubernetes.io/projected/6310a3cd-a825-485d-9a51-915c950ef436-kube-api-access-rnhfd\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-dp2lc\" (UID: \"6310a3cd-a825-485d-9a51-915c950ef436\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" Sep 15 17:38:22.802244 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.802218 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npjlb\" (UniqueName: \"kubernetes.io/projected/b4a1ae92-a9b9-4846-b865-f18d8efa1dbf-kube-api-access-npjlb\") pod \"limitador-operator-controller-manager-74495c69f8-zjh9t\" (UID: \"b4a1ae92-a9b9-4846-b865-f18d8efa1dbf\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zjh9t" Sep 15 17:38:22.867029 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.866986 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" Sep 15 17:38:22.869896 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.869870 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8jpg\" (UniqueName: \"kubernetes.io/projected/b1baff4c-8f3b-4987-8044-4d69920a0df6-kube-api-access-g8jpg\") pod \"b1baff4c-8f3b-4987-8044-4d69920a0df6\" (UID: \"b1baff4c-8f3b-4987-8044-4d69920a0df6\") " Sep 15 17:38:22.870100 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.870068 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1baff4c-8f3b-4987-8044-4d69920a0df6-extensions-socket-volume\") pod \"b1baff4c-8f3b-4987-8044-4d69920a0df6\" (UID: \"b1baff4c-8f3b-4987-8044-4d69920a0df6\") " Sep 15 17:38:22.870151 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.870120 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrhx9\" (UniqueName: \"kubernetes.io/projected/b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5-kube-api-access-nrhx9\") pod \"b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5\" (UID: \"b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5\") " Sep 15 17:38:22.870658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.870454 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1baff4c-8f3b-4987-8044-4d69920a0df6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b1baff4c-8f3b-4987-8044-4d69920a0df6" (UID: "b1baff4c-8f3b-4987-8044-4d69920a0df6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 17:38:22.870658 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.870560 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1baff4c-8f3b-4987-8044-4d69920a0df6-extensions-socket-volume\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:38:22.872303 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.872277 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1baff4c-8f3b-4987-8044-4d69920a0df6-kube-api-access-g8jpg" (OuterVolumeSpecName: "kube-api-access-g8jpg") pod "b1baff4c-8f3b-4987-8044-4d69920a0df6" (UID: "b1baff4c-8f3b-4987-8044-4d69920a0df6"). InnerVolumeSpecName "kube-api-access-g8jpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:38:22.872303 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.872281 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5-kube-api-access-nrhx9" (OuterVolumeSpecName: "kube-api-access-nrhx9") pod "b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5" (UID: "b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5"). InnerVolumeSpecName "kube-api-access-nrhx9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:38:22.875434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.875405 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" Sep 15 17:38:22.882427 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.882393 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zjh9t" Sep 15 17:38:22.930276 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.927990 2581 generic.go:356] "Generic (PLEG): container finished" podID="b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5" containerID="9af6a2b6ff3ad74863cc221687fb024606ae4cacc973cb1e503547f73e0079ae" exitCode=0 Sep 15 17:38:22.930276 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.928190 2581 scope.go:117] "RemoveContainer" containerID="9af6a2b6ff3ad74863cc221687fb024606ae4cacc973cb1e503547f73e0079ae" Sep 15 17:38:22.930276 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.928363 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:22.933614 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.932758 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b1baff4c-8f3b-4987-8044-4d69920a0df6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:22.933614 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.933402 2581 generic.go:356] "Generic (PLEG): container finished" podID="b1baff4c-8f3b-4987-8044-4d69920a0df6" containerID="0085b8b0d542eaebfd835467a66e533d54dabf4f988325fde32d4f54291795dc" exitCode=0 Sep 15 17:38:22.933766 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.933649 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:22.937353 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.937319 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-z82kh\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:22.939916 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.939878 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-z82kh\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:22.943536 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.942720 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b1baff4c-8f3b-4987-8044-4d69920a0df6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:22.944125 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.943902 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2" podUID="02aecf83-9e86-4a68-b49c-3465191d1989" containerName="manager" containerID="cri-o://cf3e283d2ef59de1c368fbcc798fc71fa6b26ae86bdeb21132394b5223c12c0f" gracePeriod=2 Sep 15 17:38:22.950426 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.950126 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b1baff4c-8f3b-4987-8044-4d69920a0df6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:22.952546 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.952511 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-z82kh\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:22.954846 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.954454 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-ghgh2\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="02aecf83-9e86-4a68-b49c-3465191d1989" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2" Sep 15 17:38:22.958475 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.958291 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b1baff4c-8f3b-4987-8044-4d69920a0df6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:22.958766 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.958750 2581 scope.go:117] "RemoveContainer" containerID="9af6a2b6ff3ad74863cc221687fb024606ae4cacc973cb1e503547f73e0079ae" Sep 15 17:38:22.959190 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.959162 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9af6a2b6ff3ad74863cc221687fb024606ae4cacc973cb1e503547f73e0079ae\": container with ID starting with 9af6a2b6ff3ad74863cc221687fb024606ae4cacc973cb1e503547f73e0079ae not found: ID does not exist" containerID="9af6a2b6ff3ad74863cc221687fb024606ae4cacc973cb1e503547f73e0079ae" Sep 15 17:38:22.959284 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.959203 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9af6a2b6ff3ad74863cc221687fb024606ae4cacc973cb1e503547f73e0079ae"} err="failed to get container status \"9af6a2b6ff3ad74863cc221687fb024606ae4cacc973cb1e503547f73e0079ae\": rpc error: code = NotFound desc = could not find container \"9af6a2b6ff3ad74863cc221687fb024606ae4cacc973cb1e503547f73e0079ae\": container with ID starting with 9af6a2b6ff3ad74863cc221687fb024606ae4cacc973cb1e503547f73e0079ae not found: ID does not exist" Sep 15 17:38:22.959284 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.959228 2581 scope.go:117] "RemoveContainer" containerID="0085b8b0d542eaebfd835467a66e533d54dabf4f988325fde32d4f54291795dc" Sep 15 17:38:22.962205 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.962173 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-z82kh\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:22.963871 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.963833 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-ghgh2\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="02aecf83-9e86-4a68-b49c-3465191d1989" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2" Sep 15 17:38:22.966704 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.966607 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b1baff4c-8f3b-4987-8044-4d69920a0df6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:22.969590 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.968987 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-z82kh\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:22.970769 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:22.970744 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-ghgh2\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="02aecf83-9e86-4a68-b49c-3465191d1989" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2" Sep 15 17:38:22.971298 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.971275 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8jpg\" (UniqueName: \"kubernetes.io/projected/b1baff4c-8f3b-4987-8044-4d69920a0df6-kube-api-access-g8jpg\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:38:22.971353 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:22.971307 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrhx9\" (UniqueName: \"kubernetes.io/projected/b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5-kube-api-access-nrhx9\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:38:23.003010 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.002981 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:23.034695 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.034666 2581 scope.go:117] "RemoveContainer" containerID="0085b8b0d542eaebfd835467a66e533d54dabf4f988325fde32d4f54291795dc" Sep 15 17:38:23.035139 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:23.035117 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0085b8b0d542eaebfd835467a66e533d54dabf4f988325fde32d4f54291795dc\": container with ID starting with 0085b8b0d542eaebfd835467a66e533d54dabf4f988325fde32d4f54291795dc not found: ID does not exist" containerID="0085b8b0d542eaebfd835467a66e533d54dabf4f988325fde32d4f54291795dc" Sep 15 17:38:23.035204 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.035148 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0085b8b0d542eaebfd835467a66e533d54dabf4f988325fde32d4f54291795dc"} err="failed to get container status \"0085b8b0d542eaebfd835467a66e533d54dabf4f988325fde32d4f54291795dc\": rpc error: code = NotFound desc = could not find container \"0085b8b0d542eaebfd835467a66e533d54dabf4f988325fde32d4f54291795dc\": container with ID starting with 0085b8b0d542eaebfd835467a66e533d54dabf4f988325fde32d4f54291795dc not found: ID does not exist" Sep 15 17:38:23.118677 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.118642 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:23.169606 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.169572 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb"] Sep 15 17:38:23.173251 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:38:23.173219 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1076754_f6d1_4056_be61_aeccdb239c2e.slice/crio-40f578c7e78e3e110cecf7a0037afa2e5c6e23f1ffda78b09ce64e35b0f028a6 WatchSource:0}: Error finding container 40f578c7e78e3e110cecf7a0037afa2e5c6e23f1ffda78b09ce64e35b0f028a6: Status 404 returned error can't find the container with id 40f578c7e78e3e110cecf7a0037afa2e5c6e23f1ffda78b09ce64e35b0f028a6 Sep 15 17:38:23.196867 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.196533 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc"] Sep 15 17:38:23.196867 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.196602 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-zjh9t"] Sep 15 17:38:23.199364 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:38:23.199333 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6310a3cd_a825_485d_9a51_915c950ef436.slice/crio-15f78e05e81e5c479cbaf1eab2465b24e90a85f878de7c77b42eeea5db4891c4 WatchSource:0}: Error finding container 15f78e05e81e5c479cbaf1eab2465b24e90a85f878de7c77b42eeea5db4891c4: Status 404 returned error can't find the container with id 15f78e05e81e5c479cbaf1eab2465b24e90a85f878de7c77b42eeea5db4891c4 Sep 15 17:38:23.200209 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:38:23.200184 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a1ae92_a9b9_4846_b865_f18d8efa1dbf.slice/crio-fa1a64c642b1f66a856f687d23f0948477e7993aedddb3dbf7fdbf4a22dc586b WatchSource:0}: Error finding container fa1a64c642b1f66a856f687d23f0948477e7993aedddb3dbf7fdbf4a22dc586b: Status 404 returned error can't find the container with id fa1a64c642b1f66a856f687d23f0948477e7993aedddb3dbf7fdbf4a22dc586b Sep 15 17:38:23.273001 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.272968 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2" Sep 15 17:38:23.275268 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:23.275241 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-wwwm4\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b1baff4c-8f3b-4987-8044-4d69920a0df6" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-wwwm4" Sep 15 17:38:23.277206 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:23.277181 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-z82kh\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-z82kh" Sep 15 17:38:23.279044 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:23.279022 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-ghgh2\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="02aecf83-9e86-4a68-b49c-3465191d1989" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2" Sep 15 17:38:23.374527 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.374485 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ksbk\" (UniqueName: \"kubernetes.io/projected/02aecf83-9e86-4a68-b49c-3465191d1989-kube-api-access-8ksbk\") pod \"02aecf83-9e86-4a68-b49c-3465191d1989\" (UID: \"02aecf83-9e86-4a68-b49c-3465191d1989\") " Sep 15 17:38:23.374710 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.374582 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02aecf83-9e86-4a68-b49c-3465191d1989-extensions-socket-volume\") pod \"02aecf83-9e86-4a68-b49c-3465191d1989\" (UID: \"02aecf83-9e86-4a68-b49c-3465191d1989\") " Sep 15 17:38:23.374874 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.374846 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02aecf83-9e86-4a68-b49c-3465191d1989-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "02aecf83-9e86-4a68-b49c-3465191d1989" (UID: "02aecf83-9e86-4a68-b49c-3465191d1989"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 17:38:23.376721 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.376696 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02aecf83-9e86-4a68-b49c-3465191d1989-kube-api-access-8ksbk" (OuterVolumeSpecName: "kube-api-access-8ksbk") pod "02aecf83-9e86-4a68-b49c-3465191d1989" (UID: "02aecf83-9e86-4a68-b49c-3465191d1989"). InnerVolumeSpecName "kube-api-access-8ksbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:38:23.476135 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.476029 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ksbk\" (UniqueName: \"kubernetes.io/projected/02aecf83-9e86-4a68-b49c-3465191d1989-kube-api-access-8ksbk\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:38:23.476135 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.476059 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02aecf83-9e86-4a68-b49c-3465191d1989-extensions-socket-volume\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:38:23.752605 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.752524 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02aecf83-9e86-4a68-b49c-3465191d1989" path="/var/lib/kubelet/pods/02aecf83-9e86-4a68-b49c-3465191d1989/volumes" Sep 15 17:38:23.752875 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.752862 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5" path="/var/lib/kubelet/pods/b02ec4d9-31ff-4e61-9627-f1c0cdf94ee5/volumes" Sep 15 17:38:23.753217 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.753202 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1baff4c-8f3b-4987-8044-4d69920a0df6" path="/var/lib/kubelet/pods/b1baff4c-8f3b-4987-8044-4d69920a0df6/volumes" Sep 15 17:38:23.880929 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.880896 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-98cml" Sep 15 17:38:23.952923 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.952887 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zjh9t" event={"ID":"b4a1ae92-a9b9-4846-b865-f18d8efa1dbf","Type":"ContainerStarted","Data":"562a22961074193413339e9e09fab2294a593397797ee1cd364fbd61845aef24"} Sep 15 17:38:23.953365 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.952955 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zjh9t" event={"ID":"b4a1ae92-a9b9-4846-b865-f18d8efa1dbf","Type":"ContainerStarted","Data":"fa1a64c642b1f66a856f687d23f0948477e7993aedddb3dbf7fdbf4a22dc586b"} Sep 15 17:38:23.953365 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.952986 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zjh9t" Sep 15 17:38:23.954546 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.954520 2581 generic.go:356] "Generic (PLEG): container finished" podID="02aecf83-9e86-4a68-b49c-3465191d1989" containerID="cf3e283d2ef59de1c368fbcc798fc71fa6b26ae86bdeb21132394b5223c12c0f" exitCode=2 Sep 15 17:38:23.954695 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.954569 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2" Sep 15 17:38:23.954695 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.954612 2581 scope.go:117] "RemoveContainer" containerID="cf3e283d2ef59de1c368fbcc798fc71fa6b26ae86bdeb21132394b5223c12c0f" Sep 15 17:38:23.958055 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.958028 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" event={"ID":"6310a3cd-a825-485d-9a51-915c950ef436","Type":"ContainerStarted","Data":"69b9b1aef8c42fbe69d45f7a0d1644c9eefcdca2e2445d9d044df143ae8fe6b2"} Sep 15 17:38:23.958203 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.958107 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" event={"ID":"6310a3cd-a825-485d-9a51-915c950ef436","Type":"ContainerStarted","Data":"15f78e05e81e5c479cbaf1eab2465b24e90a85f878de7c77b42eeea5db4891c4"} Sep 15 17:38:23.958203 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.958145 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" Sep 15 17:38:23.961278 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.961252 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" event={"ID":"e1076754-f6d1-4056-be61-aeccdb239c2e","Type":"ContainerStarted","Data":"3b4024fa7d673570e4dcf69c97c1df545c46f275551d423d3969fcf19e124230"} Sep 15 17:38:23.961427 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.961297 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" event={"ID":"e1076754-f6d1-4056-be61-aeccdb239c2e","Type":"ContainerStarted","Data":"40f578c7e78e3e110cecf7a0037afa2e5c6e23f1ffda78b09ce64e35b0f028a6"} Sep 15 17:38:23.961427 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.961319 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" Sep 15 17:38:23.965648 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.965628 2581 scope.go:117] "RemoveContainer" containerID="cf3e283d2ef59de1c368fbcc798fc71fa6b26ae86bdeb21132394b5223c12c0f" Sep 15 17:38:23.965953 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:23.965930 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf3e283d2ef59de1c368fbcc798fc71fa6b26ae86bdeb21132394b5223c12c0f\": container with ID starting with cf3e283d2ef59de1c368fbcc798fc71fa6b26ae86bdeb21132394b5223c12c0f not found: ID does not exist" containerID="cf3e283d2ef59de1c368fbcc798fc71fa6b26ae86bdeb21132394b5223c12c0f" Sep 15 17:38:23.966018 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.965967 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3e283d2ef59de1c368fbcc798fc71fa6b26ae86bdeb21132394b5223c12c0f"} err="failed to get container status \"cf3e283d2ef59de1c368fbcc798fc71fa6b26ae86bdeb21132394b5223c12c0f\": rpc error: code = NotFound desc = could not find container \"cf3e283d2ef59de1c368fbcc798fc71fa6b26ae86bdeb21132394b5223c12c0f\": container with ID starting with cf3e283d2ef59de1c368fbcc798fc71fa6b26ae86bdeb21132394b5223c12c0f not found: ID does not exist" Sep 15 17:38:23.979668 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:23.979611 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zjh9t" podStartSLOduration=1.979590811 podStartE2EDuration="1.979590811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:38:23.977524096 +0000 UTC m=+426.702342387" watchObservedRunningTime="2026-09-15 17:38:23.979590811 +0000 UTC m=+426.704409104" Sep 15 17:38:23.979811 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:23.979688 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-ghgh2\" is forbidden: User \"system:node:ip-10-0-141-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-84.ec2.internal' and this object" podUID="02aecf83-9e86-4a68-b49c-3465191d1989" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-ghgh2" Sep 15 17:38:24.002496 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:24.002436 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" podStartSLOduration=2.002420054 podStartE2EDuration="2.002420054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:38:24.000966448 +0000 UTC m=+426.725784760" watchObservedRunningTime="2026-09-15 17:38:24.002420054 +0000 UTC m=+426.727238342" Sep 15 17:38:24.021707 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:24.021603 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" podStartSLOduration=2.021583541 podStartE2EDuration="2.021583541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:38:24.019910464 +0000 UTC m=+426.744728757" watchObservedRunningTime="2026-09-15 17:38:24.021583541 +0000 UTC m=+426.746401834" Sep 15 17:38:25.424601 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:25.424560 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:25.525415 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:25.525376 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:30.197813 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:30.197782 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:30.300146 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:30.300108 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:34.971655 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:34.971621 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" Sep 15 17:38:34.972052 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:34.971797 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" Sep 15 17:38:34.972052 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:34.971851 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-zjh9t" Sep 15 17:38:35.049451 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.049421 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb"] Sep 15 17:38:35.049626 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.049598 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" podUID="e1076754-f6d1-4056-be61-aeccdb239c2e" containerName="manager" containerID="cri-o://3b4024fa7d673570e4dcf69c97c1df545c46f275551d423d3969fcf19e124230" gracePeriod=10 Sep 15 17:38:35.279570 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.279529 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9cwk9"] Sep 15 17:38:35.279981 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.279965 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02aecf83-9e86-4a68-b49c-3465191d1989" containerName="manager" Sep 15 17:38:35.280053 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.279983 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="02aecf83-9e86-4a68-b49c-3465191d1989" containerName="manager" Sep 15 17:38:35.280123 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.280053 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="02aecf83-9e86-4a68-b49c-3465191d1989" containerName="manager" Sep 15 17:38:35.285136 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.285102 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9cwk9" Sep 15 17:38:35.305812 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.305782 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9cwk9"] Sep 15 17:38:35.314342 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.314314 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" Sep 15 17:38:35.388411 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.388383 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnq8m\" (UniqueName: \"kubernetes.io/projected/e1076754-f6d1-4056-be61-aeccdb239c2e-kube-api-access-pnq8m\") pod \"e1076754-f6d1-4056-be61-aeccdb239c2e\" (UID: \"e1076754-f6d1-4056-be61-aeccdb239c2e\") " Sep 15 17:38:35.388602 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.388419 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1076754-f6d1-4056-be61-aeccdb239c2e-extensions-socket-volume\") pod \"e1076754-f6d1-4056-be61-aeccdb239c2e\" (UID: \"e1076754-f6d1-4056-be61-aeccdb239c2e\") " Sep 15 17:38:35.388602 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.388583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e185d199-8083-430a-a4f5-2f84698a741b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9cwk9\" (UID: \"e185d199-8083-430a-a4f5-2f84698a741b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9cwk9" Sep 15 17:38:35.388708 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.388640 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf46m\" (UniqueName: \"kubernetes.io/projected/e185d199-8083-430a-a4f5-2f84698a741b-kube-api-access-qf46m\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9cwk9\" (UID: \"e185d199-8083-430a-a4f5-2f84698a741b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9cwk9" Sep 15 17:38:35.388887 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.388865 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1076754-f6d1-4056-be61-aeccdb239c2e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e1076754-f6d1-4056-be61-aeccdb239c2e" (UID: "e1076754-f6d1-4056-be61-aeccdb239c2e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 17:38:35.390908 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.390879 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1076754-f6d1-4056-be61-aeccdb239c2e-kube-api-access-pnq8m" (OuterVolumeSpecName: "kube-api-access-pnq8m") pod "e1076754-f6d1-4056-be61-aeccdb239c2e" (UID: "e1076754-f6d1-4056-be61-aeccdb239c2e"). InnerVolumeSpecName "kube-api-access-pnq8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:38:35.420887 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.420854 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:35.490140 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.490059 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e185d199-8083-430a-a4f5-2f84698a741b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9cwk9\" (UID: \"e185d199-8083-430a-a4f5-2f84698a741b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9cwk9" Sep 15 17:38:35.490339 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.490170 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf46m\" (UniqueName: \"kubernetes.io/projected/e185d199-8083-430a-a4f5-2f84698a741b-kube-api-access-qf46m\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9cwk9\" (UID: \"e185d199-8083-430a-a4f5-2f84698a741b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9cwk9" Sep 15 17:38:35.490339 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.490253 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnq8m\" (UniqueName: \"kubernetes.io/projected/e1076754-f6d1-4056-be61-aeccdb239c2e-kube-api-access-pnq8m\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:38:35.490339 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.490269 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1076754-f6d1-4056-be61-aeccdb239c2e-extensions-socket-volume\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:38:35.490461 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.490447 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e185d199-8083-430a-a4f5-2f84698a741b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9cwk9\" (UID: \"e185d199-8083-430a-a4f5-2f84698a741b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9cwk9" Sep 15 17:38:35.501330 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.501299 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf46m\" (UniqueName: \"kubernetes.io/projected/e185d199-8083-430a-a4f5-2f84698a741b-kube-api-access-qf46m\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9cwk9\" (UID: \"e185d199-8083-430a-a4f5-2f84698a741b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9cwk9" Sep 15 17:38:35.524117 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.524050 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:35.608911 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.608873 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9cwk9" Sep 15 17:38:35.800471 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.800435 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:35.900067 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.899994 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:35.920509 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.920429 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9cwk9"] Sep 15 17:38:35.922943 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:38:35.922915 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode185d199_8083_430a_a4f5_2f84698a741b.slice/crio-834927a8ea6a695dd373ccd0c9e341cf70c01f822f8be5cf1a95ef2b6d680fc7 WatchSource:0}: Error finding container 834927a8ea6a695dd373ccd0c9e341cf70c01f822f8be5cf1a95ef2b6d680fc7: Status 404 returned error can't find the container with id 834927a8ea6a695dd373ccd0c9e341cf70c01f822f8be5cf1a95ef2b6d680fc7 Sep 15 17:38:35.999513 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:35.999479 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:36.032486 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:36.032443 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9cwk9" event={"ID":"e185d199-8083-430a-a4f5-2f84698a741b","Type":"ContainerStarted","Data":"0a7b362f9704573bfbf812b79025eafa5839dbacde1b120d774c92c6ff018bee"} Sep 15 17:38:36.032652 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:36.032510 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9cwk9" event={"ID":"e185d199-8083-430a-a4f5-2f84698a741b","Type":"ContainerStarted","Data":"834927a8ea6a695dd373ccd0c9e341cf70c01f822f8be5cf1a95ef2b6d680fc7"} Sep 15 17:38:36.034138 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:36.034077 2581 generic.go:356] "Generic (PLEG): container finished" podID="e1076754-f6d1-4056-be61-aeccdb239c2e" containerID="3b4024fa7d673570e4dcf69c97c1df545c46f275551d423d3969fcf19e124230" exitCode=0 Sep 15 17:38:36.034138 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:36.034118 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" event={"ID":"e1076754-f6d1-4056-be61-aeccdb239c2e","Type":"ContainerDied","Data":"3b4024fa7d673570e4dcf69c97c1df545c46f275551d423d3969fcf19e124230"} Sep 15 17:38:36.034299 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:36.034167 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" Sep 15 17:38:36.034299 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:36.034178 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb" event={"ID":"e1076754-f6d1-4056-be61-aeccdb239c2e","Type":"ContainerDied","Data":"40f578c7e78e3e110cecf7a0037afa2e5c6e23f1ffda78b09ce64e35b0f028a6"} Sep 15 17:38:36.034299 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:36.034207 2581 scope.go:117] "RemoveContainer" containerID="3b4024fa7d673570e4dcf69c97c1df545c46f275551d423d3969fcf19e124230" Sep 15 17:38:36.043607 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:36.043586 2581 scope.go:117] "RemoveContainer" containerID="3b4024fa7d673570e4dcf69c97c1df545c46f275551d423d3969fcf19e124230" Sep 15 17:38:36.043924 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:36.043904 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b4024fa7d673570e4dcf69c97c1df545c46f275551d423d3969fcf19e124230\": container with ID starting with 3b4024fa7d673570e4dcf69c97c1df545c46f275551d423d3969fcf19e124230 not found: ID does not exist" containerID="3b4024fa7d673570e4dcf69c97c1df545c46f275551d423d3969fcf19e124230" Sep 15 17:38:36.043998 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:36.043931 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b4024fa7d673570e4dcf69c97c1df545c46f275551d423d3969fcf19e124230"} err="failed to get container status \"3b4024fa7d673570e4dcf69c97c1df545c46f275551d423d3969fcf19e124230\": rpc error: code = NotFound desc = could not find container \"3b4024fa7d673570e4dcf69c97c1df545c46f275551d423d3969fcf19e124230\": container with ID starting with 3b4024fa7d673570e4dcf69c97c1df545c46f275551d423d3969fcf19e124230 not found: ID does not exist" Sep 15 17:38:36.063162 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:36.063072 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb"] Sep 15 17:38:36.067125 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:36.067097 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-t4gnb"] Sep 15 17:38:36.101335 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:36.101293 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:37.040927 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:37.040899 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9cwk9" Sep 15 17:38:37.059385 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:37.059335 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9cwk9" podStartSLOduration=2.059319744 podStartE2EDuration="2.059319744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:38:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:38:37.058335404 +0000 UTC m=+439.783153695" watchObservedRunningTime="2026-09-15 17:38:37.059319744 +0000 UTC m=+439.784138035" Sep 15 17:38:37.753159 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:37.753120 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1076754-f6d1-4056-be61-aeccdb239c2e" path="/var/lib/kubelet/pods/e1076754-f6d1-4056-be61-aeccdb239c2e/volumes" Sep 15 17:38:44.388477 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:44.388372 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:44.485520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:44.485489 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:46.818437 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:46.818403 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:46.874432 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:46.874399 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:48.049106 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:48.049042 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9cwk9" Sep 15 17:38:48.097619 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:48.097583 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc"] Sep 15 17:38:48.097864 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:48.097837 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" podUID="6310a3cd-a825-485d-9a51-915c950ef436" containerName="manager" containerID="cri-o://69b9b1aef8c42fbe69d45f7a0d1644c9eefcdca2e2445d9d044df143ae8fe6b2" gracePeriod=10 Sep 15 17:38:48.343021 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:48.342992 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" Sep 15 17:38:48.413531 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:48.413488 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6310a3cd-a825-485d-9a51-915c950ef436-extensions-socket-volume\") pod \"6310a3cd-a825-485d-9a51-915c950ef436\" (UID: \"6310a3cd-a825-485d-9a51-915c950ef436\") " Sep 15 17:38:48.413744 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:48.413558 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnhfd\" (UniqueName: \"kubernetes.io/projected/6310a3cd-a825-485d-9a51-915c950ef436-kube-api-access-rnhfd\") pod \"6310a3cd-a825-485d-9a51-915c950ef436\" (UID: \"6310a3cd-a825-485d-9a51-915c950ef436\") " Sep 15 17:38:48.413892 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:48.413866 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6310a3cd-a825-485d-9a51-915c950ef436-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6310a3cd-a825-485d-9a51-915c950ef436" (UID: "6310a3cd-a825-485d-9a51-915c950ef436"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 17:38:48.415702 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:48.415671 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6310a3cd-a825-485d-9a51-915c950ef436-kube-api-access-rnhfd" (OuterVolumeSpecName: "kube-api-access-rnhfd") pod "6310a3cd-a825-485d-9a51-915c950ef436" (UID: "6310a3cd-a825-485d-9a51-915c950ef436"). InnerVolumeSpecName "kube-api-access-rnhfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:38:48.514894 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:48.514849 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6310a3cd-a825-485d-9a51-915c950ef436-extensions-socket-volume\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:38:48.514894 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:48.514884 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnhfd\" (UniqueName: \"kubernetes.io/projected/6310a3cd-a825-485d-9a51-915c950ef436-kube-api-access-rnhfd\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:38:49.110712 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:49.110673 2581 generic.go:356] "Generic (PLEG): container finished" podID="6310a3cd-a825-485d-9a51-915c950ef436" containerID="69b9b1aef8c42fbe69d45f7a0d1644c9eefcdca2e2445d9d044df143ae8fe6b2" exitCode=0 Sep 15 17:38:49.111138 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:49.110710 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" event={"ID":"6310a3cd-a825-485d-9a51-915c950ef436","Type":"ContainerDied","Data":"69b9b1aef8c42fbe69d45f7a0d1644c9eefcdca2e2445d9d044df143ae8fe6b2"} Sep 15 17:38:49.111138 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:49.110723 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" Sep 15 17:38:49.111138 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:49.110773 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc" event={"ID":"6310a3cd-a825-485d-9a51-915c950ef436","Type":"ContainerDied","Data":"15f78e05e81e5c479cbaf1eab2465b24e90a85f878de7c77b42eeea5db4891c4"} Sep 15 17:38:49.111138 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:49.110802 2581 scope.go:117] "RemoveContainer" containerID="69b9b1aef8c42fbe69d45f7a0d1644c9eefcdca2e2445d9d044df143ae8fe6b2" Sep 15 17:38:49.120040 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:49.120015 2581 scope.go:117] "RemoveContainer" containerID="69b9b1aef8c42fbe69d45f7a0d1644c9eefcdca2e2445d9d044df143ae8fe6b2" Sep 15 17:38:49.120359 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:38:49.120338 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69b9b1aef8c42fbe69d45f7a0d1644c9eefcdca2e2445d9d044df143ae8fe6b2\": container with ID starting with 69b9b1aef8c42fbe69d45f7a0d1644c9eefcdca2e2445d9d044df143ae8fe6b2 not found: ID does not exist" containerID="69b9b1aef8c42fbe69d45f7a0d1644c9eefcdca2e2445d9d044df143ae8fe6b2" Sep 15 17:38:49.120425 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:49.120366 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69b9b1aef8c42fbe69d45f7a0d1644c9eefcdca2e2445d9d044df143ae8fe6b2"} err="failed to get container status \"69b9b1aef8c42fbe69d45f7a0d1644c9eefcdca2e2445d9d044df143ae8fe6b2\": rpc error: code = NotFound desc = could not find container \"69b9b1aef8c42fbe69d45f7a0d1644c9eefcdca2e2445d9d044df143ae8fe6b2\": container with ID starting with 69b9b1aef8c42fbe69d45f7a0d1644c9eefcdca2e2445d9d044df143ae8fe6b2 not found: ID does not exist" Sep 15 17:38:49.140462 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:49.140433 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc"] Sep 15 17:38:49.154708 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:49.154676 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-dp2lc"] Sep 15 17:38:49.752107 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:49.752060 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6310a3cd-a825-485d-9a51-915c950ef436" path="/var/lib/kubelet/pods/6310a3cd-a825-485d-9a51-915c950ef436/volumes" Sep 15 17:38:51.548761 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.548723 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz"] Sep 15 17:38:51.549261 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.549242 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6310a3cd-a825-485d-9a51-915c950ef436" containerName="manager" Sep 15 17:38:51.549261 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.549257 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6310a3cd-a825-485d-9a51-915c950ef436" containerName="manager" Sep 15 17:38:51.549378 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.549282 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1076754-f6d1-4056-be61-aeccdb239c2e" containerName="manager" Sep 15 17:38:51.549378 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.549297 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1076754-f6d1-4056-be61-aeccdb239c2e" containerName="manager" Sep 15 17:38:51.549378 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.549361 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6310a3cd-a825-485d-9a51-915c950ef436" containerName="manager" Sep 15 17:38:51.549378 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.549370 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1076754-f6d1-4056-be61-aeccdb239c2e" containerName="manager" Sep 15 17:38:51.553707 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.553685 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.556654 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.556626 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xntvl\"" Sep 15 17:38:51.556887 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.556872 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 15 17:38:51.572231 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.567117 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz"] Sep 15 17:38:51.588730 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.588689 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:51.643755 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.643712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.643939 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.643760 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.643939 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.643873 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.643939 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.643915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbvkq\" (UniqueName: \"kubernetes.io/projected/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-kube-api-access-tbvkq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.643939 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.643934 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.644119 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.643963 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.644119 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.643996 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.644119 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.644035 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.644223 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.644126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.690787 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.690749 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:51.745246 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.745213 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.745426 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.745274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.745426 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.745292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.745426 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.745312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.745426 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.745360 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.745426 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.745384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbvkq\" (UniqueName: \"kubernetes.io/projected/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-kube-api-access-tbvkq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.745426 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.745409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.745742 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.745435 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.745742 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.745477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.745853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.745827 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.745967 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.745938 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.746115 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.746058 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.746203 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.746153 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.746246 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.746220 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.748204 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.748178 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.748419 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.748385 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.757779 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.757753 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.765341 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.765316 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbvkq\" (UniqueName: \"kubernetes.io/projected/b8e4b0e1-d642-49cd-97f8-fe11e92edf37-kube-api-access-tbvkq\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tmmbz\" (UID: \"b8e4b0e1-d642-49cd-97f8-fe11e92edf37\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.865647 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.865614 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:51.922219 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:51.922185 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:38:52.166569 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:52.166414 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz"] Sep 15 17:38:52.168697 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:38:52.168670 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e4b0e1_d642_49cd_97f8_fe11e92edf37.slice/crio-edb686e8d3dfed63ad0baafdbfc5349287883de31e6c17f99ca0b18f97aa7924 WatchSource:0}: Error finding container edb686e8d3dfed63ad0baafdbfc5349287883de31e6c17f99ca0b18f97aa7924: Status 404 returned error can't find the container with id edb686e8d3dfed63ad0baafdbfc5349287883de31e6c17f99ca0b18f97aa7924 Sep 15 17:38:53.151453 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:53.151412 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" event={"ID":"b8e4b0e1-d642-49cd-97f8-fe11e92edf37","Type":"ContainerStarted","Data":"edb686e8d3dfed63ad0baafdbfc5349287883de31e6c17f99ca0b18f97aa7924"} Sep 15 17:38:54.594738 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:54.594703 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 17:38:54.595013 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:54.594780 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 17:38:54.595013 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:54.594808 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 17:38:55.164060 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:55.164021 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" event={"ID":"b8e4b0e1-d642-49cd-97f8-fe11e92edf37","Type":"ContainerStarted","Data":"d48ca8e5736e17315de546662e7da7906a2d4a3e7024255a129939462774ab76"} Sep 15 17:38:55.183790 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:55.183740 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" podStartSLOduration=1.760212305 podStartE2EDuration="4.183721011s" totalImagesPullingTime="2.423508706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:38:55.182574303 +0000 UTC m=+457.907392595" watchObservedRunningTime="2026-09-15 17:38:55.183721011 +0000 UTC m=+457.908539292" Sep 15 17:38:55.866682 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:55.866645 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:55.871590 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:55.871564 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:56.169708 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:56.169615 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:38:56.170776 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:38:56.170756 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:39:03.166629 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.166595 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:39:03.169863 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.169834 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9qx58"] Sep 15 17:39:03.174066 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.174044 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-9qx58" Sep 15 17:39:03.176361 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.176337 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 15 17:39:03.176491 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.176382 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dd98x\"" Sep 15 17:39:03.183278 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.183251 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9qx58"] Sep 15 17:39:03.268542 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.268507 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9qx58"] Sep 15 17:39:03.274454 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.274423 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:39:03.332645 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.332615 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:39:03.357655 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.357612 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03d6553a-4fd8-4455-b6f1-6d04ef2c073b-config-file\") pod \"limitador-limitador-8588749977-9qx58\" (UID: \"03d6553a-4fd8-4455-b6f1-6d04ef2c073b\") " pod="kuadrant-system/limitador-limitador-8588749977-9qx58" Sep 15 17:39:03.357974 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.357939 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcqqb\" (UniqueName: \"kubernetes.io/projected/03d6553a-4fd8-4455-b6f1-6d04ef2c073b-kube-api-access-vcqqb\") pod \"limitador-limitador-8588749977-9qx58\" (UID: \"03d6553a-4fd8-4455-b6f1-6d04ef2c073b\") " pod="kuadrant-system/limitador-limitador-8588749977-9qx58" Sep 15 17:39:03.459677 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.459578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03d6553a-4fd8-4455-b6f1-6d04ef2c073b-config-file\") pod \"limitador-limitador-8588749977-9qx58\" (UID: \"03d6553a-4fd8-4455-b6f1-6d04ef2c073b\") " pod="kuadrant-system/limitador-limitador-8588749977-9qx58" Sep 15 17:39:03.459677 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.459632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcqqb\" (UniqueName: \"kubernetes.io/projected/03d6553a-4fd8-4455-b6f1-6d04ef2c073b-kube-api-access-vcqqb\") pod \"limitador-limitador-8588749977-9qx58\" (UID: \"03d6553a-4fd8-4455-b6f1-6d04ef2c073b\") " pod="kuadrant-system/limitador-limitador-8588749977-9qx58" Sep 15 17:39:03.460606 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.460577 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03d6553a-4fd8-4455-b6f1-6d04ef2c073b-config-file\") pod \"limitador-limitador-8588749977-9qx58\" (UID: \"03d6553a-4fd8-4455-b6f1-6d04ef2c073b\") " pod="kuadrant-system/limitador-limitador-8588749977-9qx58" Sep 15 17:39:03.469491 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.469463 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcqqb\" (UniqueName: \"kubernetes.io/projected/03d6553a-4fd8-4455-b6f1-6d04ef2c073b-kube-api-access-vcqqb\") pod \"limitador-limitador-8588749977-9qx58\" (UID: \"03d6553a-4fd8-4455-b6f1-6d04ef2c073b\") " pod="kuadrant-system/limitador-limitador-8588749977-9qx58" Sep 15 17:39:03.484871 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.484835 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-9qx58" Sep 15 17:39:03.762701 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:03.762671 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9qx58"] Sep 15 17:39:03.764876 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:39:03.764845 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d6553a_4fd8_4455_b6f1_6d04ef2c073b.slice/crio-e84f0c1cf0b42e36772daf0436a8e1c0d311353bc80366d22783dd1c76e2297e WatchSource:0}: Error finding container e84f0c1cf0b42e36772daf0436a8e1c0d311353bc80366d22783dd1c76e2297e: Status 404 returned error can't find the container with id e84f0c1cf0b42e36772daf0436a8e1c0d311353bc80366d22783dd1c76e2297e Sep 15 17:39:04.011402 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:04.011369 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:39:04.111167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:04.111137 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:39:04.219868 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:04.219829 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-9qx58" event={"ID":"03d6553a-4fd8-4455-b6f1-6d04ef2c073b","Type":"ContainerStarted","Data":"e84f0c1cf0b42e36772daf0436a8e1c0d311353bc80366d22783dd1c76e2297e"} Sep 15 17:39:11.261447 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:11.261324 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-9qx58" event={"ID":"03d6553a-4fd8-4455-b6f1-6d04ef2c073b","Type":"ContainerStarted","Data":"f9bac991ee8c1c2bf5577b12b2dff6d093c9025656b992bc5872e3a1bcbebfdd"} Sep 15 17:39:11.261447 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:11.261406 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-9qx58" Sep 15 17:39:11.279108 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:11.279027 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-9qx58" podStartSLOduration=1.158471292 podStartE2EDuration="8.279008971s" totalImagesPullingTime="7.120537679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:39:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:39:11.276481595 +0000 UTC m=+474.001299921" watchObservedRunningTime="2026-09-15 17:39:11.279008971 +0000 UTC m=+474.003827261" Sep 15 17:39:18.510016 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:18.509976 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9qx58"] Sep 15 17:39:18.510764 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:18.510196 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-9qx58" podUID="03d6553a-4fd8-4455-b6f1-6d04ef2c073b" containerName="limitador" containerID="cri-o://f9bac991ee8c1c2bf5577b12b2dff6d093c9025656b992bc5872e3a1bcbebfdd" gracePeriod=30 Sep 15 17:39:18.512714 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:18.512688 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-9qx58" Sep 15 17:39:19.057789 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.057760 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-9qx58" Sep 15 17:39:19.100524 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.100484 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcqqb\" (UniqueName: \"kubernetes.io/projected/03d6553a-4fd8-4455-b6f1-6d04ef2c073b-kube-api-access-vcqqb\") pod \"03d6553a-4fd8-4455-b6f1-6d04ef2c073b\" (UID: \"03d6553a-4fd8-4455-b6f1-6d04ef2c073b\") " Sep 15 17:39:19.100734 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.100582 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03d6553a-4fd8-4455-b6f1-6d04ef2c073b-config-file\") pod \"03d6553a-4fd8-4455-b6f1-6d04ef2c073b\" (UID: \"03d6553a-4fd8-4455-b6f1-6d04ef2c073b\") " Sep 15 17:39:19.100940 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.100910 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03d6553a-4fd8-4455-b6f1-6d04ef2c073b-config-file" (OuterVolumeSpecName: "config-file") pod "03d6553a-4fd8-4455-b6f1-6d04ef2c073b" (UID: "03d6553a-4fd8-4455-b6f1-6d04ef2c073b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 17:39:19.102683 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.102640 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03d6553a-4fd8-4455-b6f1-6d04ef2c073b-kube-api-access-vcqqb" (OuterVolumeSpecName: "kube-api-access-vcqqb") pod "03d6553a-4fd8-4455-b6f1-6d04ef2c073b" (UID: "03d6553a-4fd8-4455-b6f1-6d04ef2c073b"). InnerVolumeSpecName "kube-api-access-vcqqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:39:19.201431 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.201393 2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/03d6553a-4fd8-4455-b6f1-6d04ef2c073b-config-file\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:39:19.201431 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.201422 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcqqb\" (UniqueName: \"kubernetes.io/projected/03d6553a-4fd8-4455-b6f1-6d04ef2c073b-kube-api-access-vcqqb\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:39:19.306655 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.306617 2581 generic.go:356] "Generic (PLEG): container finished" podID="03d6553a-4fd8-4455-b6f1-6d04ef2c073b" containerID="f9bac991ee8c1c2bf5577b12b2dff6d093c9025656b992bc5872e3a1bcbebfdd" exitCode=0 Sep 15 17:39:19.306655 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.306667 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-9qx58" Sep 15 17:39:19.306929 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.306711 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-9qx58" event={"ID":"03d6553a-4fd8-4455-b6f1-6d04ef2c073b","Type":"ContainerDied","Data":"f9bac991ee8c1c2bf5577b12b2dff6d093c9025656b992bc5872e3a1bcbebfdd"} Sep 15 17:39:19.306929 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.306799 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-9qx58" event={"ID":"03d6553a-4fd8-4455-b6f1-6d04ef2c073b","Type":"ContainerDied","Data":"e84f0c1cf0b42e36772daf0436a8e1c0d311353bc80366d22783dd1c76e2297e"} Sep 15 17:39:19.306929 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.306824 2581 scope.go:117] "RemoveContainer" containerID="f9bac991ee8c1c2bf5577b12b2dff6d093c9025656b992bc5872e3a1bcbebfdd" Sep 15 17:39:19.316798 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.316779 2581 scope.go:117] "RemoveContainer" containerID="f9bac991ee8c1c2bf5577b12b2dff6d093c9025656b992bc5872e3a1bcbebfdd" Sep 15 17:39:19.317147 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:39:19.317071 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9bac991ee8c1c2bf5577b12b2dff6d093c9025656b992bc5872e3a1bcbebfdd\": container with ID starting with f9bac991ee8c1c2bf5577b12b2dff6d093c9025656b992bc5872e3a1bcbebfdd not found: ID does not exist" containerID="f9bac991ee8c1c2bf5577b12b2dff6d093c9025656b992bc5872e3a1bcbebfdd" Sep 15 17:39:19.317214 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.317158 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9bac991ee8c1c2bf5577b12b2dff6d093c9025656b992bc5872e3a1bcbebfdd"} err="failed to get container status \"f9bac991ee8c1c2bf5577b12b2dff6d093c9025656b992bc5872e3a1bcbebfdd\": rpc error: code = NotFound desc = could not find container \"f9bac991ee8c1c2bf5577b12b2dff6d093c9025656b992bc5872e3a1bcbebfdd\": container with ID starting with f9bac991ee8c1c2bf5577b12b2dff6d093c9025656b992bc5872e3a1bcbebfdd not found: ID does not exist" Sep 15 17:39:19.327855 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.327816 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9qx58"] Sep 15 17:39:19.331677 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.331641 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9qx58"] Sep 15 17:39:19.752656 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:19.752619 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03d6553a-4fd8-4455-b6f1-6d04ef2c073b" path="/var/lib/kubelet/pods/03d6553a-4fd8-4455-b6f1-6d04ef2c073b/volumes" Sep 15 17:39:22.739039 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:22.738999 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:39:22.897331 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:22.897297 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:39:23.200827 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.200793 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4vscm"] Sep 15 17:39:23.201474 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.201454 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03d6553a-4fd8-4455-b6f1-6d04ef2c073b" containerName="limitador" Sep 15 17:39:23.201528 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.201480 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="03d6553a-4fd8-4455-b6f1-6d04ef2c073b" containerName="limitador" Sep 15 17:39:23.201637 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.201625 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="03d6553a-4fd8-4455-b6f1-6d04ef2c073b" containerName="limitador" Sep 15 17:39:23.206665 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.206641 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4vscm" Sep 15 17:39:23.209713 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.209672 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 15 17:39:23.210364 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.210338 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 15 17:39:23.210502 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.210363 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-h49lz\"" Sep 15 17:39:23.210502 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.210338 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 15 17:39:23.211071 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.211045 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4vscm"] Sep 15 17:39:23.236446 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.236416 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:39:23.238699 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.238677 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3668d498-99c4-4854-a5da-9fd085fe4f5b-data\") pod \"postgres-69fb4594cf-4vscm\" (UID: \"3668d498-99c4-4854-a5da-9fd085fe4f5b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4vscm" Sep 15 17:39:23.238789 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.238713 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tv5p\" (UniqueName: \"kubernetes.io/projected/3668d498-99c4-4854-a5da-9fd085fe4f5b-kube-api-access-5tv5p\") pod \"postgres-69fb4594cf-4vscm\" (UID: \"3668d498-99c4-4854-a5da-9fd085fe4f5b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4vscm" Sep 15 17:39:23.339691 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.339659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3668d498-99c4-4854-a5da-9fd085fe4f5b-data\") pod \"postgres-69fb4594cf-4vscm\" (UID: \"3668d498-99c4-4854-a5da-9fd085fe4f5b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4vscm" Sep 15 17:39:23.339864 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.339698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tv5p\" (UniqueName: \"kubernetes.io/projected/3668d498-99c4-4854-a5da-9fd085fe4f5b-kube-api-access-5tv5p\") pod \"postgres-69fb4594cf-4vscm\" (UID: \"3668d498-99c4-4854-a5da-9fd085fe4f5b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4vscm" Sep 15 17:39:23.340059 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.340040 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3668d498-99c4-4854-a5da-9fd085fe4f5b-data\") pod \"postgres-69fb4594cf-4vscm\" (UID: \"3668d498-99c4-4854-a5da-9fd085fe4f5b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4vscm" Sep 15 17:39:23.347664 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.347637 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tv5p\" (UniqueName: \"kubernetes.io/projected/3668d498-99c4-4854-a5da-9fd085fe4f5b-kube-api-access-5tv5p\") pod \"postgres-69fb4594cf-4vscm\" (UID: \"3668d498-99c4-4854-a5da-9fd085fe4f5b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4vscm" Sep 15 17:39:23.518551 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.518464 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4vscm" Sep 15 17:39:23.790639 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:23.790612 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4vscm"] Sep 15 17:39:23.792864 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:39:23.792834 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3668d498_99c4_4854_a5da_9fd085fe4f5b.slice/crio-b67bc6903f96da3a36c5cd4ae4581ed77e5244e3a8421c3211706e1e2177b1e1 WatchSource:0}: Error finding container b67bc6903f96da3a36c5cd4ae4581ed77e5244e3a8421c3211706e1e2177b1e1: Status 404 returned error can't find the container with id b67bc6903f96da3a36c5cd4ae4581ed77e5244e3a8421c3211706e1e2177b1e1 Sep 15 17:39:24.336197 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:24.336161 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4vscm" event={"ID":"3668d498-99c4-4854-a5da-9fd085fe4f5b","Type":"ContainerStarted","Data":"b67bc6903f96da3a36c5cd4ae4581ed77e5244e3a8421c3211706e1e2177b1e1"} Sep 15 17:39:29.369845 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:29.369797 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4vscm" event={"ID":"3668d498-99c4-4854-a5da-9fd085fe4f5b","Type":"ContainerStarted","Data":"aaf2329f85b55579fa77d89707d1b6a8dc7f29f356daf380e989304469bd98ba"} Sep 15 17:39:29.370349 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:29.369931 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4vscm" Sep 15 17:39:29.387255 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:29.387194 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4vscm" podStartSLOduration=1.38573656 podStartE2EDuration="6.387176898s" totalImagesPullingTime="5.001440338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:39:29.38557562 +0000 UTC m=+492.110393912" watchObservedRunningTime="2026-09-15 17:39:29.387176898 +0000 UTC m=+492.111995188" Sep 15 17:39:35.403469 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:35.403439 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4vscm" Sep 15 17:39:35.738457 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:35.738371 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:39:36.206015 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:36.205977 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:39:44.095380 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.095345 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:39:44.124095 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.124058 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-p429m"] Sep 15 17:39:44.127838 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.127808 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-p429m" Sep 15 17:39:44.130151 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.130127 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 15 17:39:44.130296 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.130151 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-clt78\"" Sep 15 17:39:44.130296 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.130129 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 15 17:39:44.130872 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.130854 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 15 17:39:44.137371 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.137347 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-p429m"] Sep 15 17:39:44.192736 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.192702 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:39:44.244348 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.244307 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45zcx\" (UniqueName: \"kubernetes.io/projected/e21ae343-8138-416c-9f78-297d4b75175c-kube-api-access-45zcx\") pod \"maas-controller-75dc6cbdf-p429m\" (UID: \"e21ae343-8138-416c-9f78-297d4b75175c\") " pod="opendatahub/maas-controller-75dc6cbdf-p429m" Sep 15 17:39:44.244525 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.244395 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e21ae343-8138-416c-9f78-297d4b75175c-webhook-cert\") pod \"maas-controller-75dc6cbdf-p429m\" (UID: \"e21ae343-8138-416c-9f78-297d4b75175c\") " pod="opendatahub/maas-controller-75dc6cbdf-p429m" Sep 15 17:39:44.244525 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.244497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e21ae343-8138-416c-9f78-297d4b75175c-metrics-certs\") pod \"maas-controller-75dc6cbdf-p429m\" (UID: \"e21ae343-8138-416c-9f78-297d4b75175c\") " pod="opendatahub/maas-controller-75dc6cbdf-p429m" Sep 15 17:39:44.286373 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.286336 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:39:44.290398 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.290366 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5dbbcdb4c-kjft7"] Sep 15 17:39:44.294103 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.294062 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dbbcdb4c-kjft7" Sep 15 17:39:44.305150 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.305114 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5dbbcdb4c-kjft7"] Sep 15 17:39:44.345589 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.345491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e21ae343-8138-416c-9f78-297d4b75175c-metrics-certs\") pod \"maas-controller-75dc6cbdf-p429m\" (UID: \"e21ae343-8138-416c-9f78-297d4b75175c\") " pod="opendatahub/maas-controller-75dc6cbdf-p429m" Sep 15 17:39:44.345589 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.345536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45zcx\" (UniqueName: \"kubernetes.io/projected/e21ae343-8138-416c-9f78-297d4b75175c-kube-api-access-45zcx\") pod \"maas-controller-75dc6cbdf-p429m\" (UID: \"e21ae343-8138-416c-9f78-297d4b75175c\") " pod="opendatahub/maas-controller-75dc6cbdf-p429m" Sep 15 17:39:44.345835 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.345588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e21ae343-8138-416c-9f78-297d4b75175c-webhook-cert\") pod \"maas-controller-75dc6cbdf-p429m\" (UID: \"e21ae343-8138-416c-9f78-297d4b75175c\") " pod="opendatahub/maas-controller-75dc6cbdf-p429m" Sep 15 17:39:44.345835 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:39:44.345719 2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Sep 15 17:39:44.345835 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:39:44.345798 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e21ae343-8138-416c-9f78-297d4b75175c-webhook-cert podName:e21ae343-8138-416c-9f78-297d4b75175c nodeName:}" failed. No retries permitted until 2026-09-15 17:39:44.845776182 +0000 UTC m=+507.570594452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/e21ae343-8138-416c-9f78-297d4b75175c-webhook-cert") pod "maas-controller-75dc6cbdf-p429m" (UID: "e21ae343-8138-416c-9f78-297d4b75175c") : secret "maas-controller-webhook-cert" not found Sep 15 17:39:44.348022 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.347999 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e21ae343-8138-416c-9f78-297d4b75175c-metrics-certs\") pod \"maas-controller-75dc6cbdf-p429m\" (UID: \"e21ae343-8138-416c-9f78-297d4b75175c\") " pod="opendatahub/maas-controller-75dc6cbdf-p429m" Sep 15 17:39:44.356021 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.355998 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45zcx\" (UniqueName: \"kubernetes.io/projected/e21ae343-8138-416c-9f78-297d4b75175c-kube-api-access-45zcx\") pod \"maas-controller-75dc6cbdf-p429m\" (UID: \"e21ae343-8138-416c-9f78-297d4b75175c\") " pod="opendatahub/maas-controller-75dc6cbdf-p429m" Sep 15 17:39:44.401580 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.401532 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:39:44.446202 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.446167 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5bf3caba-ebb2-4cd0-8ad1-ed2577be308c-webhook-cert\") pod \"maas-controller-5dbbcdb4c-kjft7\" (UID: \"5bf3caba-ebb2-4cd0-8ad1-ed2577be308c\") " pod="opendatahub/maas-controller-5dbbcdb4c-kjft7" Sep 15 17:39:44.446202 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.446204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bf3caba-ebb2-4cd0-8ad1-ed2577be308c-metrics-certs\") pod \"maas-controller-5dbbcdb4c-kjft7\" (UID: \"5bf3caba-ebb2-4cd0-8ad1-ed2577be308c\") " pod="opendatahub/maas-controller-5dbbcdb4c-kjft7" Sep 15 17:39:44.446415 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.446227 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptbvj\" (UniqueName: \"kubernetes.io/projected/5bf3caba-ebb2-4cd0-8ad1-ed2577be308c-kube-api-access-ptbvj\") pod \"maas-controller-5dbbcdb4c-kjft7\" (UID: \"5bf3caba-ebb2-4cd0-8ad1-ed2577be308c\") " pod="opendatahub/maas-controller-5dbbcdb4c-kjft7" Sep 15 17:39:44.547695 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.547654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5bf3caba-ebb2-4cd0-8ad1-ed2577be308c-webhook-cert\") pod \"maas-controller-5dbbcdb4c-kjft7\" (UID: \"5bf3caba-ebb2-4cd0-8ad1-ed2577be308c\") " pod="opendatahub/maas-controller-5dbbcdb4c-kjft7" Sep 15 17:39:44.547695 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.547695 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bf3caba-ebb2-4cd0-8ad1-ed2577be308c-metrics-certs\") pod \"maas-controller-5dbbcdb4c-kjft7\" (UID: \"5bf3caba-ebb2-4cd0-8ad1-ed2577be308c\") " pod="opendatahub/maas-controller-5dbbcdb4c-kjft7" Sep 15 17:39:44.547918 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.547711 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptbvj\" (UniqueName: \"kubernetes.io/projected/5bf3caba-ebb2-4cd0-8ad1-ed2577be308c-kube-api-access-ptbvj\") pod \"maas-controller-5dbbcdb4c-kjft7\" (UID: \"5bf3caba-ebb2-4cd0-8ad1-ed2577be308c\") " pod="opendatahub/maas-controller-5dbbcdb4c-kjft7" Sep 15 17:39:44.550318 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.550290 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5bf3caba-ebb2-4cd0-8ad1-ed2577be308c-metrics-certs\") pod \"maas-controller-5dbbcdb4c-kjft7\" (UID: \"5bf3caba-ebb2-4cd0-8ad1-ed2577be308c\") " pod="opendatahub/maas-controller-5dbbcdb4c-kjft7" Sep 15 17:39:44.550475 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.550322 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5bf3caba-ebb2-4cd0-8ad1-ed2577be308c-webhook-cert\") pod \"maas-controller-5dbbcdb4c-kjft7\" (UID: \"5bf3caba-ebb2-4cd0-8ad1-ed2577be308c\") " pod="opendatahub/maas-controller-5dbbcdb4c-kjft7" Sep 15 17:39:44.556407 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.556381 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptbvj\" (UniqueName: \"kubernetes.io/projected/5bf3caba-ebb2-4cd0-8ad1-ed2577be308c-kube-api-access-ptbvj\") pod \"maas-controller-5dbbcdb4c-kjft7\" (UID: \"5bf3caba-ebb2-4cd0-8ad1-ed2577be308c\") " pod="opendatahub/maas-controller-5dbbcdb4c-kjft7" Sep 15 17:39:44.605656 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.605565 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dbbcdb4c-kjft7" Sep 15 17:39:44.850990 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.850950 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e21ae343-8138-416c-9f78-297d4b75175c-webhook-cert\") pod \"maas-controller-75dc6cbdf-p429m\" (UID: \"e21ae343-8138-416c-9f78-297d4b75175c\") " pod="opendatahub/maas-controller-75dc6cbdf-p429m" Sep 15 17:39:44.853373 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.853352 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e21ae343-8138-416c-9f78-297d4b75175c-webhook-cert\") pod \"maas-controller-75dc6cbdf-p429m\" (UID: \"e21ae343-8138-416c-9f78-297d4b75175c\") " pod="opendatahub/maas-controller-75dc6cbdf-p429m" Sep 15 17:39:44.875941 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:44.875901 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5dbbcdb4c-kjft7"] Sep 15 17:39:44.878619 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:39:44.878586 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf3caba_ebb2_4cd0_8ad1_ed2577be308c.slice/crio-121fdd89437ce8b3ebb7a9c374421ce4b14970ba74044aabc45589c44eaabfb8 WatchSource:0}: Error finding container 121fdd89437ce8b3ebb7a9c374421ce4b14970ba74044aabc45589c44eaabfb8: Status 404 returned error can't find the container with id 121fdd89437ce8b3ebb7a9c374421ce4b14970ba74044aabc45589c44eaabfb8 Sep 15 17:39:45.039660 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:45.039617 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-p429m" Sep 15 17:39:45.342195 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:45.342146 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-p429m"] Sep 15 17:39:45.344600 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:39:45.344574 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode21ae343_8138_416c_9f78_297d4b75175c.slice/crio-d9bfbb0aefb1beb0d3be8a62b52a677311cf837aa81a8a9d68f8dd4b4e1d1be2 WatchSource:0}: Error finding container d9bfbb0aefb1beb0d3be8a62b52a677311cf837aa81a8a9d68f8dd4b4e1d1be2: Status 404 returned error can't find the container with id d9bfbb0aefb1beb0d3be8a62b52a677311cf837aa81a8a9d68f8dd4b4e1d1be2 Sep 15 17:39:45.452235 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:45.452196 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-p429m" event={"ID":"e21ae343-8138-416c-9f78-297d4b75175c","Type":"ContainerStarted","Data":"d9bfbb0aefb1beb0d3be8a62b52a677311cf837aa81a8a9d68f8dd4b4e1d1be2"} Sep 15 17:39:45.453418 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:45.453387 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dbbcdb4c-kjft7" event={"ID":"5bf3caba-ebb2-4cd0-8ad1-ed2577be308c","Type":"ContainerStarted","Data":"121fdd89437ce8b3ebb7a9c374421ce4b14970ba74044aabc45589c44eaabfb8"} Sep 15 17:39:47.785888 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:47.785851 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:39:47.885118 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:47.885065 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:39:48.475258 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:48.475215 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-p429m" event={"ID":"e21ae343-8138-416c-9f78-297d4b75175c","Type":"ContainerStarted","Data":"816a81e7053627639be3c12b6cc7f065bd570aa77d52a452b8345ccf396ef0a5"} Sep 15 17:39:48.475554 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:48.475324 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75dc6cbdf-p429m" Sep 15 17:39:48.476904 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:48.476876 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dbbcdb4c-kjft7" event={"ID":"5bf3caba-ebb2-4cd0-8ad1-ed2577be308c","Type":"ContainerStarted","Data":"d345917c078c53001de1c31a33e7e445a3633f6598998d16a0a74a594d1de684"} Sep 15 17:39:48.477007 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:48.476927 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5dbbcdb4c-kjft7" Sep 15 17:39:48.496264 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:48.496213 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75dc6cbdf-p429m" podStartSLOduration=2.265623244 podStartE2EDuration="4.496197797s" totalImagesPullingTime="2.230574553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:39:48.494435567 +0000 UTC m=+511.219253858" watchObservedRunningTime="2026-09-15 17:39:48.496197797 +0000 UTC m=+511.221016087" Sep 15 17:39:48.511738 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:48.511686 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5dbbcdb4c-kjft7" podStartSLOduration=1.822396757 podStartE2EDuration="4.51167001s" totalImagesPullingTime="2.689273253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:39:48.510406038 +0000 UTC m=+511.235224330" watchObservedRunningTime="2026-09-15 17:39:48.51167001 +0000 UTC m=+511.236488301" Sep 15 17:39:59.484385 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:59.484353 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75dc6cbdf-p429m" Sep 15 17:39:59.484868 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:59.484422 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5dbbcdb4c-kjft7" Sep 15 17:39:59.542534 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:59.542495 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-p429m"] Sep 15 17:39:59.543007 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:59.542970 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75dc6cbdf-p429m" podUID="e21ae343-8138-416c-9f78-297d4b75175c" containerName="manager" containerID="cri-o://816a81e7053627639be3c12b6cc7f065bd570aa77d52a452b8345ccf396ef0a5" gracePeriod=30 Sep 15 17:39:59.801167 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:59.801131 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-p429m" Sep 15 17:39:59.900754 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:59.900718 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e21ae343-8138-416c-9f78-297d4b75175c-metrics-certs\") pod \"e21ae343-8138-416c-9f78-297d4b75175c\" (UID: \"e21ae343-8138-416c-9f78-297d4b75175c\") " Sep 15 17:39:59.900935 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:59.900819 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e21ae343-8138-416c-9f78-297d4b75175c-webhook-cert\") pod \"e21ae343-8138-416c-9f78-297d4b75175c\" (UID: \"e21ae343-8138-416c-9f78-297d4b75175c\") " Sep 15 17:39:59.901018 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:59.900992 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45zcx\" (UniqueName: \"kubernetes.io/projected/e21ae343-8138-416c-9f78-297d4b75175c-kube-api-access-45zcx\") pod \"e21ae343-8138-416c-9f78-297d4b75175c\" (UID: \"e21ae343-8138-416c-9f78-297d4b75175c\") " Sep 15 17:39:59.903133 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:59.903052 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e21ae343-8138-416c-9f78-297d4b75175c-kube-api-access-45zcx" (OuterVolumeSpecName: "kube-api-access-45zcx") pod "e21ae343-8138-416c-9f78-297d4b75175c" (UID: "e21ae343-8138-416c-9f78-297d4b75175c"). InnerVolumeSpecName "kube-api-access-45zcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 17:39:59.903265 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:59.903142 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e21ae343-8138-416c-9f78-297d4b75175c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e21ae343-8138-416c-9f78-297d4b75175c" (UID: "e21ae343-8138-416c-9f78-297d4b75175c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:39:59.903265 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:39:59.903162 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e21ae343-8138-416c-9f78-297d4b75175c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e21ae343-8138-416c-9f78-297d4b75175c" (UID: "e21ae343-8138-416c-9f78-297d4b75175c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 17:40:00.001934 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:00.001901 2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e21ae343-8138-416c-9f78-297d4b75175c-webhook-cert\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:40:00.001934 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:00.001931 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45zcx\" (UniqueName: \"kubernetes.io/projected/e21ae343-8138-416c-9f78-297d4b75175c-kube-api-access-45zcx\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:40:00.001934 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:00.001942 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e21ae343-8138-416c-9f78-297d4b75175c-metrics-certs\") on node \"ip-10-0-141-84.ec2.internal\" DevicePath \"\"" Sep 15 17:40:00.542334 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:00.542302 2581 generic.go:356] "Generic (PLEG): container finished" podID="e21ae343-8138-416c-9f78-297d4b75175c" containerID="816a81e7053627639be3c12b6cc7f065bd570aa77d52a452b8345ccf396ef0a5" exitCode=0 Sep 15 17:40:00.542803 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:00.542346 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-p429m" Sep 15 17:40:00.542803 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:00.542365 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-p429m" event={"ID":"e21ae343-8138-416c-9f78-297d4b75175c","Type":"ContainerDied","Data":"816a81e7053627639be3c12b6cc7f065bd570aa77d52a452b8345ccf396ef0a5"} Sep 15 17:40:00.542803 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:00.542407 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-p429m" event={"ID":"e21ae343-8138-416c-9f78-297d4b75175c","Type":"ContainerDied","Data":"d9bfbb0aefb1beb0d3be8a62b52a677311cf837aa81a8a9d68f8dd4b4e1d1be2"} Sep 15 17:40:00.542803 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:00.542431 2581 scope.go:117] "RemoveContainer" containerID="816a81e7053627639be3c12b6cc7f065bd570aa77d52a452b8345ccf396ef0a5" Sep 15 17:40:00.552454 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:00.552319 2581 scope.go:117] "RemoveContainer" containerID="816a81e7053627639be3c12b6cc7f065bd570aa77d52a452b8345ccf396ef0a5" Sep 15 17:40:00.552674 ip-10-0-141-84 kubenswrapper[2581]: E0915 17:40:00.552655 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"816a81e7053627639be3c12b6cc7f065bd570aa77d52a452b8345ccf396ef0a5\": container with ID starting with 816a81e7053627639be3c12b6cc7f065bd570aa77d52a452b8345ccf396ef0a5 not found: ID does not exist" containerID="816a81e7053627639be3c12b6cc7f065bd570aa77d52a452b8345ccf396ef0a5" Sep 15 17:40:00.552717 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:00.552683 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"816a81e7053627639be3c12b6cc7f065bd570aa77d52a452b8345ccf396ef0a5"} err="failed to get container status \"816a81e7053627639be3c12b6cc7f065bd570aa77d52a452b8345ccf396ef0a5\": rpc error: code = NotFound desc = could not find container \"816a81e7053627639be3c12b6cc7f065bd570aa77d52a452b8345ccf396ef0a5\": container with ID starting with 816a81e7053627639be3c12b6cc7f065bd570aa77d52a452b8345ccf396ef0a5 not found: ID does not exist" Sep 15 17:40:00.564129 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:00.564096 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-p429m"] Sep 15 17:40:00.571627 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:00.568473 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-p429m"] Sep 15 17:40:01.752742 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:01.752701 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e21ae343-8138-416c-9f78-297d4b75175c" path="/var/lib/kubelet/pods/e21ae343-8138-416c-9f78-297d4b75175c/volumes" Sep 15 17:40:05.914590 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:05.914555 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:40:06.143151 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:06.143114 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:40:08.641575 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:08.641536 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:40:20.337418 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:20.337376 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:40:20.436789 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:20.436753 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:40:21.714692 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:21.714656 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:40:21.815880 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:21.815853 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:40:21.850968 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:21.850920 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq"] Sep 15 17:40:21.851557 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:21.851538 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e21ae343-8138-416c-9f78-297d4b75175c" containerName="manager" Sep 15 17:40:21.851557 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:21.851558 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e21ae343-8138-416c-9f78-297d4b75175c" containerName="manager" Sep 15 17:40:21.851686 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:21.851635 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e21ae343-8138-416c-9f78-297d4b75175c" containerName="manager" Sep 15 17:40:21.858310 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:21.858285 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" Sep 15 17:40:21.860663 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:21.860638 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 15 17:40:21.860835 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:21.860671 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 15 17:40:21.863828 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:21.863764 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq"] Sep 15 17:40:21.927095 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:21.927059 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:40:22.005347 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.005245 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3884b98a-e6ce-40c5-af66-4e0b4a1d9349-maas-api-tls\") pod \"maas-api-59f6566bbc-xs8mq\" (UID: \"3884b98a-e6ce-40c5-af66-4e0b4a1d9349\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" Sep 15 17:40:22.005347 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.005295 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3884b98a-e6ce-40c5-af66-4e0b4a1d9349-metrics-certs\") pod \"maas-api-59f6566bbc-xs8mq\" (UID: \"3884b98a-e6ce-40c5-af66-4e0b4a1d9349\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" Sep 15 17:40:22.005589 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.005363 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3884b98a-e6ce-40c5-af66-4e0b4a1d9349-openshift-service-ca\") pod \"maas-api-59f6566bbc-xs8mq\" (UID: \"3884b98a-e6ce-40c5-af66-4e0b4a1d9349\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" Sep 15 17:40:22.005589 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.005392 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwqhd\" (UniqueName: \"kubernetes.io/projected/3884b98a-e6ce-40c5-af66-4e0b4a1d9349-kube-api-access-cwqhd\") pod \"maas-api-59f6566bbc-xs8mq\" (UID: \"3884b98a-e6ce-40c5-af66-4e0b4a1d9349\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" Sep 15 17:40:22.029901 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.029856 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:40:22.106133 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.106100 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3884b98a-e6ce-40c5-af66-4e0b4a1d9349-openshift-service-ca\") pod \"maas-api-59f6566bbc-xs8mq\" (UID: \"3884b98a-e6ce-40c5-af66-4e0b4a1d9349\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" Sep 15 17:40:22.106351 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.106179 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwqhd\" (UniqueName: \"kubernetes.io/projected/3884b98a-e6ce-40c5-af66-4e0b4a1d9349-kube-api-access-cwqhd\") pod \"maas-api-59f6566bbc-xs8mq\" (UID: \"3884b98a-e6ce-40c5-af66-4e0b4a1d9349\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" Sep 15 17:40:22.106429 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.106355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3884b98a-e6ce-40c5-af66-4e0b4a1d9349-maas-api-tls\") pod \"maas-api-59f6566bbc-xs8mq\" (UID: \"3884b98a-e6ce-40c5-af66-4e0b4a1d9349\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" Sep 15 17:40:22.106429 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.106410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3884b98a-e6ce-40c5-af66-4e0b4a1d9349-metrics-certs\") pod \"maas-api-59f6566bbc-xs8mq\" (UID: \"3884b98a-e6ce-40c5-af66-4e0b4a1d9349\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" Sep 15 17:40:22.106976 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.106945 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3884b98a-e6ce-40c5-af66-4e0b4a1d9349-openshift-service-ca\") pod \"maas-api-59f6566bbc-xs8mq\" (UID: \"3884b98a-e6ce-40c5-af66-4e0b4a1d9349\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" Sep 15 17:40:22.108972 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.108936 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3884b98a-e6ce-40c5-af66-4e0b4a1d9349-metrics-certs\") pod \"maas-api-59f6566bbc-xs8mq\" (UID: \"3884b98a-e6ce-40c5-af66-4e0b4a1d9349\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" Sep 15 17:40:22.109121 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.108996 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3884b98a-e6ce-40c5-af66-4e0b4a1d9349-maas-api-tls\") pod \"maas-api-59f6566bbc-xs8mq\" (UID: \"3884b98a-e6ce-40c5-af66-4e0b4a1d9349\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" Sep 15 17:40:22.117148 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.117102 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwqhd\" (UniqueName: \"kubernetes.io/projected/3884b98a-e6ce-40c5-af66-4e0b4a1d9349-kube-api-access-cwqhd\") pod \"maas-api-59f6566bbc-xs8mq\" (UID: \"3884b98a-e6ce-40c5-af66-4e0b4a1d9349\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" Sep 15 17:40:22.170863 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.170827 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" Sep 15 17:40:22.290346 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.290130 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:40:22.382716 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.382679 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:40:22.383871 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.383847 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-nj64q"] Sep 15 17:40:22.388865 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.388844 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nj64q" Sep 15 17:40:22.391285 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.391252 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 15 17:40:22.397273 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.397243 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-nj64q"] Sep 15 17:40:22.415334 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.415298 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9hr2p"] Sep 15 17:40:22.419078 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.419056 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-9hr2p" Sep 15 17:40:22.421283 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.421261 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-j54lw\"" Sep 15 17:40:22.431729 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.431697 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9hr2p"] Sep 15 17:40:22.457721 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.457696 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq"] Sep 15 17:40:22.460335 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:40:22.460293 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3884b98a_e6ce_40c5_af66_4e0b4a1d9349.slice/crio-5b786803c554831595a389f4dc1869a9ba8bd56d9106f7b496833d6d8e82ea5b WatchSource:0}: Error finding container 5b786803c554831595a389f4dc1869a9ba8bd56d9106f7b496833d6d8e82ea5b: Status 404 returned error can't find the container with id 5b786803c554831595a389f4dc1869a9ba8bd56d9106f7b496833d6d8e82ea5b Sep 15 17:40:22.510048 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.510011 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q99w7\" (UniqueName: \"kubernetes.io/projected/93aacc5d-9e0f-48d3-8496-e4e2d440d49a-kube-api-access-q99w7\") pod \"payload-pre-processing-59fbc47bf8-nj64q\" (UID: \"93aacc5d-9e0f-48d3-8496-e4e2d440d49a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nj64q" Sep 15 17:40:22.510235 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.510059 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9hr2p\" (UID: \"96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9hr2p" Sep 15 17:40:22.510235 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.510119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfr7n\" (UniqueName: \"kubernetes.io/projected/96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0-kube-api-access-zfr7n\") pod \"payload-processing-5b54b7fbb7-9hr2p\" (UID: \"96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9hr2p" Sep 15 17:40:22.510235 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.510153 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93aacc5d-9e0f-48d3-8496-e4e2d440d49a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-nj64q\" (UID: \"93aacc5d-9e0f-48d3-8496-e4e2d440d49a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nj64q" Sep 15 17:40:22.611372 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.611337 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q99w7\" (UniqueName: \"kubernetes.io/projected/93aacc5d-9e0f-48d3-8496-e4e2d440d49a-kube-api-access-q99w7\") pod \"payload-pre-processing-59fbc47bf8-nj64q\" (UID: \"93aacc5d-9e0f-48d3-8496-e4e2d440d49a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nj64q" Sep 15 17:40:22.611564 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.611389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9hr2p\" (UID: \"96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9hr2p" Sep 15 17:40:22.611564 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.611434 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfr7n\" (UniqueName: \"kubernetes.io/projected/96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0-kube-api-access-zfr7n\") pod \"payload-processing-5b54b7fbb7-9hr2p\" (UID: \"96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9hr2p" Sep 15 17:40:22.611564 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.611457 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93aacc5d-9e0f-48d3-8496-e4e2d440d49a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-nj64q\" (UID: \"93aacc5d-9e0f-48d3-8496-e4e2d440d49a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nj64q" Sep 15 17:40:22.612437 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.612413 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93aacc5d-9e0f-48d3-8496-e4e2d440d49a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-nj64q\" (UID: \"93aacc5d-9e0f-48d3-8496-e4e2d440d49a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nj64q" Sep 15 17:40:22.612502 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.612413 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9hr2p\" (UID: \"96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9hr2p" Sep 15 17:40:22.625151 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.625113 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfr7n\" (UniqueName: \"kubernetes.io/projected/96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0-kube-api-access-zfr7n\") pod \"payload-processing-5b54b7fbb7-9hr2p\" (UID: \"96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9hr2p" Sep 15 17:40:22.625358 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.625113 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q99w7\" (UniqueName: \"kubernetes.io/projected/93aacc5d-9e0f-48d3-8496-e4e2d440d49a-kube-api-access-q99w7\") pod \"payload-pre-processing-59fbc47bf8-nj64q\" (UID: \"93aacc5d-9e0f-48d3-8496-e4e2d440d49a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nj64q" Sep 15 17:40:22.663754 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.663711 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" event={"ID":"3884b98a-e6ce-40c5-af66-4e0b4a1d9349","Type":"ContainerStarted","Data":"5b786803c554831595a389f4dc1869a9ba8bd56d9106f7b496833d6d8e82ea5b"} Sep 15 17:40:22.703755 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.703712 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nj64q" Sep 15 17:40:22.734139 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.734061 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-9hr2p" Sep 15 17:40:22.978213 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:22.978184 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-nj64q"] Sep 15 17:40:22.979993 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:40:22.979962 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93aacc5d_9e0f_48d3_8496_e4e2d440d49a.slice/crio-516619cd709c6fb3ad1728b0e74d8788cd61d278d65f4b86635e4fb846eb8532 WatchSource:0}: Error finding container 516619cd709c6fb3ad1728b0e74d8788cd61d278d65f4b86635e4fb846eb8532: Status 404 returned error can't find the container with id 516619cd709c6fb3ad1728b0e74d8788cd61d278d65f4b86635e4fb846eb8532 Sep 15 17:40:23.016292 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:23.016264 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9hr2p"] Sep 15 17:40:23.018917 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:40:23.018888 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d523ee_96eb_4cdc_aa9e_bd1c90dd9bf0.slice/crio-013ccc2d97697f6f388b567dee2ccf05f286bd9477ca5d66a38d05fef2aac2b2 WatchSource:0}: Error finding container 013ccc2d97697f6f388b567dee2ccf05f286bd9477ca5d66a38d05fef2aac2b2: Status 404 returned error can't find the container with id 013ccc2d97697f6f388b567dee2ccf05f286bd9477ca5d66a38d05fef2aac2b2 Sep 15 17:40:23.672000 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:23.671954 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nj64q" event={"ID":"93aacc5d-9e0f-48d3-8496-e4e2d440d49a","Type":"ContainerStarted","Data":"516619cd709c6fb3ad1728b0e74d8788cd61d278d65f4b86635e4fb846eb8532"} Sep 15 17:40:23.673797 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:23.673768 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-9hr2p" event={"ID":"96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0","Type":"ContainerStarted","Data":"013ccc2d97697f6f388b567dee2ccf05f286bd9477ca5d66a38d05fef2aac2b2"} Sep 15 17:40:24.686419 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:24.686019 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" event={"ID":"3884b98a-e6ce-40c5-af66-4e0b4a1d9349","Type":"ContainerStarted","Data":"7d83b6fdc5fde642c77731ec17ec1fc6776b336743f4e36d99a1c66dd07ad17b"} Sep 15 17:40:24.686419 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:24.686155 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" Sep 15 17:40:27.707520 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:27.707471 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nj64q" event={"ID":"93aacc5d-9e0f-48d3-8496-e4e2d440d49a","Type":"ContainerStarted","Data":"8ce04cf39caf2dc40a5393c10a106cadd91fdc2f13c83835f1747238eaad2c1b"} Sep 15 17:40:27.707961 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:27.707686 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nj64q" Sep 15 17:40:27.709461 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:27.709432 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-9hr2p" event={"ID":"96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0","Type":"ContainerStarted","Data":"2fa6d09be12e26a137c21df244ac6da3f29b4266e42a9f9a345e10204ec39096"} Sep 15 17:40:27.709608 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:27.709484 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-9hr2p" Sep 15 17:40:27.722734 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:27.722679 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nj64q" podStartSLOduration=1.490433739 podStartE2EDuration="5.722663926s" totalImagesPullingTime="4.232230187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:40:27.721600948 +0000 UTC m=+550.446419239" watchObservedRunningTime="2026-09-15 17:40:27.722663926 +0000 UTC m=+550.447482216" Sep 15 17:40:27.724302 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:27.724249 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" podStartSLOduration=4.7192479899999995 podStartE2EDuration="6.724232186s" totalImagesPullingTime="2.004984196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:40:24.707364655 +0000 UTC m=+547.432182985" watchObservedRunningTime="2026-09-15 17:40:27.724232186 +0000 UTC m=+550.449050478" Sep 15 17:40:27.741093 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:27.739252 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-9hr2p" podStartSLOduration=1.5566057949999998 podStartE2EDuration="5.739230289s" totalImagesPullingTime="4.182624494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:40:27.737113782 +0000 UTC m=+550.461932074" watchObservedRunningTime="2026-09-15 17:40:27.739230289 +0000 UTC m=+550.464048583" Sep 15 17:40:30.707984 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:30.707950 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-xs8mq" Sep 15 17:40:31.735191 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:31.735162 2581 generic.go:356] "Generic (PLEG): container finished" podID="b8e4b0e1-d642-49cd-97f8-fe11e92edf37" containerID="d48ca8e5736e17315de546662e7da7906a2d4a3e7024255a129939462774ab76" exitCode=0 Sep 15 17:40:31.735548 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:31.735230 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" event={"ID":"b8e4b0e1-d642-49cd-97f8-fe11e92edf37","Type":"ContainerDied","Data":"d48ca8e5736e17315de546662e7da7906a2d4a3e7024255a129939462774ab76"} Sep 15 17:40:31.735675 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:31.735659 2581 scope.go:117] "RemoveContainer" containerID="d48ca8e5736e17315de546662e7da7906a2d4a3e7024255a129939462774ab76" Sep 15 17:40:31.736721 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:31.736688 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 17:40:31.736795 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:31.736763 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 17:40:31.736835 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:31.736795 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 15 17:40:31.771471 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:31.771425 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:40:31.866218 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:31.866170 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:40:32.748558 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:32.747675 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" event={"ID":"b8e4b0e1-d642-49cd-97f8-fe11e92edf37","Type":"ContainerStarted","Data":"93592c7de3f57b3beb6d4eb7cc12a9a35084918a2c3ac617547124a77d9d718e"} Sep 15 17:40:32.866829 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:32.866794 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:40:32.867069 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:32.867045 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tmmbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Sep 15 17:40:32.867158 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:32.867138 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" podUID="b8e4b0e1-d642-49cd-97f8-fe11e92edf37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Sep 15 17:40:33.866590 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:33.866551 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tmmbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Sep 15 17:40:33.866996 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:33.866609 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" podUID="b8e4b0e1-d642-49cd-97f8-fe11e92edf37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Sep 15 17:40:34.866330 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:34.866297 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tmmbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Sep 15 17:40:34.866538 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:34.866359 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" podUID="b8e4b0e1-d642-49cd-97f8-fe11e92edf37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Sep 15 17:40:35.866240 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:35.866198 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tmmbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Sep 15 17:40:35.866727 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:35.866262 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" podUID="b8e4b0e1-d642-49cd-97f8-fe11e92edf37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Sep 15 17:40:36.866597 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:36.866553 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tmmbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Sep 15 17:40:36.866983 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:36.866613 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" podUID="b8e4b0e1-d642-49cd-97f8-fe11e92edf37" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Sep 15 17:40:37.870225 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:37.870194 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:40:37.870605 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:37.870473 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:40:37.871148 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:37.871129 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tmmbz" Sep 15 17:40:38.224758 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:38.224665 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-887zc_defc24c0-9272-4801-a2d0-8ae2e8559be8/manager/0.log" Sep 15 17:40:38.348077 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:38.348049 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fh5nm_ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac/manager/0.log" Sep 15 17:40:38.469434 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:38.469407 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5dbbcdb4c-kjft7_5bf3caba-ebb2-4cd0-8ad1-ed2577be308c/manager/0.log" Sep 15 17:40:38.716916 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:38.716872 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nj64q" Sep 15 17:40:38.717113 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:38.716975 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-9hr2p" Sep 15 17:40:38.879770 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:38.879739 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8444d5474c-4n57b_670742cf-0992-4add-b7d9-87a8e9f24be2/manager/0.log" Sep 15 17:40:38.885803 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:38.885777 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8444d5474c-4n57b_670742cf-0992-4add-b7d9-87a8e9f24be2/copy-manifests/0.log" Sep 15 17:40:39.556655 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:39.556625 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-59f6566bbc-xs8mq_3884b98a-e6ce-40c5-af66-4e0b4a1d9349/maas-api/0.log" Sep 15 17:40:39.679833 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:39.679800 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-4vscm_3668d498-99c4-4854-a5da-9fd085fe4f5b/postgres/0.log" Sep 15 17:40:40.653337 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:40.653310 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-jf4dl_a2859f41-902e-4a3a-8541-89a1ce8080a9/manager/0.log" Sep 15 17:40:40.772779 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:40.772751 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-98cml_48272a33-8f62-42a9-9308-fae1b3b88bd9/manager/0.log" Sep 15 17:40:41.030133 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:41.030040 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-9cwk9_e185d199-8083-430a-a4f5-2f84698a741b/manager/0.log" Sep 15 17:40:41.269430 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:41.269402 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-zjh9t_b4a1ae92-a9b9-4846-b865-f18d8efa1dbf/manager/0.log" Sep 15 17:40:42.065049 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:42.065010 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58595d97fd-zlc9p_8f860ab3-34be-4353-9ca9-70f402fbf1e0/kube-auth-proxy/0.log" Sep 15 17:40:42.191559 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:42.191529 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tmmbz_b8e4b0e1-d642-49cd-97f8-fe11e92edf37/istio-proxy/1.log" Sep 15 17:40:42.316746 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:42.316663 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nj64q_93aacc5d-9e0f-48d3-8496-e4e2d440d49a/payload-pre-processing/0.log" Sep 15 17:40:42.439338 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:42.439306 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9hr2p_96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0/payload-processing/0.log" Sep 15 17:40:42.565561 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:42.565533 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76b4c8ff46-4fdtq_d83e4858-93c2-45eb-9bd5-b70be1b0b965/router/0.log" Sep 15 17:40:49.309973 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:49.309940 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:40:49.396403 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:49.396368 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" limit=1024 Sep 15 17:40:53.372858 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:53.372829 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-88jzz_913d5e1b-5e80-4cda-8ceb-600f27b611fe/global-pull-secret-syncer/0.log" Sep 15 17:40:53.491886 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:53.491852 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9k6j4_fa4487e8-f742-4a86-9d47-8c4b4a90e76f/konnectivity-agent/0.log" Sep 15 17:40:53.612668 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:53.612634 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-84.ec2.internal_520fabedc60a64e4fd6648fb59243517/haproxy/0.log" Sep 15 17:40:57.914141 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:57.914107 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-jf4dl_a2859f41-902e-4a3a-8541-89a1ce8080a9/manager/0.log" Sep 15 17:40:57.939310 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:57.939280 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-98cml_48272a33-8f62-42a9-9308-fae1b3b88bd9/manager/0.log" Sep 15 17:40:57.999789 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:57.999713 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-9cwk9_e185d199-8083-430a-a4f5-2f84698a741b/manager/0.log" Sep 15 17:40:58.077054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:58.077024 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-zjh9t_b4a1ae92-a9b9-4846-b865-f18d8efa1dbf/manager/0.log" Sep 15 17:40:59.523765 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:59.523733 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c53211f4-9d2c-4319-8c30-60904243e175/alertmanager/0.log" Sep 15 17:40:59.550410 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:59.550336 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c53211f4-9d2c-4319-8c30-60904243e175/config-reloader/0.log" Sep 15 17:40:59.573059 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:59.573017 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c53211f4-9d2c-4319-8c30-60904243e175/kube-rbac-proxy-web/0.log" Sep 15 17:40:59.616780 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:59.616755 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c53211f4-9d2c-4319-8c30-60904243e175/kube-rbac-proxy/0.log" Sep 15 17:40:59.685273 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:59.685247 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c53211f4-9d2c-4319-8c30-60904243e175/kube-rbac-proxy-metric/0.log" Sep 15 17:40:59.733208 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:59.733181 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c53211f4-9d2c-4319-8c30-60904243e175/prom-label-proxy/0.log" Sep 15 17:40:59.758955 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:59.758927 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c53211f4-9d2c-4319-8c30-60904243e175/init-config-reloader/0.log" Sep 15 17:40:59.803436 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:59.803349 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-574jg_472f8dc7-89fb-4761-b5cb-a114e0037550/cluster-monitoring-operator/0.log" Sep 15 17:40:59.825814 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:59.825788 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-fxfw4_2038a5b6-96fa-4a05-814e-bed4c0321bab/kube-state-metrics/0.log" Sep 15 17:40:59.844961 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:59.844938 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-fxfw4_2038a5b6-96fa-4a05-814e-bed4c0321bab/kube-rbac-proxy-main/0.log" Sep 15 17:40:59.867690 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:59.867661 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-fxfw4_2038a5b6-96fa-4a05-814e-bed4c0321bab/kube-rbac-proxy-self/0.log" Sep 15 17:40:59.920317 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:40:59.920285 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-jhhpn_93dfb136-f81b-4602-825e-0c1ba00b3bbb/monitoring-plugin/0.log" Sep 15 17:41:00.103622 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:00.103595 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x99kc_751a9207-b3d5-437e-9830-1284e95c2fbd/node-exporter/0.log" Sep 15 17:41:00.123264 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:00.123236 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x99kc_751a9207-b3d5-437e-9830-1284e95c2fbd/kube-rbac-proxy/0.log" Sep 15 17:41:00.145809 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:00.145785 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x99kc_751a9207-b3d5-437e-9830-1284e95c2fbd/init-textfile/0.log" Sep 15 17:41:00.287706 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:00.287682 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18ebe23b-6c3e-4551-b4ca-6f77a048f0fb/prometheus/0.log" Sep 15 17:41:00.311120 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:00.311068 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18ebe23b-6c3e-4551-b4ca-6f77a048f0fb/config-reloader/0.log" Sep 15 17:41:00.332825 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:00.332784 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18ebe23b-6c3e-4551-b4ca-6f77a048f0fb/thanos-sidecar/0.log" Sep 15 17:41:00.357719 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:00.357634 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18ebe23b-6c3e-4551-b4ca-6f77a048f0fb/kube-rbac-proxy-web/0.log" Sep 15 17:41:00.380924 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:00.380883 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18ebe23b-6c3e-4551-b4ca-6f77a048f0fb/kube-rbac-proxy/0.log" Sep 15 17:41:00.403051 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:00.403013 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18ebe23b-6c3e-4551-b4ca-6f77a048f0fb/kube-rbac-proxy-thanos/0.log" Sep 15 17:41:00.430059 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:00.430035 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18ebe23b-6c3e-4551-b4ca-6f77a048f0fb/init-config-reloader/0.log" Sep 15 17:41:00.523392 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:00.523365 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-mpdhd_3bed477f-ec85-4f99-b461-55e07e4cebeb/prometheus-operator-admission-webhook/0.log" Sep 15 17:41:00.555552 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:00.555524 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56f68b6ff9-vthbs_0ba5d08b-75b3-4a02-b6f6-f90a38969d7b/telemeter-client/0.log" Sep 15 17:41:00.579748 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:00.579725 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56f68b6ff9-vthbs_0ba5d08b-75b3-4a02-b6f6-f90a38969d7b/reload/0.log" Sep 15 17:41:00.611989 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:00.611900 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56f68b6ff9-vthbs_0ba5d08b-75b3-4a02-b6f6-f90a38969d7b/kube-rbac-proxy/0.log" Sep 15 17:41:02.224706 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:02.224672 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-rzbrw_553d3f2c-4029-44be-a0ca-8e26b8cf6478/networking-console-plugin/0.log" Sep 15 17:41:02.847708 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:02.847670 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qzlwj_ff23d4ac-6b19-456a-86b4-195197a89788/console-operator/1.log" Sep 15 17:41:02.851755 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:02.851732 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qzlwj_ff23d4ac-6b19-456a-86b4-195197a89788/console-operator/2.log" Sep 15 17:41:03.469791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.469756 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw"] Sep 15 17:41:03.478367 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.478340 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:03.480788 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.480755 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xf6x6\"/\"openshift-service-ca.crt\"" Sep 15 17:41:03.480947 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.480879 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xf6x6\"/\"kube-root-ca.crt\"" Sep 15 17:41:03.481054 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.481032 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xf6x6\"/\"default-dockercfg-sb8kn\"" Sep 15 17:41:03.483008 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.482985 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw"] Sep 15 17:41:03.639976 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.639943 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjv69\" (UniqueName: \"kubernetes.io/projected/49558f0c-48f3-44d4-bfa7-d95c83776433-kube-api-access-zjv69\") pod \"perf-node-gather-daemonset-bp8cw\" (UID: \"49558f0c-48f3-44d4-bfa7-d95c83776433\") " pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:03.639976 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.639983 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49558f0c-48f3-44d4-bfa7-d95c83776433-sys\") pod \"perf-node-gather-daemonset-bp8cw\" (UID: \"49558f0c-48f3-44d4-bfa7-d95c83776433\") " pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:03.640292 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.640033 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49558f0c-48f3-44d4-bfa7-d95c83776433-proc\") pod \"perf-node-gather-daemonset-bp8cw\" (UID: \"49558f0c-48f3-44d4-bfa7-d95c83776433\") " pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:03.640292 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.640074 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49558f0c-48f3-44d4-bfa7-d95c83776433-lib-modules\") pod \"perf-node-gather-daemonset-bp8cw\" (UID: \"49558f0c-48f3-44d4-bfa7-d95c83776433\") " pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:03.640292 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.640114 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49558f0c-48f3-44d4-bfa7-d95c83776433-podres\") pod \"perf-node-gather-daemonset-bp8cw\" (UID: \"49558f0c-48f3-44d4-bfa7-d95c83776433\") " pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:03.741284 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.741193 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjv69\" (UniqueName: \"kubernetes.io/projected/49558f0c-48f3-44d4-bfa7-d95c83776433-kube-api-access-zjv69\") pod \"perf-node-gather-daemonset-bp8cw\" (UID: \"49558f0c-48f3-44d4-bfa7-d95c83776433\") " pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:03.741284 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.741235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49558f0c-48f3-44d4-bfa7-d95c83776433-sys\") pod \"perf-node-gather-daemonset-bp8cw\" (UID: \"49558f0c-48f3-44d4-bfa7-d95c83776433\") " pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:03.741284 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.741267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49558f0c-48f3-44d4-bfa7-d95c83776433-proc\") pod \"perf-node-gather-daemonset-bp8cw\" (UID: \"49558f0c-48f3-44d4-bfa7-d95c83776433\") " pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:03.741499 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.741293 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49558f0c-48f3-44d4-bfa7-d95c83776433-lib-modules\") pod \"perf-node-gather-daemonset-bp8cw\" (UID: \"49558f0c-48f3-44d4-bfa7-d95c83776433\") " pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:03.741499 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.741313 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49558f0c-48f3-44d4-bfa7-d95c83776433-podres\") pod \"perf-node-gather-daemonset-bp8cw\" (UID: \"49558f0c-48f3-44d4-bfa7-d95c83776433\") " pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:03.741499 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.741332 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49558f0c-48f3-44d4-bfa7-d95c83776433-sys\") pod \"perf-node-gather-daemonset-bp8cw\" (UID: \"49558f0c-48f3-44d4-bfa7-d95c83776433\") " pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:03.741499 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.741407 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49558f0c-48f3-44d4-bfa7-d95c83776433-proc\") pod \"perf-node-gather-daemonset-bp8cw\" (UID: \"49558f0c-48f3-44d4-bfa7-d95c83776433\") " pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:03.741631 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.741499 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49558f0c-48f3-44d4-bfa7-d95c83776433-lib-modules\") pod \"perf-node-gather-daemonset-bp8cw\" (UID: \"49558f0c-48f3-44d4-bfa7-d95c83776433\") " pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:03.741631 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.741519 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49558f0c-48f3-44d4-bfa7-d95c83776433-podres\") pod \"perf-node-gather-daemonset-bp8cw\" (UID: \"49558f0c-48f3-44d4-bfa7-d95c83776433\") " pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:03.750773 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.750747 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjv69\" (UniqueName: \"kubernetes.io/projected/49558f0c-48f3-44d4-bfa7-d95c83776433-kube-api-access-zjv69\") pod \"perf-node-gather-daemonset-bp8cw\" (UID: \"49558f0c-48f3-44d4-bfa7-d95c83776433\") " pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:03.790268 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:03.790218 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:04.065066 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:04.065028 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw"] Sep 15 17:41:04.066886 ip-10-0-141-84 kubenswrapper[2581]: W0915 17:41:04.066863 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod49558f0c_48f3_44d4_bfa7_d95c83776433.slice/crio-754a49d3570a1f5f962ebaaaed0faa257ca338ba43e8f3b6788de2d1ca4f4fc5 WatchSource:0}: Error finding container 754a49d3570a1f5f962ebaaaed0faa257ca338ba43e8f3b6788de2d1ca4f4fc5: Status 404 returned error can't find the container with id 754a49d3570a1f5f962ebaaaed0faa257ca338ba43e8f3b6788de2d1ca4f4fc5 Sep 15 17:41:04.174318 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:04.174280 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-q7tlz_4aa95671-b9a0-4162-840b-46d8eaaf2506/volume-data-source-validator/0.log" Sep 15 17:41:04.934161 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:04.934128 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" event={"ID":"49558f0c-48f3-44d4-bfa7-d95c83776433","Type":"ContainerStarted","Data":"ae188f4bec730f7835f8a85501f65c91cdebc23df86279eea80d966e11f4ca47"} Sep 15 17:41:04.934641 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:04.934184 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" event={"ID":"49558f0c-48f3-44d4-bfa7-d95c83776433","Type":"ContainerStarted","Data":"754a49d3570a1f5f962ebaaaed0faa257ca338ba43e8f3b6788de2d1ca4f4fc5"} Sep 15 17:41:04.934641 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:04.934214 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:04.970269 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:04.965816 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" podStartSLOduration=1.96579518 podStartE2EDuration="1.96579518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:41:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:41:04.963726913 +0000 UTC m=+587.688545205" watchObservedRunningTime="2026-09-15 17:41:04.96579518 +0000 UTC m=+587.690613472" Sep 15 17:41:05.447885 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:05.447852 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qvf8k_bcf3a972-2bdd-4ead-8482-0485ffb1101d/dns/0.log" Sep 15 17:41:05.467490 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:05.467456 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qvf8k_bcf3a972-2bdd-4ead-8482-0485ffb1101d/kube-rbac-proxy/0.log" Sep 15 17:41:05.511123 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:05.511068 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-btdt9_9a4c059e-96cd-4fef-bbce-0aed2fe62900/dns-node-resolver/0.log" Sep 15 17:41:06.134731 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:06.134697 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tncm8_a7df6635-4580-4cef-809a-46d2b81cbb5c/node-ca/0.log" Sep 15 17:41:07.159045 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:07.159008 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58595d97fd-zlc9p_8f860ab3-34be-4353-9ca9-70f402fbf1e0/kube-auth-proxy/0.log" Sep 15 17:41:07.188824 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:07.188787 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tmmbz_b8e4b0e1-d642-49cd-97f8-fe11e92edf37/istio-proxy/1.log" Sep 15 17:41:07.189269 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:07.189255 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tmmbz_b8e4b0e1-d642-49cd-97f8-fe11e92edf37/istio-proxy/0.log" Sep 15 17:41:07.207499 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:07.207470 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nj64q_93aacc5d-9e0f-48d3-8496-e4e2d440d49a/payload-pre-processing/0.log" Sep 15 17:41:07.231479 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:07.231433 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9hr2p_96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0/payload-processing/0.log" Sep 15 17:41:07.256001 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:07.255974 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76b4c8ff46-4fdtq_d83e4858-93c2-45eb-9bd5-b70be1b0b965/router/0.log" Sep 15 17:41:07.851238 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:07.851189 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-666q6_bb2f968d-aebe-461c-b000-e2196237c78f/serve-healthcheck-canary/0.log" Sep 15 17:41:08.354130 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:08.354100 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-x96rj_7625f3fc-9afb-4a69-87d1-4978d83ffad8/insights-operator/1.log" Sep 15 17:41:08.359971 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:08.359949 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-x96rj_7625f3fc-9afb-4a69-87d1-4978d83ffad8/insights-operator/0.log" Sep 15 17:41:08.592641 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:08.592610 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nx5fj_584dd0af-72b6-4a59-93c9-0a948e9f0e12/kube-rbac-proxy/0.log" Sep 15 17:41:08.612613 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:08.612542 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nx5fj_584dd0af-72b6-4a59-93c9-0a948e9f0e12/exporter/0.log" Sep 15 17:41:08.646816 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:08.646789 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nx5fj_584dd0af-72b6-4a59-93c9-0a948e9f0e12/extractor/0.log" Sep 15 17:41:10.773510 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:10.773477 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-887zc_defc24c0-9272-4801-a2d0-8ae2e8559be8/manager/0.log" Sep 15 17:41:10.800324 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:10.800293 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fh5nm_ff47d4aa-fc1b-48fa-b3d3-cdabf2f65cac/manager/0.log" Sep 15 17:41:10.828640 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:10.828609 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5dbbcdb4c-kjft7_5bf3caba-ebb2-4cd0-8ad1-ed2577be308c/manager/0.log" Sep 15 17:41:10.945722 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:10.945693 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8444d5474c-4n57b_670742cf-0992-4add-b7d9-87a8e9f24be2/manager/0.log" Sep 15 17:41:10.949734 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:10.949706 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xf6x6/perf-node-gather-daemonset-bp8cw" Sep 15 17:41:10.967807 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:10.967781 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8444d5474c-4n57b_670742cf-0992-4add-b7d9-87a8e9f24be2/copy-manifests/0.log" Sep 15 17:41:12.455791 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:12.455769 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-75pxq_2b8d07c6-f937-4f15-b457-17762a2c3e28/openshift-lws-operator/0.log" Sep 15 17:41:14.017480 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:14.017449 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58595d97fd-zlc9p_8f860ab3-34be-4353-9ca9-70f402fbf1e0/kube-auth-proxy/0.log" Sep 15 17:41:14.042321 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:14.042266 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tmmbz_b8e4b0e1-d642-49cd-97f8-fe11e92edf37/istio-proxy/1.log" Sep 15 17:41:14.042731 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:14.042715 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tmmbz_b8e4b0e1-d642-49cd-97f8-fe11e92edf37/istio-proxy/0.log" Sep 15 17:41:14.051920 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:14.051891 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nj64q_93aacc5d-9e0f-48d3-8496-e4e2d440d49a/payload-pre-processing/0.log" Sep 15 17:41:14.065976 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:14.065931 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9hr2p_96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0/payload-processing/0.log" Sep 15 17:41:14.081887 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:14.081867 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76b4c8ff46-4fdtq_d83e4858-93c2-45eb-9bd5-b70be1b0b965/router/0.log" Sep 15 17:41:15.291795 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:15.291763 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58595d97fd-zlc9p_8f860ab3-34be-4353-9ca9-70f402fbf1e0/kube-auth-proxy/0.log" Sep 15 17:41:15.315383 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:15.315353 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tmmbz_b8e4b0e1-d642-49cd-97f8-fe11e92edf37/istio-proxy/1.log" Sep 15 17:41:15.315746 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:15.315729 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tmmbz_b8e4b0e1-d642-49cd-97f8-fe11e92edf37/istio-proxy/0.log" Sep 15 17:41:15.328559 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:15.328534 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nj64q_93aacc5d-9e0f-48d3-8496-e4e2d440d49a/payload-pre-processing/0.log" Sep 15 17:41:15.343317 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:15.343289 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9hr2p_96d523ee-96eb-4cdc-aa9e-bd1c90dd9bf0/payload-processing/0.log" Sep 15 17:41:15.364005 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:15.363976 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76b4c8ff46-4fdtq_d83e4858-93c2-45eb-9bd5-b70be1b0b965/router/0.log" Sep 15 17:41:17.641672 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:17.641635 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qzlwj_ff23d4ac-6b19-456a-86b4-195197a89788/console-operator/1.log" Sep 15 17:41:17.643835 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:17.643806 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-qzlwj_ff23d4ac-6b19-456a-86b4-195197a89788/console-operator/1.log" Sep 15 17:41:17.649958 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:17.649933 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/ovn-acl-logging/0.log" Sep 15 17:41:17.652148 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:17.652129 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/ovn-acl-logging/0.log" Sep 15 17:41:18.012865 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:18.012784 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-59jf6_b9605bf3-fd4f-4659-b69d-b4698683fbad/kube-storage-version-migrator-operator/1.log" Sep 15 17:41:18.013679 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:18.013664 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-59jf6_b9605bf3-fd4f-4659-b69d-b4698683fbad/kube-storage-version-migrator-operator/0.log" Sep 15 17:41:19.226498 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:19.226469 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rb26f_76e419fd-5854-4474-a4dd-324785d896bd/kube-multus-additional-cni-plugins/0.log" Sep 15 17:41:19.248543 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:19.248519 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rb26f_76e419fd-5854-4474-a4dd-324785d896bd/egress-router-binary-copy/0.log" Sep 15 17:41:19.268449 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:19.268415 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rb26f_76e419fd-5854-4474-a4dd-324785d896bd/cni-plugins/0.log" Sep 15 17:41:19.290070 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:19.290040 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rb26f_76e419fd-5854-4474-a4dd-324785d896bd/bond-cni-plugin/0.log" Sep 15 17:41:19.313221 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:19.313191 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rb26f_76e419fd-5854-4474-a4dd-324785d896bd/routeoverride-cni/0.log" Sep 15 17:41:19.335955 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:19.335924 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rb26f_76e419fd-5854-4474-a4dd-324785d896bd/whereabouts-cni-bincopy/0.log" Sep 15 17:41:19.356977 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:19.356946 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rb26f_76e419fd-5854-4474-a4dd-324785d896bd/whereabouts-cni/0.log" Sep 15 17:41:19.546279 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:19.546198 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-p9llc_2927a04f-4bc9-400e-9afd-5480987c6ebc/kube-multus/0.log" Sep 15 17:41:19.600734 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:19.600706 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k7k2q_dd17968b-99b4-4dcf-afd3-33e5bc160e72/network-metrics-daemon/0.log" Sep 15 17:41:19.619101 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:19.619060 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k7k2q_dd17968b-99b4-4dcf-afd3-33e5bc160e72/kube-rbac-proxy/0.log" Sep 15 17:41:20.523097 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:20.523043 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/ovn-controller/0.log" Sep 15 17:41:20.540689 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:20.540659 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/ovn-acl-logging/1.log" Sep 15 17:41:20.540853 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:20.540752 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/ovn-acl-logging/0.log" Sep 15 17:41:20.558377 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:20.558349 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/kube-rbac-proxy-node/0.log" Sep 15 17:41:20.578884 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:20.578855 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/kube-rbac-proxy-ovn-metrics/0.log" Sep 15 17:41:20.596750 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:20.596717 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/northd/0.log" Sep 15 17:41:20.620632 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:20.620535 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/nbdb/0.log" Sep 15 17:41:20.637742 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:20.637714 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/sbdb/0.log" Sep 15 17:41:20.679886 ip-10-0-141-84 kubenswrapper[2581]: I0915 17:41:20.679852 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ldm4p_4c127eff-4d31-469d-968e-ec86c46bb4cd/ovnkube-controller/0.log"