Sep 11 06:18:32.777892 ip-10-0-135-168 systemd[1]: Starting Kubernetes Kubelet... Sep 11 06:18:33.203723 ip-10-0-135-168 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 06:18:33.203723 ip-10-0-135-168 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 11 06:18:33.203723 ip-10-0-135-168 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 06:18:33.203723 ip-10-0-135-168 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 11 06:18:33.203723 ip-10-0-135-168 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 06:18:33.206510 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.206427 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 11 06:18:33.209661 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209646 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 06:18:33.209661 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209661 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209664 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209667 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209671 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209674 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209677 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209680 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209683 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209686 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209688 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209693 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209697 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209701 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209704 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209707 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209715 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209718 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209721 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209723 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 06:18:33.209724 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209726 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209729 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209732 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209735 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209737 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209740 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209742 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209745 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209747 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209750 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209752 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209755 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209757 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209760 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209762 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209764 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209767 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209770 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209772 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209775 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 06:18:33.210175 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209778 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209781 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209783 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209786 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209790 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209793 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209797 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209800 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209802 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209805 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209807 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209809 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209812 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209815 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209818 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209821 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209823 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209826 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209829 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 06:18:33.210711 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209831 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209834 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209837 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209839 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209841 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209844 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209846 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209849 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209852 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209854 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209857 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209859 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209862 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209864 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209868 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209870 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209873 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209875 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209878 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209880 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 06:18:33.211179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209883 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209885 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209888 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209890 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209892 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209895 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209898 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209901 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209903 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209906 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209908 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209911 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209913 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209916 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209918 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209921 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209923 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209926 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209928 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 06:18:33.211668 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.209931 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211767 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211775 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211778 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211781 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211785 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211791 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211794 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211797 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211800 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211802 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211805 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211807 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211810 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211812 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211815 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211817 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211820 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211822 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211825 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 06:18:33.212115 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211827 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211830 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211832 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211834 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211837 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211839 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211841 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211844 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211847 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211849 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211851 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211854 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211856 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211858 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211862 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211865 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211870 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211874 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211878 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 06:18:33.212603 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211882 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211885 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211888 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211890 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211893 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211895 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211898 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211900 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211903 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211906 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211908 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211912 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211915 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211918 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211920 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211923 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211925 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211928 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211930 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211933 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 06:18:33.213104 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211936 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211938 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211940 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211943 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211945 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211948 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211950 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211954 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211957 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211960 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211963 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211965 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211968 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211971 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211974 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211977 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211979 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211982 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211984 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211987 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 06:18:33.213610 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211989 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211992 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211994 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211996 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.211999 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212001 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212004 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212006 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212009 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212011 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212014 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212016 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212019 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212021 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212024 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212028 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212031 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212034 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212036 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 11 06:18:33.214221 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212040 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212042 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212452 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212457 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212460 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212464 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212468 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212471 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212475 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212479 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212482 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212485 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212488 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212491 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212494 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212496 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212499 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212501 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212504 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212506 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 06:18:33.214698 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212509 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212511 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212514 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212516 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212520 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212524 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212527 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212530 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212532 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212535 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212537 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212540 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212543 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212546 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212548 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212551 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212554 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212557 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212559 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 06:18:33.215179 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212562 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212579 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212581 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212584 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212587 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212589 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212592 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212594 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212597 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212599 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212602 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212604 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212607 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212609 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212612 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212615 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212618 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212623 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212626 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 06:18:33.215689 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212628 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212631 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212634 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212637 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212640 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212643 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212646 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212648 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212651 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212654 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212656 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212659 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212661 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212664 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212667 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212670 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212672 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212675 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212677 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 06:18:33.216151 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212680 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212682 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212685 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212687 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212689 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212692 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212694 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212696 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212699 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212701 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212704 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212706 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212709 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212711 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212713 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212716 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212718 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212721 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212724 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212727 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 06:18:33.216628 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212729 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212731 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212734 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.212736 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212811 2578 flags.go:64] FLAG: --address="0.0.0.0" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212844 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212853 2578 flags.go:64] FLAG: --anonymous-auth="true" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212857 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212861 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212864 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212868 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212872 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212875 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212878 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212881 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212886 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212889 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212892 2578 flags.go:64] FLAG: --cgroup-root="" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212895 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212898 2578 flags.go:64] FLAG: --client-ca-file="" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212901 2578 flags.go:64] FLAG: --cloud-provider="external" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212904 2578 flags.go:64] FLAG: --cluster-dns="[]" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212908 2578 flags.go:64] FLAG: --cluster-domain="" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212911 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 11 06:18:33.217136 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212914 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212917 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212920 2578 flags.go:64] FLAG: --container-log-max-files="5" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212924 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212927 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212930 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212933 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212936 2578 flags.go:64] FLAG: --contention-profiling="false" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212939 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212942 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212945 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212948 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212952 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212955 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212958 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212960 2578 flags.go:64] FLAG: --enable-load-reader="false" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212964 2578 flags.go:64] FLAG: --enable-server="true" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212972 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212976 2578 flags.go:64] FLAG: --event-burst="100" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212979 2578 flags.go:64] FLAG: --event-qps="50" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212982 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212985 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212988 2578 flags.go:64] FLAG: --eviction-hard="" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212993 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 11 06:18:33.217740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212996 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.212998 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213001 2578 flags.go:64] FLAG: --eviction-soft="" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213004 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213007 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213010 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213012 2578 flags.go:64] FLAG: --experimental-mounter-path="" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213016 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213019 2578 flags.go:64] FLAG: --fail-swap-on="true" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213021 2578 flags.go:64] FLAG: --feature-gates="" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213025 2578 flags.go:64] FLAG: --file-check-frequency="20s" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213028 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213031 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213034 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213037 2578 flags.go:64] FLAG: --healthz-port="10248" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213040 2578 flags.go:64] FLAG: --help="false" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213043 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213046 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213049 2578 flags.go:64] FLAG: --http-check-frequency="20s" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213052 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213055 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213059 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213061 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 11 06:18:33.218312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213064 2578 flags.go:64] FLAG: --image-service-endpoint="" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213067 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213070 2578 flags.go:64] FLAG: --kube-api-burst="100" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213080 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213084 2578 flags.go:64] FLAG: --kube-api-qps="50" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213086 2578 flags.go:64] FLAG: --kube-reserved="" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213089 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213092 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213096 2578 flags.go:64] FLAG: --kubelet-cgroups="" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213099 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213102 2578 flags.go:64] FLAG: --lock-file="" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213105 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213108 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213112 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213117 2578 flags.go:64] FLAG: --log-json-split-stream="false" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213120 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213122 2578 flags.go:64] FLAG: --log-text-split-stream="false" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213125 2578 flags.go:64] FLAG: --logging-format="text" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213128 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213131 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213134 2578 flags.go:64] FLAG: --manifest-url="" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213137 2578 flags.go:64] FLAG: --manifest-url-header="" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213141 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213144 2578 flags.go:64] FLAG: --max-open-files="1000000" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213148 2578 flags.go:64] FLAG: --max-pods="110" Sep 11 06:18:33.218895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213150 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213153 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213156 2578 flags.go:64] FLAG: --memory-manager-policy="None" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213159 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213161 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213164 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213167 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213180 2578 flags.go:64] FLAG: --node-status-max-images="50" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213183 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213196 2578 flags.go:64] FLAG: --oom-score-adj="-999" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213200 2578 flags.go:64] FLAG: --pod-cidr="" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213210 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213216 2578 flags.go:64] FLAG: --pod-manifest-path="" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213219 2578 flags.go:64] FLAG: --pod-max-pids="-1" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213222 2578 flags.go:64] FLAG: --pods-per-core="0" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213226 2578 flags.go:64] FLAG: --port="10250" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213229 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213231 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01cc0c7e5958a4138" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213234 2578 flags.go:64] FLAG: --qos-reserved="" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213237 2578 flags.go:64] FLAG: --read-only-port="10255" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213240 2578 flags.go:64] FLAG: --register-node="true" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213243 2578 flags.go:64] FLAG: --register-with-taints="" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213246 2578 flags.go:64] FLAG: --registry-burst="10" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213249 2578 flags.go:64] FLAG: --registry-qps="5" Sep 11 06:18:33.219496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213252 2578 flags.go:64] FLAG: --reserved-cpus="" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213255 2578 flags.go:64] FLAG: --reserved-memory="" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213258 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213261 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213264 2578 flags.go:64] FLAG: --rotate-certificates="false" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213267 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213269 2578 flags.go:64] FLAG: --runonce="false" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213272 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213275 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213278 2578 flags.go:64] FLAG: --seccomp-default="false" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213281 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213283 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213286 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213289 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213292 2578 flags.go:64] FLAG: --storage-driver-password="root" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213295 2578 flags.go:64] FLAG: --storage-driver-secure="false" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213297 2578 flags.go:64] FLAG: --storage-driver-table="stats" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213300 2578 flags.go:64] FLAG: --storage-driver-user="root" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213303 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213305 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213310 2578 flags.go:64] FLAG: --system-cgroups="" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213312 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213318 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213322 2578 flags.go:64] FLAG: --tls-cert-file="" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213325 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 11 06:18:33.220096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213329 2578 flags.go:64] FLAG: --tls-min-version="" Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213331 2578 flags.go:64] FLAG: --tls-private-key-file="" Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213334 2578 flags.go:64] FLAG: --topology-manager-policy="none" Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213337 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213339 2578 flags.go:64] FLAG: --topology-manager-scope="container" Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213342 2578 flags.go:64] FLAG: --v="2" Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213346 2578 flags.go:64] FLAG: --version="false" Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213350 2578 flags.go:64] FLAG: --vmodule="" Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213353 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.213357 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213469 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213473 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213475 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213478 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213481 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213483 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213488 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213491 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213494 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213497 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213500 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213503 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 06:18:33.220752 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213505 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213508 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213510 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213513 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213516 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213519 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213522 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213525 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213529 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213532 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213535 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213539 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213542 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213545 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213547 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213550 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213552 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213555 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213557 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 06:18:33.221279 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213560 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213562 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213578 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213581 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213583 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213586 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213588 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213592 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213594 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213597 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213600 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213604 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213606 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213609 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213611 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213614 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213617 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213620 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213624 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213627 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 06:18:33.221761 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213630 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213633 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213636 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213639 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213641 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213644 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213647 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213649 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213652 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213655 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213657 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213660 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213662 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213664 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213667 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213670 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213672 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213675 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213677 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213680 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 06:18:33.222244 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213682 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213685 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213687 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213690 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213692 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213695 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213697 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213699 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213702 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213705 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213708 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213711 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213713 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213716 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213719 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213722 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213724 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213727 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213729 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213732 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 06:18:33.222746 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213734 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 06:18:33.223248 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213737 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 06:18:33.223248 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213740 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 06:18:33.223248 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213742 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 06:18:33.223248 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213746 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 06:18:33.223248 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213749 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 06:18:33.223248 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213752 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 06:18:33.223248 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.213755 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 06:18:33.223248 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.214397 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 06:18:33.223248 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.221852 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 11 06:18:33.223248 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.221969 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 11 06:18:33.223248 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.222876 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 11 06:18:33.223248 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.222884 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 11 06:18:33.223248 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.222947 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 06:18:33.223248 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.222953 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.222957 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.222961 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.222965 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.222968 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.222972 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.222975 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.222978 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.222981 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.222984 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.222988 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.222990 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.222993 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.222996 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.222999 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223001 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223004 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223006 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223009 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 06:18:33.223612 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223011 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223014 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223017 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223019 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223021 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223024 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223027 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223029 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223032 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223036 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223038 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223041 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223044 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223046 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223049 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223051 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223053 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223056 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223059 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 06:18:33.224116 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223061 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223064 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223066 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223069 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223071 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223075 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223078 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223081 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223084 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223086 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223088 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223091 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223094 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223096 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223098 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223101 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223103 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223106 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223109 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223111 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 06:18:33.224587 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223114 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223117 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223120 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223123 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223126 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223129 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223131 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223133 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223136 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223138 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223141 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223143 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223146 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223148 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223151 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223154 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223156 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223159 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223161 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223164 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 06:18:33.225072 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223166 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223169 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223171 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223174 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223176 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223179 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223181 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223183 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223186 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223189 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223191 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223194 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223196 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223199 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223202 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223206 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223210 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223213 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223216 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 06:18:33.225554 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223219 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 06:18:33.226034 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.223224 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 06:18:33.226034 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223342 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 06:18:33.226034 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223347 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 06:18:33.226034 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223350 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 06:18:33.226034 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223354 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 06:18:33.226034 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223356 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 06:18:33.226034 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223359 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 06:18:33.226034 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223361 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 06:18:33.226034 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223364 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 06:18:33.226034 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223366 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 06:18:33.226034 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223369 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 06:18:33.226034 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223371 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 06:18:33.226034 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223374 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 06:18:33.226034 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223376 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 06:18:33.226034 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223378 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223381 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223384 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223386 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223389 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223391 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223394 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223397 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223401 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223403 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223406 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223409 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223412 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223415 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223417 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223420 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223422 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223425 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223427 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 06:18:33.226403 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223430 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223432 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223435 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223437 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223440 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223442 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223444 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223447 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223449 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223451 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223455 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223459 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223461 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223464 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223467 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223470 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223472 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223475 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223477 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223480 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 06:18:33.226871 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223482 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223484 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223487 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223489 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223493 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223495 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223497 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223500 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223503 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223506 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223508 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223511 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223513 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223515 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223518 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223520 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223522 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223525 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223527 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223529 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 06:18:33.227366 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223532 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223534 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223537 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223539 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223543 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223546 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223549 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223552 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223555 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223557 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223560 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223562 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223580 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223583 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223585 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223588 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223590 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223593 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223595 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 06:18:33.227861 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223598 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 06:18:33.228301 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223601 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 06:18:33.228301 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223604 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 06:18:33.228301 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223607 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 06:18:33.228301 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223609 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 06:18:33.228301 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223612 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 06:18:33.228301 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223614 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 06:18:33.228301 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:33.223617 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 06:18:33.228301 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.223622 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 06:18:33.228301 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.223715 2578 server.go:962] "Client rotation is on, will bootstrap in background" Sep 11 06:18:33.228301 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.227046 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 11 06:18:33.228301 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.228170 2578 server.go:1019] "Starting client certificate rotation" Sep 11 06:18:33.228301 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.228267 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 06:18:33.228301 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.228298 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 06:18:33.230923 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.230910 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 06:18:33.235397 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.235365 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 06:18:33.243461 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.243440 2578 log.go:25] "Validated CRI v1 runtime API" Sep 11 06:18:33.249011 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.248994 2578 log.go:25] "Validated CRI v1 image API" Sep 11 06:18:33.249861 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.249825 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 11 06:18:33.253861 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.253834 2578 fs.go:135] Filesystem UUIDs: map[188cc930-c020-45f0-996f-82cf6d4b9a91:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cfa9a12d-ac89-4c46-b756-9e94b23b0ce4:/dev/nvme0n1p4] Sep 11 06:18:33.253934 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.253860 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 11 06:18:33.258904 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.258772 2578 manager.go:216] Machine: {Timestamp:2026-09-11 06:18:33.257335079 +0000 UTC m=+0.369463316 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104203 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b5045a9ef1708cc8bb7576ed7c14a SystemUUID:ec2b5045-a9ef-1708-cc8b-b7576ed7c14a BootID:fc57b07d-1550-46cc-b932-f334a524df0f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:32:b9:0f:4e:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:32:b9:0f:4e:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:b8:4c:8f:e1:43 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 11 06:18:33.258904 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.258894 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 11 06:18:33.259034 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.259001 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 11 06:18:33.260303 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.260286 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 06:18:33.262496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.262474 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 11 06:18:33.262690 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.262503 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-168.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 11 06:18:33.264163 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.264150 2578 topology_manager.go:138] "Creating topology manager with none policy" Sep 11 06:18:33.264225 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.264168 2578 container_manager_linux.go:309] "Creating device plugin manager" Sep 11 06:18:33.264225 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.264179 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 06:18:33.265079 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.265067 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 06:18:33.266324 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.266313 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 11 06:18:33.271019 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.271005 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 11 06:18:33.271284 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.271272 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 11 06:18:33.271344 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.271310 2578 kubelet.go:486] "Attempting to sync node with API server" Sep 11 06:18:33.271344 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.271324 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 11 06:18:33.271344 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.271344 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 11 06:18:33.271517 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.271356 2578 kubelet.go:398] "Adding apiserver pod source" Sep 11 06:18:33.271517 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.271370 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 11 06:18:33.271785 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.271772 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 06:18:33.271844 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.271797 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 06:18:33.274187 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.274173 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 11 06:18:33.277023 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.277007 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 11 06:18:33.277099 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.277045 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 11 06:18:33.279843 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.279829 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 11 06:18:33.279921 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.279853 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 11 06:18:33.279921 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.279863 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 11 06:18:33.279921 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.279871 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 11 06:18:33.279921 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.279885 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 11 06:18:33.279921 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.279894 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 11 06:18:33.279921 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.279914 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 11 06:18:33.279921 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.279922 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 11 06:18:33.280141 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.279935 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 11 06:18:33.280141 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.279944 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 11 06:18:33.280141 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.279969 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 11 06:18:33.280141 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.279977 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 11 06:18:33.280901 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.280889 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 11 06:18:33.280970 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.280904 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 11 06:18:33.282244 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.282225 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 11 06:18:33.282346 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.282274 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 11 06:18:33.286231 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.286210 2578 server.go:1268] "Started kubelet" Sep 11 06:18:33.286344 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.286304 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 11 06:18:33.290423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.290360 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 11 06:18:33.290661 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.290630 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 11 06:18:33.291247 ip-10-0-135-168 systemd[1]: Started Kubernetes Kubelet. Sep 11 06:18:33.292424 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.292404 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 11 06:18:33.294049 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.293440 2578 server.go:310] "Adding debug handlers to kubelet server" Sep 11 06:18:33.295179 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.295156 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 11 06:18:33.295784 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.295766 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-168.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 11 06:18:33.296987 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.295823 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-168.ec2.internal.18d42fcde267b9d3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-168.ec2.internal,UID:ip-10-0-135-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-168.ec2.internal,},FirstTimestamp:2026-09-11 06:18:33.286179283 +0000 UTC m=+0.398307519,LastTimestamp:2026-09-11 06:18:33.286179283 +0000 UTC m=+0.398307519,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-168.ec2.internal,}" Sep 11 06:18:33.300322 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.300307 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 11 06:18:33.301004 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.300988 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 11 06:18:33.301111 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.301091 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-168.ec2.internal\" not found" Sep 11 06:18:33.301807 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.301786 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 11 06:18:33.301807 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.301797 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 11 06:18:33.301807 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.301808 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 11 06:18:33.301980 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.301870 2578 reconstruct.go:97] "Volume reconstruction finished" Sep 11 06:18:33.301980 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.301880 2578 reconciler.go:29] "Reconciler: start to sync state" Sep 11 06:18:33.302609 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.302588 2578 factory.go:55] Registering systemd factory Sep 11 06:18:33.302659 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.302613 2578 factory.go:223] Registration of the systemd container factory successfully Sep 11 06:18:33.302739 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.302717 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 11 06:18:33.302801 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.302735 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 11 06:18:33.302845 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.302816 2578 factory.go:153] Registering CRI-O factory Sep 11 06:18:33.302845 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.302826 2578 factory.go:223] Registration of the crio container factory successfully Sep 11 06:18:33.302912 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.302873 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 11 06:18:33.302912 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.302887 2578 factory.go:103] Registering Raw factory Sep 11 06:18:33.302912 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.302897 2578 manager.go:1196] Started watching for new ooms in manager Sep 11 06:18:33.303218 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.303202 2578 manager.go:349] Starting recovery of all containers Sep 11 06:18:33.305212 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.305107 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q7lvj" Sep 11 06:18:33.312586 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.312545 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q7lvj" Sep 11 06:18:33.313185 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.313167 2578 manager.go:354] Recovery completed Sep 11 06:18:33.314895 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.314874 2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 11 06:18:33.318070 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.318059 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 06:18:33.319987 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.319973 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasSufficientMemory" Sep 11 06:18:33.320041 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.320025 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 06:18:33.320041 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.320038 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasSufficientPID" Sep 11 06:18:33.320715 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.320689 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 11 06:18:33.320715 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.320698 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 06:18:33.320715 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.320703 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 11 06:18:33.320715 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.320717 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 11 06:18:33.321359 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.321344 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasSufficientMemory" Sep 11 06:18:33.321415 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.321374 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 06:18:33.321415 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.321388 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasSufficientPID" Sep 11 06:18:33.322775 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.322763 2578 policy_none.go:49] "None policy: Start" Sep 11 06:18:33.322817 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.322781 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 11 06:18:33.322817 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.322791 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 11 06:18:33.324836 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.324818 2578 policy_none.go:47] "Start" Sep 11 06:18:33.375631 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.359156 2578 manager.go:337] "Starting Device Plugin manager" Sep 11 06:18:33.375631 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.359193 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 11 06:18:33.375631 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.359203 2578 server.go:87] "Starting device plugin registration server" Sep 11 06:18:33.375631 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.359411 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 11 06:18:33.375631 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.359424 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 11 06:18:33.375631 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.359541 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 11 06:18:33.375631 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.359655 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 11 06:18:33.375631 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.359668 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 11 06:18:33.375631 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.360073 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 11 06:18:33.375631 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.360110 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-168.ec2.internal\" not found" Sep 11 06:18:33.391410 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.391389 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 11 06:18:33.392691 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.392674 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 11 06:18:33.392761 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.392718 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 11 06:18:33.392761 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.392737 2578 kubelet.go:2448] "Starting kubelet main sync loop" Sep 11 06:18:33.392851 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.392774 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 11 06:18:33.394982 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.394962 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 06:18:33.460078 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.460009 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 06:18:33.460778 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.460761 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasSufficientMemory" Sep 11 06:18:33.460845 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.460793 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 06:18:33.460845 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.460803 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasSufficientPID" Sep 11 06:18:33.460845 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.460826 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.470476 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.470461 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.470544 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.470480 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-168.ec2.internal\": node \"ip-10-0-135-168.ec2.internal\" not found" Sep 11 06:18:33.493259 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.493231 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-168.ec2.internal"] Sep 11 06:18:33.493347 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.493335 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 06:18:33.493347 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.493340 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-168.ec2.internal\" not found" Sep 11 06:18:33.494693 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.494679 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasSufficientMemory" Sep 11 06:18:33.494769 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.494709 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 06:18:33.494769 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.494724 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasSufficientPID" Sep 11 06:18:33.497060 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.497046 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 06:18:33.497182 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.497169 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.497229 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.497195 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 06:18:33.497786 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.497767 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasSufficientMemory" Sep 11 06:18:33.497880 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.497786 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasSufficientMemory" Sep 11 06:18:33.497880 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.497798 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 06:18:33.497880 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.497810 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 06:18:33.497880 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.497811 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasSufficientPID" Sep 11 06:18:33.497880 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.497823 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasSufficientPID" Sep 11 06:18:33.500101 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.500088 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.500146 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.500115 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 06:18:33.500768 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.500752 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasSufficientMemory" Sep 11 06:18:33.500837 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.500775 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 06:18:33.500837 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.500785 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeHasSufficientPID" Sep 11 06:18:33.502959 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.502934 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7302cb3052b6ea5146139460ab2402c8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal\" (UID: \"7302cb3052b6ea5146139460ab2402c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.502959 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.502967 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7302cb3052b6ea5146139460ab2402c8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal\" (UID: \"7302cb3052b6ea5146139460ab2402c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.503104 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.502983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa6ea2416a19c5884a3df0b3ea9c984b-config\") pod \"kube-apiserver-proxy-ip-10-0-135-168.ec2.internal\" (UID: \"fa6ea2416a19c5884a3df0b3ea9c984b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.523075 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.523052 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-168.ec2.internal\" not found" node="ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.527292 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.527278 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-168.ec2.internal\" not found" node="ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.594049 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.594029 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-168.ec2.internal\" not found" Sep 11 06:18:33.603318 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.603300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7302cb3052b6ea5146139460ab2402c8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal\" (UID: \"7302cb3052b6ea5146139460ab2402c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.603378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.603322 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7302cb3052b6ea5146139460ab2402c8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal\" (UID: \"7302cb3052b6ea5146139460ab2402c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.603378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.603343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa6ea2416a19c5884a3df0b3ea9c984b-config\") pod \"kube-apiserver-proxy-ip-10-0-135-168.ec2.internal\" (UID: \"fa6ea2416a19c5884a3df0b3ea9c984b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.603475 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.603393 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa6ea2416a19c5884a3df0b3ea9c984b-config\") pod \"kube-apiserver-proxy-ip-10-0-135-168.ec2.internal\" (UID: \"fa6ea2416a19c5884a3df0b3ea9c984b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.603475 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.603405 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7302cb3052b6ea5146139460ab2402c8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal\" (UID: \"7302cb3052b6ea5146139460ab2402c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.603475 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.603430 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7302cb3052b6ea5146139460ab2402c8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal\" (UID: \"7302cb3052b6ea5146139460ab2402c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.694480 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.694453 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-168.ec2.internal\" not found" Sep 11 06:18:33.795255 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.795178 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-168.ec2.internal\" not found" Sep 11 06:18:33.825723 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.825701 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.830742 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:33.830608 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-168.ec2.internal" Sep 11 06:18:33.895488 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.895446 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-168.ec2.internal\" not found" Sep 11 06:18:33.996017 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:33.995991 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-168.ec2.internal\" not found" Sep 11 06:18:34.096599 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:34.096502 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-168.ec2.internal\" not found" Sep 11 06:18:34.197108 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:34.197075 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-168.ec2.internal\" not found" Sep 11 06:18:34.199328 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:34.199311 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 06:18:34.228283 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:34.228261 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 11 06:18:34.228655 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:34.228376 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 06:18:34.228655 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:34.228410 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 06:18:34.297158 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:34.297132 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-168.ec2.internal\" not found" Sep 11 06:18:34.319171 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:34.319011 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 06:13:33 +0000 UTC" deadline="2028-05-26 09:28:47.42156603 +0000 UTC" Sep 11 06:18:34.319171 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:34.319166 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14955h10m13.102403207s" Sep 11 06:18:34.398232 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:34.398207 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-168.ec2.internal\" not found" Sep 11 06:18:34.399096 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:34.399068 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7302cb3052b6ea5146139460ab2402c8.slice/crio-fafb1ebd7fe936062938d4c35d1b084faa26db2cc7a3dcb39752520a4cf4012a WatchSource:0}: Error finding container fafb1ebd7fe936062938d4c35d1b084faa26db2cc7a3dcb39752520a4cf4012a: Status 404 returned error can't find the container with id fafb1ebd7fe936062938d4c35d1b084faa26db2cc7a3dcb39752520a4cf4012a Sep 11 06:18:34.399605 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:34.399585 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6ea2416a19c5884a3df0b3ea9c984b.slice/crio-87ebae0a6f35c2c8682df2f1bfc30329f2f38bfe94bd2890176c925fcdbd9127 WatchSource:0}: Error finding container 87ebae0a6f35c2c8682df2f1bfc30329f2f38bfe94bd2890176c925fcdbd9127: Status 404 returned error can't find the container with id 87ebae0a6f35c2c8682df2f1bfc30329f2f38bfe94bd2890176c925fcdbd9127 Sep 11 06:18:34.404927 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:34.404909 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 06:18:34.498870 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:34.498835 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-168.ec2.internal\" not found" Sep 11 06:18:34.532325 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:34.532305 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 06:18:34.601644 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:34.601618 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-168.ec2.internal" Sep 11 06:18:34.611135 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:34.611111 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 06:18:34.613145 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:34.613126 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal" Sep 11 06:18:34.623898 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:34.623878 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 06:18:34.747654 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:34.747587 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 06:18:35.272302 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.272224 2578 apiserver.go:52] "Watching apiserver" Sep 11 06:18:35.280127 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.280104 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 11 06:18:35.281541 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.281514 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-7wkvx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg","openshift-image-registry/node-ca-s5kw4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal","openshift-multus/multus-mm84v","openshift-multus/network-metrics-daemon-7mpnr","openshift-network-diagnostics/network-check-target-p8qtr","kube-system/kube-apiserver-proxy-ip-10-0-135-168.ec2.internal","openshift-cluster-node-tuning-operator/tuned-ftc27","openshift-dns/node-resolver-lzqnp","openshift-multus/multus-additional-cni-plugins-zw5v6","openshift-network-operator/iptables-alerter-7lw7b","openshift-ovn-kubernetes/ovnkube-node-gkzwh","kube-system/global-pull-secret-syncer-db87s"] Sep 11 06:18:35.284182 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.284158 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:35.284278 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.284253 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:18:35.286386 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.286366 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7lw7b" Sep 11 06:18:35.289013 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.288666 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s5kw4" Sep 11 06:18:35.289013 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.288721 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 11 06:18:35.289013 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.288779 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 11 06:18:35.289013 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.288809 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 11 06:18:35.289013 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.288868 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7tx49\"" Sep 11 06:18:35.290810 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.290792 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 11 06:18:35.290985 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.290957 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7wkvx" Sep 11 06:18:35.291101 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.291019 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 11 06:18:35.291168 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.291122 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-whvfm\"" Sep 11 06:18:35.291250 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.291230 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 11 06:18:35.293357 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.293311 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.294419 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.294172 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vcc6g\"" Sep 11 06:18:35.294540 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.294521 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 11 06:18:35.294797 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.294782 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 11 06:18:35.295560 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.295547 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 11 06:18:35.295680 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.295659 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ltzgj\"" Sep 11 06:18:35.295760 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.295743 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:35.295841 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.295819 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:18:35.296506 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.296489 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 06:18:35.296552 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.296508 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 11 06:18:35.298111 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.298095 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.300467 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.300446 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 11 06:18:35.300467 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.300465 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lzqnp" Sep 11 06:18:35.301329 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.301217 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 11 06:18:35.301329 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.301253 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 11 06:18:35.301329 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.301288 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2684d\"" Sep 11 06:18:35.301513 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.301488 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 11 06:18:35.301711 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.301694 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 11 06:18:35.304494 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.304471 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.305202 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.305183 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 11 06:18:35.305497 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.305479 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 11 06:18:35.305602 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.305581 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9zjfl\"" Sep 11 06:18:35.307068 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.307046 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 11 06:18:35.307068 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.307270 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.307834 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.307811 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l87cd\"" Sep 11 06:18:35.308151 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.308132 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 11 06:18:35.309877 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.309857 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 11 06:18:35.310255 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.310214 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 11 06:18:35.310419 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.310397 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 11 06:18:35.310729 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.310710 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ccmpr\"" Sep 11 06:18:35.311054 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.311034 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.311886 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.311863 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs\") pod \"network-metrics-daemon-7mpnr\" (UID: \"b5bab53c-ef28-4f24-a84e-640462c08884\") " pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:35.311989 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.311900 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9202f543-8508-4616-9b49-9c3063006a76-iptables-alerter-script\") pod \"iptables-alerter-7lw7b\" (UID: \"9202f543-8508-4616-9b49-9c3063006a76\") " pod="openshift-network-operator/iptables-alerter-7lw7b" Sep 11 06:18:35.311989 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.311928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-var-lib-cni-bin\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.311989 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.311954 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.311989 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.311979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpcvg\" (UniqueName: \"kubernetes.io/projected/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-kube-api-access-gpcvg\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.312210 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312010 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9xdv\" (UniqueName: \"kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv\") pod \"network-check-target-p8qtr\" (UID: \"45161465-23cb-40f9-b682-809e7aeef6ac\") " pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:35.312210 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312036 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-sysctl-conf\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.312210 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312060 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c749j\" (UniqueName: \"kubernetes.io/projected/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-kube-api-access-c749j\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.312210 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312088 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrrsn\" (UniqueName: \"kubernetes.io/projected/a2f7b95d-3f2a-4c11-a467-c3d3e6badf84-kube-api-access-hrrsn\") pod \"node-resolver-lzqnp\" (UID: \"a2f7b95d-3f2a-4c11-a467-c3d3e6badf84\") " pod="openshift-dns/node-resolver-lzqnp" Sep 11 06:18:35.312210 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312134 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-lib-modules\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.312210 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312189 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-system-cni-dir\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.312546 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-cnibin\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.312546 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312244 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-sysctl-d\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.312546 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312269 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-systemd\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.312546 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312293 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-var-lib-kubelet\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.312546 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02292fc4-88eb-48f2-859d-31af30865593-tmp\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.312546 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-hostroot\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.312546 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312469 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-multus-conf-dir\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.312546 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-multus-daemon-config\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.312546 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.312546 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f03ec2fa-ca46-4d35-aa87-bad491b6fa58-host\") pod \"node-ca-s5kw4\" (UID: \"f03ec2fa-ca46-4d35-aa87-bad491b6fa58\") " pod="openshift-image-registry/node-ca-s5kw4" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312554 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f03ec2fa-ca46-4d35-aa87-bad491b6fa58-serviceca\") pod \"node-ca-s5kw4\" (UID: \"f03ec2fa-ca46-4d35-aa87-bad491b6fa58\") " pod="openshift-image-registry/node-ca-s5kw4" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a2f7b95d-3f2a-4c11-a467-c3d3e6badf84-hosts-file\") pod \"node-resolver-lzqnp\" (UID: \"a2f7b95d-3f2a-4c11-a467-c3d3e6badf84\") " pod="openshift-dns/node-resolver-lzqnp" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9202f543-8508-4616-9b49-9c3063006a76-host-slash\") pod \"iptables-alerter-7lw7b\" (UID: \"9202f543-8508-4616-9b49-9c3063006a76\") " pod="openshift-network-operator/iptables-alerter-7lw7b" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-run\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-multus-cni-dir\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312800 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-multus-socket-dir-parent\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59a3c67d-d236-44e3-ba64-5253f5ca2087-agent-certs\") pod \"konnectivity-agent-7wkvx\" (UID: \"59a3c67d-d236-44e3-ba64-5253f5ca2087\") " pod="kube-system/konnectivity-agent-7wkvx" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312880 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsvvg\" (UniqueName: \"kubernetes.io/projected/b5bab53c-ef28-4f24-a84e-640462c08884-kube-api-access-lsvvg\") pod \"network-metrics-daemon-7mpnr\" (UID: \"b5bab53c-ef28-4f24-a84e-640462c08884\") " pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdjll\" (UniqueName: \"kubernetes.io/projected/9202f543-8508-4616-9b49-9c3063006a76-kube-api-access-vdjll\") pod \"iptables-alerter-7lw7b\" (UID: \"9202f543-8508-4616-9b49-9c3063006a76\") " pod="openshift-network-operator/iptables-alerter-7lw7b" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-host\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/02292fc4-88eb-48f2-859d-31af30865593-etc-tuned\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-system-cni-dir\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.312969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-cni-binary-copy\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313000 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-run-k8s-cni-cncf-io\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2f7b95d-3f2a-4c11-a467-c3d3e6badf84-tmp-dir\") pod \"node-resolver-lzqnp\" (UID: \"a2f7b95d-3f2a-4c11-a467-c3d3e6badf84\") " pod="openshift-dns/node-resolver-lzqnp" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313044 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-sysconfig\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.313063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313060 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-kubernetes\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-sys\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-var-lib-cni-multus\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313115 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-run-multus-certs\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313143 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-cni-binary-copy\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313165 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313182 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srnfh\" (UniqueName: \"kubernetes.io/projected/f03ec2fa-ca46-4d35-aa87-bad491b6fa58-kube-api-access-srnfh\") pod \"node-ca-s5kw4\" (UID: \"f03ec2fa-ca46-4d35-aa87-bad491b6fa58\") " pod="openshift-image-registry/node-ca-s5kw4" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59a3c67d-d236-44e3-ba64-5253f5ca2087-konnectivity-ca\") pod \"konnectivity-agent-7wkvx\" (UID: \"59a3c67d-d236-44e3-ba64-5253f5ca2087\") " pod="kube-system/konnectivity-agent-7wkvx" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313221 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-modprobe-d\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313223 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313235 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltv8p\" (UniqueName: \"kubernetes.io/projected/02292fc4-88eb-48f2-859d-31af30865593-kube-api-access-ltv8p\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313250 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-cnibin\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313278 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-run-netns\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-var-lib-kubelet\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-etc-kubernetes\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313622 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.313673 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:18:35.313968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313775 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 11 06:18:35.314846 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.313999 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 11 06:18:35.314846 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.314018 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wqpxr\"" Sep 11 06:18:35.314846 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.314104 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 11 06:18:35.314846 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.314751 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 11 06:18:35.314846 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.314816 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 06:18:35.314846 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.314755 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 11 06:18:35.336863 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.336834 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-trm2v" Sep 11 06:18:35.347953 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.347932 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-trm2v" Sep 11 06:18:35.397586 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.397531 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-168.ec2.internal" event={"ID":"fa6ea2416a19c5884a3df0b3ea9c984b","Type":"ContainerStarted","Data":"87ebae0a6f35c2c8682df2f1bfc30329f2f38bfe94bd2890176c925fcdbd9127"} Sep 11 06:18:35.398741 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.398717 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal" event={"ID":"7302cb3052b6ea5146139460ab2402c8","Type":"ContainerStarted","Data":"fafb1ebd7fe936062938d4c35d1b084faa26db2cc7a3dcb39752520a4cf4012a"} Sep 11 06:18:35.402844 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.402830 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 11 06:18:35.413695 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.413664 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-var-lib-kubelet\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.413803 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.413775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-device-dir\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.413857 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.413808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-run-openvswitch\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.413857 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.413827 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-var-lib-kubelet\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.414037 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.413828 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m85sw\" (UniqueName: \"kubernetes.io/projected/39545d0c-44ed-4a03-a545-f0e61abb52d0-kube-api-access-m85sw\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.414354 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs\") pod \"network-metrics-daemon-7mpnr\" (UID: \"b5bab53c-ef28-4f24-a84e-640462c08884\") " pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.414407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-var-lib-cni-bin\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.414483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9xdv\" (UniqueName: \"kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv\") pod \"network-check-target-p8qtr\" (UID: \"45161465-23cb-40f9-b682-809e7aeef6ac\") " pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.414541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-sysctl-conf\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.414491 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-var-lib-cni-bin\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.414571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c749j\" (UniqueName: \"kubernetes.io/projected/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-kube-api-access-c749j\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.414596 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.414618 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-cnibin\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.414653 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-sysctl-d\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.414770 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs podName:b5bab53c-ef28-4f24-a84e-640462c08884 nodeName:}" failed. No retries permitted until 2026-09-11 06:18:35.914681014 +0000 UTC m=+3.026809257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs") pod "network-metrics-daemon-7mpnr" (UID: "b5bab53c-ef28-4f24-a84e-640462c08884") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.414800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-systemd\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.414844 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-sysctl-d\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.414990 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-systemd\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415155 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-sysctl-conf\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415249 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-cnibin\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.414845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-multus-daemon-config\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.417816 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-run-netns\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415388 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-system-cni-dir\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415422 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-kubelet-config\") pod \"global-pull-secret-syncer-db87s\" (UID: \"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6\") " pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415454 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f03ec2fa-ca46-4d35-aa87-bad491b6fa58-serviceca\") pod \"node-ca-s5kw4\" (UID: \"f03ec2fa-ca46-4d35-aa87-bad491b6fa58\") " pod="openshift-image-registry/node-ca-s5kw4" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415485 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9202f543-8508-4616-9b49-9c3063006a76-host-slash\") pod \"iptables-alerter-7lw7b\" (UID: \"9202f543-8508-4616-9b49-9c3063006a76\") " pod="openshift-network-operator/iptables-alerter-7lw7b" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-multus-cni-dir\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415504 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-multus-daemon-config\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415544 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-multus-socket-dir-parent\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415564 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-system-cni-dir\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415602 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-var-lib-cni-multus\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415697 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-multus-socket-dir-parent\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415751 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59a3c67d-d236-44e3-ba64-5253f5ca2087-agent-certs\") pod \"konnectivity-agent-7wkvx\" (UID: \"59a3c67d-d236-44e3-ba64-5253f5ca2087\") " pod="kube-system/konnectivity-agent-7wkvx" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvvg\" (UniqueName: \"kubernetes.io/projected/b5bab53c-ef28-4f24-a84e-640462c08884-kube-api-access-lsvvg\") pod \"network-metrics-daemon-7mpnr\" (UID: \"b5bab53c-ef28-4f24-a84e-640462c08884\") " pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415861 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-host\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/02292fc4-88eb-48f2-859d-31af30865593-etc-tuned\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.418717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-cni-binary-copy\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-etc-openvswitch\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.415995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-slash\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416034 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-log-socket\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416230 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f03ec2fa-ca46-4d35-aa87-bad491b6fa58-serviceca\") pod \"node-ca-s5kw4\" (UID: \"f03ec2fa-ca46-4d35-aa87-bad491b6fa58\") " pod="openshift-image-registry/node-ca-s5kw4" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416325 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416326 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9202f543-8508-4616-9b49-9c3063006a76-host-slash\") pod \"iptables-alerter-7lw7b\" (UID: \"9202f543-8508-4616-9b49-9c3063006a76\") " pod="openshift-network-operator/iptables-alerter-7lw7b" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416419 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-run-netns\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416472 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-multus-cni-dir\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416494 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-host\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416576 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-modprobe-d\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416695 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltv8p\" (UniqueName: \"kubernetes.io/projected/02292fc4-88eb-48f2-859d-31af30865593-kube-api-access-ltv8p\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-etc-kubernetes\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39545d0c-44ed-4a03-a545-f0e61abb52d0-ovn-node-metrics-cert\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416839 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-var-lib-cni-multus\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416862 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9202f543-8508-4616-9b49-9c3063006a76-iptables-alerter-script\") pod \"iptables-alerter-7lw7b\" (UID: \"9202f543-8508-4616-9b49-9c3063006a76\") " pod="openshift-network-operator/iptables-alerter-7lw7b" Sep 11 06:18:35.419390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416954 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret\") pod \"global-pull-secret-syncer-db87s\" (UID: \"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6\") " pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416960 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-etc-kubernetes\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416998 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.416919 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-modprobe-d\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.417034 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-run-ovn\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.417202 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.417570 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.417605 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-cni-binary-copy\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.417669 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9202f543-8508-4616-9b49-9c3063006a76-iptables-alerter-script\") pod \"iptables-alerter-7lw7b\" (UID: \"9202f543-8508-4616-9b49-9c3063006a76\") " pod="openshift-network-operator/iptables-alerter-7lw7b" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.417686 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-cni-bin\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.417750 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-socket-dir\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.417864 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.417944 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-etc-selinux\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.417979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-systemd-units\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.417996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-cni-netd\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418081 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrrsn\" (UniqueName: \"kubernetes.io/projected/a2f7b95d-3f2a-4c11-a467-c3d3e6badf84-kube-api-access-hrrsn\") pod \"node-resolver-lzqnp\" (UID: \"a2f7b95d-3f2a-4c11-a467-c3d3e6badf84\") " pod="openshift-dns/node-resolver-lzqnp" Sep 11 06:18:35.420087 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-lib-modules\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-registration-dir\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418198 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-sys-fs\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418381 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-run-netns\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418450 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-lib-modules\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-var-lib-kubelet\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418533 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02292fc4-88eb-48f2-859d-31af30865593-tmp\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418556 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-var-lib-kubelet\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-hostroot\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418600 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-multus-conf-dir\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418643 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-hostroot\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418638 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-run-systemd\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418704 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-multus-conf-dir\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418719 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39545d0c-44ed-4a03-a545-f0e61abb52d0-ovnkube-config\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418850 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-dbus\") pod \"global-pull-secret-syncer-db87s\" (UID: \"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6\") " pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418903 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f03ec2fa-ca46-4d35-aa87-bad491b6fa58-host\") pod \"node-ca-s5kw4\" (UID: \"f03ec2fa-ca46-4d35-aa87-bad491b6fa58\") " pod="openshift-image-registry/node-ca-s5kw4" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a2f7b95d-3f2a-4c11-a467-c3d3e6badf84-hosts-file\") pod \"node-resolver-lzqnp\" (UID: \"a2f7b95d-3f2a-4c11-a467-c3d3e6badf84\") " pod="openshift-dns/node-resolver-lzqnp" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418966 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f03ec2fa-ca46-4d35-aa87-bad491b6fa58-host\") pod \"node-ca-s5kw4\" (UID: \"f03ec2fa-ca46-4d35-aa87-bad491b6fa58\") " pod="openshift-image-registry/node-ca-s5kw4" Sep 11 06:18:35.420812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.418972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-run\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.419017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-node-log\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.419037 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a2f7b95d-3f2a-4c11-a467-c3d3e6badf84-hosts-file\") pod \"node-resolver-lzqnp\" (UID: \"a2f7b95d-3f2a-4c11-a467-c3d3e6badf84\") " pod="openshift-dns/node-resolver-lzqnp" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.419056 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.419102 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39545d0c-44ed-4a03-a545-f0e61abb52d0-env-overrides\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.419135 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39545d0c-44ed-4a03-a545-f0e61abb52d0-ovnkube-script-lib\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.419154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpcvg\" (UniqueName: \"kubernetes.io/projected/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-kube-api-access-gpcvg\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.419197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdjll\" (UniqueName: \"kubernetes.io/projected/9202f543-8508-4616-9b49-9c3063006a76-kube-api-access-vdjll\") pod \"iptables-alerter-7lw7b\" (UID: \"9202f543-8508-4616-9b49-9c3063006a76\") " pod="openshift-network-operator/iptables-alerter-7lw7b" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.419120 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-run\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.419257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-system-cni-dir\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.419290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-run-k8s-cni-cncf-io\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.419320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sd58\" (UniqueName: \"kubernetes.io/projected/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-kube-api-access-7sd58\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.419324 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-system-cni-dir\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.419367 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-kubelet\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.419381 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-run-k8s-cni-cncf-io\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.420431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2f7b95d-3f2a-4c11-a467-c3d3e6badf84-tmp-dir\") pod \"node-resolver-lzqnp\" (UID: \"a2f7b95d-3f2a-4c11-a467-c3d3e6badf84\") " pod="openshift-dns/node-resolver-lzqnp" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.420470 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-sysconfig\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.421782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.420498 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-kubernetes\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.420525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-sys\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.420553 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-run-multus-certs\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.420581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-cni-binary-copy\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.420608 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-var-lib-openvswitch\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.420637 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srnfh\" (UniqueName: \"kubernetes.io/projected/f03ec2fa-ca46-4d35-aa87-bad491b6fa58-kube-api-access-srnfh\") pod \"node-ca-s5kw4\" (UID: \"f03ec2fa-ca46-4d35-aa87-bad491b6fa58\") " pod="openshift-image-registry/node-ca-s5kw4" Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.420639 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-sys\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.420680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59a3c67d-d236-44e3-ba64-5253f5ca2087-konnectivity-ca\") pod \"konnectivity-agent-7wkvx\" (UID: \"59a3c67d-d236-44e3-ba64-5253f5ca2087\") " pod="kube-system/konnectivity-agent-7wkvx" Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.420706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-cnibin\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.420715 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-kubernetes\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.420823 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-cnibin\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.420850 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2f7b95d-3f2a-4c11-a467-c3d3e6badf84-tmp-dir\") pod \"node-resolver-lzqnp\" (UID: \"a2f7b95d-3f2a-4c11-a467-c3d3e6badf84\") " pod="openshift-dns/node-resolver-lzqnp" Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.420884 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-host-run-multus-certs\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.421366 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/59a3c67d-d236-44e3-ba64-5253f5ca2087-konnectivity-ca\") pod \"konnectivity-agent-7wkvx\" (UID: \"59a3c67d-d236-44e3-ba64-5253f5ca2087\") " pod="kube-system/konnectivity-agent-7wkvx" Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.421438 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-cni-binary-copy\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.421495 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/02292fc4-88eb-48f2-859d-31af30865593-etc-sysconfig\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.421799 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.421820 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.421835 2578 projected.go:196] Error preparing data for projected volume kube-api-access-h9xdv for pod openshift-network-diagnostics/network-check-target-p8qtr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 06:18:35.422423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.421836 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/02292fc4-88eb-48f2-859d-31af30865593-etc-tuned\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.423043 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.421887 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv podName:45161465-23cb-40f9-b682-809e7aeef6ac nodeName:}" failed. No retries permitted until 2026-09-11 06:18:35.921873862 +0000 UTC m=+3.034002091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h9xdv" (UniqueName: "kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv") pod "network-check-target-p8qtr" (UID: "45161465-23cb-40f9-b682-809e7aeef6ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 06:18:35.423043 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.422086 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/59a3c67d-d236-44e3-ba64-5253f5ca2087-agent-certs\") pod \"konnectivity-agent-7wkvx\" (UID: \"59a3c67d-d236-44e3-ba64-5253f5ca2087\") " pod="kube-system/konnectivity-agent-7wkvx" Sep 11 06:18:35.423398 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.423377 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02292fc4-88eb-48f2-859d-31af30865593-tmp\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.423576 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.423559 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c749j\" (UniqueName: \"kubernetes.io/projected/be86ac5f-0bf8-4641-8ece-4eef5ab1d580-kube-api-access-c749j\") pod \"multus-mm84v\" (UID: \"be86ac5f-0bf8-4641-8ece-4eef5ab1d580\") " pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.429184 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.429165 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltv8p\" (UniqueName: \"kubernetes.io/projected/02292fc4-88eb-48f2-859d-31af30865593-kube-api-access-ltv8p\") pod \"tuned-ftc27\" (UID: \"02292fc4-88eb-48f2-859d-31af30865593\") " pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.433966 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.433937 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsvvg\" (UniqueName: \"kubernetes.io/projected/b5bab53c-ef28-4f24-a84e-640462c08884-kube-api-access-lsvvg\") pod \"network-metrics-daemon-7mpnr\" (UID: \"b5bab53c-ef28-4f24-a84e-640462c08884\") " pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:35.434370 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.434334 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdjll\" (UniqueName: \"kubernetes.io/projected/9202f543-8508-4616-9b49-9c3063006a76-kube-api-access-vdjll\") pod \"iptables-alerter-7lw7b\" (UID: \"9202f543-8508-4616-9b49-9c3063006a76\") " pod="openshift-network-operator/iptables-alerter-7lw7b" Sep 11 06:18:35.434484 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.434468 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpcvg\" (UniqueName: \"kubernetes.io/projected/5746b0e0-5a64-4b42-8ccb-21f7ecfc66de-kube-api-access-gpcvg\") pod \"multus-additional-cni-plugins-zw5v6\" (UID: \"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de\") " pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.434845 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.434825 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrrsn\" (UniqueName: \"kubernetes.io/projected/a2f7b95d-3f2a-4c11-a467-c3d3e6badf84-kube-api-access-hrrsn\") pod \"node-resolver-lzqnp\" (UID: \"a2f7b95d-3f2a-4c11-a467-c3d3e6badf84\") " pod="openshift-dns/node-resolver-lzqnp" Sep 11 06:18:35.435146 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.435127 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srnfh\" (UniqueName: \"kubernetes.io/projected/f03ec2fa-ca46-4d35-aa87-bad491b6fa58-kube-api-access-srnfh\") pod \"node-ca-s5kw4\" (UID: \"f03ec2fa-ca46-4d35-aa87-bad491b6fa58\") " pod="openshift-image-registry/node-ca-s5kw4" Sep 11 06:18:35.521544 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-device-dir\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.521544 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-run-openvswitch\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.521544 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m85sw\" (UniqueName: \"kubernetes.io/projected/39545d0c-44ed-4a03-a545-f0e61abb52d0-kube-api-access-m85sw\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.521850 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-kubelet-config\") pod \"global-pull-secret-syncer-db87s\" (UID: \"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6\") " pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:35.521850 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-etc-openvswitch\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.521850 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521664 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-run-openvswitch\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.521850 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521684 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-slash\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.521850 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521652 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-device-dir\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.521850 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521729 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-slash\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.521850 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521727 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-log-socket\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.521850 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521743 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-kubelet-config\") pod \"global-pull-secret-syncer-db87s\" (UID: \"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6\") " pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:35.521850 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521762 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-log-socket\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.521850 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521789 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.521850 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.521850 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521829 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39545d0c-44ed-4a03-a545-f0e61abb52d0-ovn-node-metrics-cert\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521867 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret\") pod \"global-pull-secret-syncer-db87s\" (UID: \"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6\") " pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-run-ovn\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-cni-bin\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.521970 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-socket-dir\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521999 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-etc-selinux\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.521876 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-etc-openvswitch\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.522039 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret podName:7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6 nodeName:}" failed. No retries permitted until 2026-09-11 06:18:36.022019558 +0000 UTC m=+3.134147812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret") pod "global-pull-secret-syncer-db87s" (UID: "7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6") : object "kube-system"/"original-pull-secret" not registered Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-systemd-units\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522104 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-etc-selinux\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522141 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-systemd-units\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522150 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-cni-netd\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522188 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-cni-bin\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-cni-netd\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.522378 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522233 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-run-ovn\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-registration-dir\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522275 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-socket-dir\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-sys-fs\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522309 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-registration-dir\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-run-netns\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522358 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-run-netns\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522371 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-sys-fs\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-run-systemd\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39545d0c-44ed-4a03-a545-f0e61abb52d0-ovnkube-config\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522414 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-run-systemd\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-dbus\") pod \"global-pull-secret-syncer-db87s\" (UID: \"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6\") " pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-node-log\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522507 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39545d0c-44ed-4a03-a545-f0e61abb52d0-env-overrides\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39545d0c-44ed-4a03-a545-f0e61abb52d0-ovnkube-script-lib\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sd58\" (UniqueName: \"kubernetes.io/projected/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-kube-api-access-7sd58\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.523258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522563 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-node-log\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523869 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522602 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-kubelet\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523869 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522641 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-var-lib-openvswitch\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523869 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522654 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-dbus\") pod \"global-pull-secret-syncer-db87s\" (UID: \"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6\") " pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:35.523869 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522937 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-kubelet\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523869 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522983 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-var-lib-openvswitch\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523869 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.522995 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39545d0c-44ed-4a03-a545-f0e61abb52d0-ovnkube-config\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523869 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.523022 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39545d0c-44ed-4a03-a545-f0e61abb52d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523869 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.523228 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39545d0c-44ed-4a03-a545-f0e61abb52d0-ovnkube-script-lib\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.523869 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.523365 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39545d0c-44ed-4a03-a545-f0e61abb52d0-env-overrides\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.524863 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.524833 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39545d0c-44ed-4a03-a545-f0e61abb52d0-ovn-node-metrics-cert\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.531776 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.531751 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m85sw\" (UniqueName: \"kubernetes.io/projected/39545d0c-44ed-4a03-a545-f0e61abb52d0-kube-api-access-m85sw\") pod \"ovnkube-node-gkzwh\" (UID: \"39545d0c-44ed-4a03-a545-f0e61abb52d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.532796 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.532766 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sd58\" (UniqueName: \"kubernetes.io/projected/ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e-kube-api-access-7sd58\") pod \"aws-ebs-csi-driver-node-72rbg\" (UID: \"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.597532 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.597486 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7lw7b" Sep 11 06:18:35.607385 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.607363 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s5kw4" Sep 11 06:18:35.619495 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.619469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mm84v" Sep 11 06:18:35.624715 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.624693 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7wkvx" Sep 11 06:18:35.630628 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.630610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ftc27" Sep 11 06:18:35.636482 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.636458 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lzqnp" Sep 11 06:18:35.642300 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.642281 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zw5v6" Sep 11 06:18:35.648190 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.648171 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" Sep 11 06:18:35.651961 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.651946 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:18:35.807791 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:35.807757 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe86ac5f_0bf8_4641_8ece_4eef5ab1d580.slice/crio-0e4e6160a05c343ee57a1ef9b38378ba7cc02fd55024aae5b639d4274969eaf7 WatchSource:0}: Error finding container 0e4e6160a05c343ee57a1ef9b38378ba7cc02fd55024aae5b639d4274969eaf7: Status 404 returned error can't find the container with id 0e4e6160a05c343ee57a1ef9b38378ba7cc02fd55024aae5b639d4274969eaf7 Sep 11 06:18:35.809076 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:35.809047 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddcd2adb_fc14_4c12_8f4c_a66ef5fa9a1e.slice/crio-e4cc33b6d3db1bd712ae844ba948110f7ba189a6ee7a60c8e8aef0190ee28674 WatchSource:0}: Error finding container e4cc33b6d3db1bd712ae844ba948110f7ba189a6ee7a60c8e8aef0190ee28674: Status 404 returned error can't find the container with id e4cc33b6d3db1bd712ae844ba948110f7ba189a6ee7a60c8e8aef0190ee28674 Sep 11 06:18:35.812537 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:35.812493 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03ec2fa_ca46_4d35_aa87_bad491b6fa58.slice/crio-bac2c1309002145c93f4baa8ef889f6aaf7506b7a7f3a0af05d2658c107df6f4 WatchSource:0}: Error finding container bac2c1309002145c93f4baa8ef889f6aaf7506b7a7f3a0af05d2658c107df6f4: Status 404 returned error can't find the container with id bac2c1309002145c93f4baa8ef889f6aaf7506b7a7f3a0af05d2658c107df6f4 Sep 11 06:18:35.813666 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:35.813418 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02292fc4_88eb_48f2_859d_31af30865593.slice/crio-5c16fe6bd46abd366a78c0b68396ae2e8d3f769c8b21f691cc763aaa1c5364a9 WatchSource:0}: Error finding container 5c16fe6bd46abd366a78c0b68396ae2e8d3f769c8b21f691cc763aaa1c5364a9: Status 404 returned error can't find the container with id 5c16fe6bd46abd366a78c0b68396ae2e8d3f769c8b21f691cc763aaa1c5364a9 Sep 11 06:18:35.815494 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:35.814258 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5746b0e0_5a64_4b42_8ccb_21f7ecfc66de.slice/crio-1a93e632e659ae34d599c297d04cab008f59547db782dc60fdbdfcf4efab9ebb WatchSource:0}: Error finding container 1a93e632e659ae34d599c297d04cab008f59547db782dc60fdbdfcf4efab9ebb: Status 404 returned error can't find the container with id 1a93e632e659ae34d599c297d04cab008f59547db782dc60fdbdfcf4efab9ebb Sep 11 06:18:35.815494 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:35.814856 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9202f543_8508_4616_9b49_9c3063006a76.slice/crio-ed5998f7939dd78741f55bb4c9baee4dde366f4f8be58ebef89a7722c2c8ce9a WatchSource:0}: Error finding container ed5998f7939dd78741f55bb4c9baee4dde366f4f8be58ebef89a7722c2c8ce9a: Status 404 returned error can't find the container with id ed5998f7939dd78741f55bb4c9baee4dde366f4f8be58ebef89a7722c2c8ce9a Sep 11 06:18:35.817737 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:35.817308 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a3c67d_d236_44e3_ba64_5253f5ca2087.slice/crio-191b855e8679a95e84b3d0596fbbaa815e48cb7aa2178023fc165aa9b6779f1c WatchSource:0}: Error finding container 191b855e8679a95e84b3d0596fbbaa815e48cb7aa2178023fc165aa9b6779f1c: Status 404 returned error can't find the container with id 191b855e8679a95e84b3d0596fbbaa815e48cb7aa2178023fc165aa9b6779f1c Sep 11 06:18:35.818383 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:35.818358 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2f7b95d_3f2a_4c11_a467_c3d3e6badf84.slice/crio-a8df63bbcd63f43ce10453b864bfb2e856fb1cba9fb651bc9a3e0fd95142586e WatchSource:0}: Error finding container a8df63bbcd63f43ce10453b864bfb2e856fb1cba9fb651bc9a3e0fd95142586e: Status 404 returned error can't find the container with id a8df63bbcd63f43ce10453b864bfb2e856fb1cba9fb651bc9a3e0fd95142586e Sep 11 06:18:35.819506 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:18:35.819484 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39545d0c_44ed_4a03_a545_f0e61abb52d0.slice/crio-0785d07acc3eaac66888d7f1ad8148f4384bde78114c25df65fc740fdad4e859 WatchSource:0}: Error finding container 0785d07acc3eaac66888d7f1ad8148f4384bde78114c25df65fc740fdad4e859: Status 404 returned error can't find the container with id 0785d07acc3eaac66888d7f1ad8148f4384bde78114c25df65fc740fdad4e859 Sep 11 06:18:35.925176 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.925135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs\") pod \"network-metrics-daemon-7mpnr\" (UID: \"b5bab53c-ef28-4f24-a84e-640462c08884\") " pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:35.925335 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:35.925204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9xdv\" (UniqueName: \"kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv\") pod \"network-check-target-p8qtr\" (UID: \"45161465-23cb-40f9-b682-809e7aeef6ac\") " pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:35.925412 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.925377 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 06:18:35.925412 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.925407 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 06:18:35.925502 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.925431 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 06:18:35.925502 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.925445 2578 projected.go:196] Error preparing data for projected volume kube-api-access-h9xdv for pod openshift-network-diagnostics/network-check-target-p8qtr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 06:18:35.925502 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.925450 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs podName:b5bab53c-ef28-4f24-a84e-640462c08884 nodeName:}" failed. No retries permitted until 2026-09-11 06:18:36.925428553 +0000 UTC m=+4.037556783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs") pod "network-metrics-daemon-7mpnr" (UID: "b5bab53c-ef28-4f24-a84e-640462c08884") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 06:18:35.925502 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:35.925500 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv podName:45161465-23cb-40f9-b682-809e7aeef6ac nodeName:}" failed. No retries permitted until 2026-09-11 06:18:36.925482071 +0000 UTC m=+4.037610319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9xdv" (UniqueName: "kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv") pod "network-check-target-p8qtr" (UID: "45161465-23cb-40f9-b682-809e7aeef6ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 06:18:36.026605 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.026083 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret\") pod \"global-pull-secret-syncer-db87s\" (UID: \"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6\") " pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:36.026605 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:36.026253 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 06:18:36.026605 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:36.026315 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret podName:7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6 nodeName:}" failed. No retries permitted until 2026-09-11 06:18:37.026300189 +0000 UTC m=+4.138428429 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret") pod "global-pull-secret-syncer-db87s" (UID: "7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6") : object "kube-system"/"original-pull-secret" not registered Sep 11 06:18:36.351245 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.351168 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 06:13:35 +0000 UTC" deadline="2028-06-09 18:24:54.38606469 +0000 UTC" Sep 11 06:18:36.351245 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.351233 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15300h6m18.034836374s" Sep 11 06:18:36.404344 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.404316 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 06:18:36.411514 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.411329 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7lw7b" event={"ID":"9202f543-8508-4616-9b49-9c3063006a76","Type":"ContainerStarted","Data":"ed5998f7939dd78741f55bb4c9baee4dde366f4f8be58ebef89a7722c2c8ce9a"} Sep 11 06:18:36.420533 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.420499 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ftc27" event={"ID":"02292fc4-88eb-48f2-859d-31af30865593","Type":"ContainerStarted","Data":"5c16fe6bd46abd366a78c0b68396ae2e8d3f769c8b21f691cc763aaa1c5364a9"} Sep 11 06:18:36.434279 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.434244 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" event={"ID":"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e","Type":"ContainerStarted","Data":"e4cc33b6d3db1bd712ae844ba948110f7ba189a6ee7a60c8e8aef0190ee28674"} Sep 11 06:18:36.452813 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.440732 2578 generic.go:356] "Generic (PLEG): container finished" podID="7302cb3052b6ea5146139460ab2402c8" containerID="9107df9474f04663748376daa026e86f6af5127979bb96ef3c4f4ebd2112b7be" exitCode=0 Sep 11 06:18:36.452813 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.440796 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal" event={"ID":"7302cb3052b6ea5146139460ab2402c8","Type":"ContainerDied","Data":"9107df9474f04663748376daa026e86f6af5127979bb96ef3c4f4ebd2112b7be"} Sep 11 06:18:36.452813 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.450271 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" event={"ID":"39545d0c-44ed-4a03-a545-f0e61abb52d0","Type":"ContainerStarted","Data":"0785d07acc3eaac66888d7f1ad8148f4384bde78114c25df65fc740fdad4e859"} Sep 11 06:18:36.456160 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.456132 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lzqnp" event={"ID":"a2f7b95d-3f2a-4c11-a467-c3d3e6badf84","Type":"ContainerStarted","Data":"a8df63bbcd63f43ce10453b864bfb2e856fb1cba9fb651bc9a3e0fd95142586e"} Sep 11 06:18:36.460491 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.460454 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s5kw4" event={"ID":"f03ec2fa-ca46-4d35-aa87-bad491b6fa58","Type":"ContainerStarted","Data":"bac2c1309002145c93f4baa8ef889f6aaf7506b7a7f3a0af05d2658c107df6f4"} Sep 11 06:18:36.469309 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.469269 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mm84v" event={"ID":"be86ac5f-0bf8-4641-8ece-4eef5ab1d580","Type":"ContainerStarted","Data":"0e4e6160a05c343ee57a1ef9b38378ba7cc02fd55024aae5b639d4274969eaf7"} Sep 11 06:18:36.473186 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.473161 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7wkvx" event={"ID":"59a3c67d-d236-44e3-ba64-5253f5ca2087","Type":"ContainerStarted","Data":"191b855e8679a95e84b3d0596fbbaa815e48cb7aa2178023fc165aa9b6779f1c"} Sep 11 06:18:36.483498 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.483442 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zw5v6" event={"ID":"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de","Type":"ContainerStarted","Data":"1a93e632e659ae34d599c297d04cab008f59547db782dc60fdbdfcf4efab9ebb"} Sep 11 06:18:36.935236 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.934312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs\") pod \"network-metrics-daemon-7mpnr\" (UID: \"b5bab53c-ef28-4f24-a84e-640462c08884\") " pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:36.935236 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:36.934361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9xdv\" (UniqueName: \"kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv\") pod \"network-check-target-p8qtr\" (UID: \"45161465-23cb-40f9-b682-809e7aeef6ac\") " pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:36.935236 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:36.934551 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 06:18:36.935236 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:36.934570 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 06:18:36.935236 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:36.934584 2578 projected.go:196] Error preparing data for projected volume kube-api-access-h9xdv for pod openshift-network-diagnostics/network-check-target-p8qtr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 06:18:36.935236 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:36.934665 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv podName:45161465-23cb-40f9-b682-809e7aeef6ac nodeName:}" failed. No retries permitted until 2026-09-11 06:18:38.934644183 +0000 UTC m=+6.046772430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9xdv" (UniqueName: "kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv") pod "network-check-target-p8qtr" (UID: "45161465-23cb-40f9-b682-809e7aeef6ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 06:18:36.935236 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:36.934752 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 06:18:36.935236 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:36.934788 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs podName:b5bab53c-ef28-4f24-a84e-640462c08884 nodeName:}" failed. No retries permitted until 2026-09-11 06:18:38.934776817 +0000 UTC m=+6.046905058 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs") pod "network-metrics-daemon-7mpnr" (UID: "b5bab53c-ef28-4f24-a84e-640462c08884") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 06:18:37.035006 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:37.034967 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret\") pod \"global-pull-secret-syncer-db87s\" (UID: \"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6\") " pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:37.035200 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:37.035181 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 06:18:37.035282 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:37.035253 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret podName:7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6 nodeName:}" failed. No retries permitted until 2026-09-11 06:18:39.035233394 +0000 UTC m=+6.147361639 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret") pod "global-pull-secret-syncer-db87s" (UID: "7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6") : object "kube-system"/"original-pull-secret" not registered Sep 11 06:18:37.352496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:37.352157 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 06:13:35 +0000 UTC" deadline="2028-02-11 21:28:28.686708014 +0000 UTC" Sep 11 06:18:37.352496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:37.352418 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12447h9m51.334296265s" Sep 11 06:18:37.397611 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:37.396428 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:37.397611 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:37.396580 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:18:37.397611 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:37.397036 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:37.397611 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:37.397142 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:18:37.397611 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:37.397216 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:37.397611 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:37.397330 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:18:37.509770 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:37.509731 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal" event={"ID":"7302cb3052b6ea5146139460ab2402c8","Type":"ContainerStarted","Data":"e7949fe991a5434041b0d0e5041a84900a2ffc85447d9687114c214fe337e68e"} Sep 11 06:18:37.527309 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:37.527193 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-168.ec2.internal" podStartSLOduration=3.527170736 podStartE2EDuration="3.527170736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 06:18:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:18:37.52662485 +0000 UTC m=+4.638753099" watchObservedRunningTime="2026-09-11 06:18:37.527170736 +0000 UTC m=+4.639298987" Sep 11 06:18:38.955110 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:38.955072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs\") pod \"network-metrics-daemon-7mpnr\" (UID: \"b5bab53c-ef28-4f24-a84e-640462c08884\") " pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:38.955562 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:38.955123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9xdv\" (UniqueName: \"kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv\") pod \"network-check-target-p8qtr\" (UID: \"45161465-23cb-40f9-b682-809e7aeef6ac\") " pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:38.955562 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:38.955275 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 06:18:38.955562 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:38.955294 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 06:18:38.955562 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:38.955309 2578 projected.go:196] Error preparing data for projected volume kube-api-access-h9xdv for pod openshift-network-diagnostics/network-check-target-p8qtr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 06:18:38.955562 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:38.955367 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv podName:45161465-23cb-40f9-b682-809e7aeef6ac nodeName:}" failed. No retries permitted until 2026-09-11 06:18:42.95534712 +0000 UTC m=+10.067475360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9xdv" (UniqueName: "kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv") pod "network-check-target-p8qtr" (UID: "45161465-23cb-40f9-b682-809e7aeef6ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 06:18:38.955919 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:38.955771 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 06:18:38.955919 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:38.955831 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs podName:b5bab53c-ef28-4f24-a84e-640462c08884 nodeName:}" failed. No retries permitted until 2026-09-11 06:18:42.95581687 +0000 UTC m=+10.067945101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs") pod "network-metrics-daemon-7mpnr" (UID: "b5bab53c-ef28-4f24-a84e-640462c08884") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 06:18:39.065335 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:39.063091 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret\") pod \"global-pull-secret-syncer-db87s\" (UID: \"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6\") " pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:39.065335 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:39.063250 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 06:18:39.065335 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:39.063324 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret podName:7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6 nodeName:}" failed. No retries permitted until 2026-09-11 06:18:43.063304293 +0000 UTC m=+10.175432542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret") pod "global-pull-secret-syncer-db87s" (UID: "7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6") : object "kube-system"/"original-pull-secret" not registered Sep 11 06:18:39.394832 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:39.394692 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:39.394994 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:39.394830 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:18:39.395413 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:39.395122 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:39.395413 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:39.394692 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:39.395413 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:39.395240 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:18:39.395413 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:39.395331 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:18:41.394140 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:41.393861 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:41.394140 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:41.393973 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:18:41.394140 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:41.394059 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:41.394140 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:41.394090 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:41.394756 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:41.394189 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:18:41.394756 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:41.394293 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:18:43.000176 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:43.000146 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs\") pod \"network-metrics-daemon-7mpnr\" (UID: \"b5bab53c-ef28-4f24-a84e-640462c08884\") " pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:43.000657 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:43.000182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9xdv\" (UniqueName: \"kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv\") pod \"network-check-target-p8qtr\" (UID: \"45161465-23cb-40f9-b682-809e7aeef6ac\") " pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:43.000657 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:43.000316 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 06:18:43.000657 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:43.000401 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs podName:b5bab53c-ef28-4f24-a84e-640462c08884 nodeName:}" failed. No retries permitted until 2026-09-11 06:18:51.000380158 +0000 UTC m=+18.112508409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs") pod "network-metrics-daemon-7mpnr" (UID: "b5bab53c-ef28-4f24-a84e-640462c08884") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 06:18:43.000657 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:43.000323 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 06:18:43.000657 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:43.000443 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 06:18:43.000657 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:43.000457 2578 projected.go:196] Error preparing data for projected volume kube-api-access-h9xdv for pod openshift-network-diagnostics/network-check-target-p8qtr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 06:18:43.000657 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:43.000510 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv podName:45161465-23cb-40f9-b682-809e7aeef6ac nodeName:}" failed. No retries permitted until 2026-09-11 06:18:51.000492856 +0000 UTC m=+18.112621111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9xdv" (UniqueName: "kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv") pod "network-check-target-p8qtr" (UID: "45161465-23cb-40f9-b682-809e7aeef6ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 06:18:43.101315 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:43.101278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret\") pod \"global-pull-secret-syncer-db87s\" (UID: \"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6\") " pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:43.101467 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:43.101415 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 06:18:43.101519 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:43.101488 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret podName:7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6 nodeName:}" failed. No retries permitted until 2026-09-11 06:18:51.101470436 +0000 UTC m=+18.213598663 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret") pod "global-pull-secret-syncer-db87s" (UID: "7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6") : object "kube-system"/"original-pull-secret" not registered Sep 11 06:18:43.394992 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:43.394954 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:43.395155 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:43.395060 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:43.395155 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:43.395105 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:43.395155 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:43.395097 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:18:43.395328 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:43.395205 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:18:43.395383 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:43.395325 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:18:45.393073 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:45.393046 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:45.393506 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:45.393049 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:45.393506 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:45.393163 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:18:45.393506 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:45.393181 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:45.393506 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:45.393267 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:18:45.393506 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:45.393353 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:18:47.393747 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:47.393708 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:47.394086 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:47.393709 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:47.394086 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:47.393854 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:18:47.394086 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:47.393903 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:47.394086 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:47.393972 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:18:47.394086 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:47.394020 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:18:49.394420 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:49.393902 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:49.394420 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:49.393942 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:49.394420 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:49.394072 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:18:49.394420 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:49.394138 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:49.394420 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:49.394216 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:18:49.394420 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:49.394301 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:18:51.057611 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:51.057534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs\") pod \"network-metrics-daemon-7mpnr\" (UID: \"b5bab53c-ef28-4f24-a84e-640462c08884\") " pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:51.057611 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:51.057590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9xdv\" (UniqueName: \"kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv\") pod \"network-check-target-p8qtr\" (UID: \"45161465-23cb-40f9-b682-809e7aeef6ac\") " pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:51.058008 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:51.057686 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 06:18:51.058008 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:51.057701 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 06:18:51.058008 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:51.057722 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 06:18:51.058008 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:51.057732 2578 projected.go:196] Error preparing data for projected volume kube-api-access-h9xdv for pod openshift-network-diagnostics/network-check-target-p8qtr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 06:18:51.058008 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:51.057780 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs podName:b5bab53c-ef28-4f24-a84e-640462c08884 nodeName:}" failed. No retries permitted until 2026-09-11 06:19:07.057762733 +0000 UTC m=+34.169890959 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs") pod "network-metrics-daemon-7mpnr" (UID: "b5bab53c-ef28-4f24-a84e-640462c08884") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 06:18:51.058008 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:51.057794 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv podName:45161465-23cb-40f9-b682-809e7aeef6ac nodeName:}" failed. No retries permitted until 2026-09-11 06:19:07.057788141 +0000 UTC m=+34.169916364 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9xdv" (UniqueName: "kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv") pod "network-check-target-p8qtr" (UID: "45161465-23cb-40f9-b682-809e7aeef6ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 06:18:51.158327 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:51.158306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret\") pod \"global-pull-secret-syncer-db87s\" (UID: \"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6\") " pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:51.158439 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:51.158428 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 06:18:51.158483 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:51.158475 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret podName:7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6 nodeName:}" failed. No retries permitted until 2026-09-11 06:19:07.158463169 +0000 UTC m=+34.270591393 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret") pod "global-pull-secret-syncer-db87s" (UID: "7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6") : object "kube-system"/"original-pull-secret" not registered Sep 11 06:18:51.393668 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:51.393635 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:51.393850 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:51.393635 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:51.393850 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:51.393782 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:18:51.394000 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:51.393858 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:18:51.394000 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:51.393899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:51.394086 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:51.394002 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:18:53.394283 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:53.394256 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:53.394726 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:53.394365 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:18:53.394796 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:53.394726 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:53.394849 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:53.394819 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:18:53.394892 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:53.394860 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:53.394936 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:53.394918 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:18:55.393244 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.393076 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:55.394198 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.393076 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:55.394198 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:55.393329 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:18:55.394198 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.393076 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:55.394198 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:55.393392 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:18:55.394198 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:55.393454 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:18:55.551289 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.551071 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" event={"ID":"39545d0c-44ed-4a03-a545-f0e61abb52d0","Type":"ContainerStarted","Data":"a8dadaf9723f9ba49df17d5e423d7173dcc7eedf3e1de070ecdf447bac7118cc"} Sep 11 06:18:55.551624 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.551356 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" event={"ID":"39545d0c-44ed-4a03-a545-f0e61abb52d0","Type":"ContainerStarted","Data":"c7069a1b75085cbf0145e0af4194f8101367357db895bd1006e8374b091f5209"} Sep 11 06:18:55.551624 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.551414 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" event={"ID":"39545d0c-44ed-4a03-a545-f0e61abb52d0","Type":"ContainerStarted","Data":"edade931f62d1e96cb751e4000a92965f76cdfb0c18d46a0de5aa559633de3b1"} Sep 11 06:18:55.551624 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.551465 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" event={"ID":"39545d0c-44ed-4a03-a545-f0e61abb52d0","Type":"ContainerStarted","Data":"1874898df0faa641ee6716f50528fa18568c4ec4e3eca88090945b601b717479"} Sep 11 06:18:55.551624 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.551514 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" event={"ID":"39545d0c-44ed-4a03-a545-f0e61abb52d0","Type":"ContainerStarted","Data":"203b48b0a5f3455adfded5e1355db2d814fe9e341d53de0934e826f093d0c097"} Sep 11 06:18:55.551624 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.551560 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" event={"ID":"39545d0c-44ed-4a03-a545-f0e61abb52d0","Type":"ContainerStarted","Data":"b4d21f9b7208a33bcaaf059425f13d68e9a0e576409b4cd7000700a14aa86106"} Sep 11 06:18:55.552761 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.552729 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lzqnp" event={"ID":"a2f7b95d-3f2a-4c11-a467-c3d3e6badf84","Type":"ContainerStarted","Data":"ac5493f8d915484637d832ff40d2c139906521490657ce976acc0286af9a0803"} Sep 11 06:18:55.554606 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.554560 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s5kw4" event={"ID":"f03ec2fa-ca46-4d35-aa87-bad491b6fa58","Type":"ContainerStarted","Data":"0ca24c346576f466aad22bb9eddc27194249dae3f4e86d530fdcfa2d0811c736"} Sep 11 06:18:55.556295 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.556266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mm84v" event={"ID":"be86ac5f-0bf8-4641-8ece-4eef5ab1d580","Type":"ContainerStarted","Data":"305e61e4c67724f26b5843546ba591b550f0670807b8303718394c75e594f1f7"} Sep 11 06:18:55.557912 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.557893 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-168.ec2.internal" event={"ID":"fa6ea2416a19c5884a3df0b3ea9c984b","Type":"ContainerStarted","Data":"377de0db1028710fe068b53dc6492e52f68ab31e07322891520bb8c37d351b44"} Sep 11 06:18:55.559827 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.559802 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7wkvx" event={"ID":"59a3c67d-d236-44e3-ba64-5253f5ca2087","Type":"ContainerStarted","Data":"4f1176f4c218015dd7be46da71625c458fdfbb79ed8abfe24185ea4deebb8f16"} Sep 11 06:18:55.561436 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.561414 2578 generic.go:356] "Generic (PLEG): container finished" podID="5746b0e0-5a64-4b42-8ccb-21f7ecfc66de" containerID="3b6099be2ffa449cf6ab88d09966fe06d5c23a8fd2c05a57e4a846663023e7bc" exitCode=0 Sep 11 06:18:55.561537 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.561481 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zw5v6" event={"ID":"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de","Type":"ContainerDied","Data":"3b6099be2ffa449cf6ab88d09966fe06d5c23a8fd2c05a57e4a846663023e7bc"} Sep 11 06:18:55.564443 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.564416 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ftc27" event={"ID":"02292fc4-88eb-48f2-859d-31af30865593","Type":"ContainerStarted","Data":"3d1626ad1ee406a3c302beb4ebaf1b1f495b0d6e659b704b08943f20912d8942"} Sep 11 06:18:55.567370 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.567313 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" event={"ID":"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e","Type":"ContainerStarted","Data":"74e8345c13eda215cc5a95b97703670906904d3055f1a94bc9ed55274cc46e49"} Sep 11 06:18:55.577342 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.577297 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lzqnp" podStartSLOduration=2.783328422 podStartE2EDuration="21.577280312s" totalImagesPullingTime="18.79395189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 06:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:18:55.576711382 +0000 UTC m=+22.688839630" watchObservedRunningTime="2026-09-11 06:18:55.577280312 +0000 UTC m=+22.689408562" Sep 11 06:18:55.634313 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.634275 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mm84v" podStartSLOduration=2.751220979 podStartE2EDuration="21.634263419s" totalImagesPullingTime="18.88304244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 06:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:18:55.634215515 +0000 UTC m=+22.746343760" watchObservedRunningTime="2026-09-11 06:18:55.634263419 +0000 UTC m=+22.746391665" Sep 11 06:18:55.634447 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.634430 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ftc27" podStartSLOduration=3.77785714 podStartE2EDuration="22.63442544s" totalImagesPullingTime="18.8565683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 06:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:18:55.60719091 +0000 UTC m=+22.719319159" watchObservedRunningTime="2026-09-11 06:18:55.63442544 +0000 UTC m=+22.746553685" Sep 11 06:18:55.652014 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.651975 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7wkvx" podStartSLOduration=3.8265600490000002 podStartE2EDuration="22.651961384s" totalImagesPullingTime="18.825401335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:18:55.65140972 +0000 UTC m=+22.763537966" watchObservedRunningTime="2026-09-11 06:18:55.651961384 +0000 UTC m=+22.764089631" Sep 11 06:18:55.698623 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.698540 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-168.ec2.internal" podStartSLOduration=21.698525753 podStartE2EDuration="21.698525753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 06:18:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:18:55.69808817 +0000 UTC m=+22.810216418" watchObservedRunningTime="2026-09-11 06:18:55.698525753 +0000 UTC m=+22.810653996" Sep 11 06:18:55.719264 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:55.719224 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s5kw4" podStartSLOduration=3.8949151950000003 podStartE2EDuration="22.719213846s" totalImagesPullingTime="18.824298651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 06:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:18:55.718796157 +0000 UTC m=+22.830924402" watchObservedRunningTime="2026-09-11 06:18:55.719213846 +0000 UTC m=+22.831342074" Sep 11 06:18:56.441806 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:56.441775 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 11 06:18:56.570709 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:56.570628 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7lw7b" event={"ID":"9202f543-8508-4616-9b49-9c3063006a76","Type":"ContainerStarted","Data":"93c77f35f6b945fc38c3b175c8cdaaa5c9faf80e0ebc3a317e9799428e99dffb"} Sep 11 06:18:56.572805 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:56.572774 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" event={"ID":"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e","Type":"ContainerStarted","Data":"d7fb0db70cfd03b35dafd44e1f31ce8287873476a35cd7555ca338cd2cfd3283"} Sep 11 06:18:56.589756 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:56.589717 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7lw7b" podStartSLOduration=4.7354633360000005 podStartE2EDuration="23.589705489s" totalImagesPullingTime="18.854242153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 06:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:18:56.589466562 +0000 UTC m=+23.701594808" watchObservedRunningTime="2026-09-11 06:18:56.589705489 +0000 UTC m=+23.701833734" Sep 11 06:18:57.372952 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:57.372835 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T06:18:56.441803646Z","UUID":"6c70a3ac-bc38-40b6-a740-acdfef6fe4c2","Handler":null,"Name":"","Endpoint":""} Sep 11 06:18:57.375016 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:57.374990 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 11 06:18:57.375186 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:57.375035 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 11 06:18:57.393602 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:57.393559 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:57.393738 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:57.393559 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:57.393738 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:57.393701 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:18:57.393859 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:57.393784 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:18:57.393859 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:57.393578 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:57.393859 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:57.393853 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:18:57.489408 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:57.489377 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7wkvx" Sep 11 06:18:57.489962 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:57.489941 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7wkvx" Sep 11 06:18:57.580673 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:57.580643 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" event={"ID":"39545d0c-44ed-4a03-a545-f0e61abb52d0","Type":"ContainerStarted","Data":"092ae116fb776f86fec275e13e0fa7e4d320a22603ea4b956465eadf97bbdf7e"} Sep 11 06:18:57.580793 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:57.580735 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7wkvx" Sep 11 06:18:57.581554 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:57.581535 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7wkvx" Sep 11 06:18:58.585671 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:58.585630 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" event={"ID":"ddcd2adb-fc14-4c12-8f4c-a66ef5fa9a1e","Type":"ContainerStarted","Data":"49a7cccadb507cd5af6a2c47f511d134eb16f65db5982caf2794ef4b80d3d05c"} Sep 11 06:18:58.606411 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:58.606354 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72rbg" podStartSLOduration=3.220337358 podStartE2EDuration="24.606336081s" totalImagesPullingTime="21.385998723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 06:18:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:18:58.605898667 +0000 UTC m=+25.718026914" watchObservedRunningTime="2026-09-11 06:18:58.606336081 +0000 UTC m=+25.718464328" Sep 11 06:18:59.393919 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:59.393880 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:18:59.393919 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:59.393918 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:18:59.394163 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:18:59.393880 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:18:59.394163 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:59.394013 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:18:59.394163 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:59.394122 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:18:59.394326 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:18:59.394256 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:19:00.594202 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:00.594172 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" event={"ID":"39545d0c-44ed-4a03-a545-f0e61abb52d0","Type":"ContainerStarted","Data":"f76774318be95d411ee1aa950479e15eb83918dd459353d28068102f6a3400aa"} Sep 11 06:19:00.594789 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:00.594416 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:19:00.596145 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:00.596122 2578 generic.go:356] "Generic (PLEG): container finished" podID="5746b0e0-5a64-4b42-8ccb-21f7ecfc66de" containerID="aa84d766b132c0d197c03ddd9c6cfcdda173f6bab74d585a73c31de9e00ad411" exitCode=0 Sep 11 06:19:00.596267 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:00.596155 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zw5v6" event={"ID":"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de","Type":"ContainerDied","Data":"aa84d766b132c0d197c03ddd9c6cfcdda173f6bab74d585a73c31de9e00ad411"} Sep 11 06:19:00.610344 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:00.610319 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:19:00.619380 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:00.619343 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" podStartSLOduration=7.734609056 podStartE2EDuration="26.619330572s" totalImagesPullingTime="18.884721516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 06:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:19:00.619309127 +0000 UTC m=+27.731437372" watchObservedRunningTime="2026-09-11 06:19:00.619330572 +0000 UTC m=+27.731458800" Sep 11 06:19:01.393909 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:01.393876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:19:01.394098 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:01.393926 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:19:01.394098 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:01.393877 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:19:01.394098 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:01.394011 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:19:01.394254 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:01.394094 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:19:01.394254 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:01.394172 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:19:01.598685 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:01.598656 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 11 06:19:01.599428 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:01.599230 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:19:01.620128 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:01.619902 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:19:01.890905 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:01.890873 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-db87s"] Sep 11 06:19:01.891072 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:01.891014 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:19:01.891147 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:01.891104 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:19:01.893885 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:01.893859 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p8qtr"] Sep 11 06:19:01.894005 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:01.893974 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:19:01.894081 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:01.894052 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:19:01.894606 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:01.894559 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7mpnr"] Sep 11 06:19:01.894711 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:01.894687 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:19:01.894836 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:01.894797 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:19:02.602989 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:02.602952 2578 generic.go:356] "Generic (PLEG): container finished" podID="5746b0e0-5a64-4b42-8ccb-21f7ecfc66de" containerID="ed1d171c3185ce9631d3b39461e1766457a83bf263fc2b158c9eed0855a5a496" exitCode=0 Sep 11 06:19:02.603477 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:02.603039 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zw5v6" event={"ID":"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de","Type":"ContainerDied","Data":"ed1d171c3185ce9631d3b39461e1766457a83bf263fc2b158c9eed0855a5a496"} Sep 11 06:19:02.603477 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:02.603147 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 11 06:19:03.395908 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:03.395881 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:19:03.395908 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:03.395901 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:19:03.396127 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:03.395890 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:19:03.396127 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:03.395973 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:19:03.396127 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:03.396049 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:19:03.396261 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:03.396130 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:19:03.605585 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:03.605547 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 11 06:19:04.610003 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:04.609969 2578 generic.go:356] "Generic (PLEG): container finished" podID="5746b0e0-5a64-4b42-8ccb-21f7ecfc66de" containerID="07f74adaf26a57f37b1b9b6b9ce490e153d12e0f19537df5b2bbd3128ccfb3cf" exitCode=0 Sep 11 06:19:04.610003 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:04.610007 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zw5v6" event={"ID":"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de","Type":"ContainerDied","Data":"07f74adaf26a57f37b1b9b6b9ce490e153d12e0f19537df5b2bbd3128ccfb3cf"} Sep 11 06:19:05.164404 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:05.164374 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:19:05.164626 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:05.164613 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 11 06:19:05.178778 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:05.178742 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" podUID="39545d0c-44ed-4a03-a545-f0e61abb52d0" containerName="ovnkube-controller" probeResult="failure" output="" Sep 11 06:19:05.187797 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:05.187764 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" podUID="39545d0c-44ed-4a03-a545-f0e61abb52d0" containerName="ovnkube-controller" probeResult="failure" output="" Sep 11 06:19:05.393273 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:05.393242 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:19:05.393437 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:05.393241 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:19:05.393437 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:05.393384 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:19:05.393437 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:05.393383 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:19:05.393607 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:05.393515 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:19:05.393645 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:05.393603 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:19:07.078156 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.078126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs\") pod \"network-metrics-daemon-7mpnr\" (UID: \"b5bab53c-ef28-4f24-a84e-640462c08884\") " pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:19:07.078156 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.078160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9xdv\" (UniqueName: \"kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv\") pod \"network-check-target-p8qtr\" (UID: \"45161465-23cb-40f9-b682-809e7aeef6ac\") " pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:19:07.078643 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:07.078283 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 06:19:07.078643 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:07.078297 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 06:19:07.078643 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:07.078312 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 06:19:07.078643 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:07.078325 2578 projected.go:196] Error preparing data for projected volume kube-api-access-h9xdv for pod openshift-network-diagnostics/network-check-target-p8qtr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 06:19:07.078643 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:07.078356 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs podName:b5bab53c-ef28-4f24-a84e-640462c08884 nodeName:}" failed. No retries permitted until 2026-09-11 06:19:39.078336784 +0000 UTC m=+66.190465019 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs") pod "network-metrics-daemon-7mpnr" (UID: "b5bab53c-ef28-4f24-a84e-640462c08884") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 06:19:07.078643 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:07.078373 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv podName:45161465-23cb-40f9-b682-809e7aeef6ac nodeName:}" failed. No retries permitted until 2026-09-11 06:19:39.078365885 +0000 UTC m=+66.190494111 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h9xdv" (UniqueName: "kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv") pod "network-check-target-p8qtr" (UID: "45161465-23cb-40f9-b682-809e7aeef6ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 06:19:07.179370 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.179335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret\") pod \"global-pull-secret-syncer-db87s\" (UID: \"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6\") " pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:19:07.179542 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:07.179495 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 06:19:07.179640 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:07.179585 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret podName:7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6 nodeName:}" failed. No retries permitted until 2026-09-11 06:19:39.179548792 +0000 UTC m=+66.291677036 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret") pod "global-pull-secret-syncer-db87s" (UID: "7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6") : object "kube-system"/"original-pull-secret" not registered Sep 11 06:19:07.393228 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.393144 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:19:07.393228 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.393186 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:19:07.393426 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.393148 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:19:07.393426 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:07.393280 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db87s" podUID="7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6" Sep 11 06:19:07.393426 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:07.393376 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mpnr" podUID="b5bab53c-ef28-4f24-a84e-640462c08884" Sep 11 06:19:07.393544 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:07.393464 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8qtr" podUID="45161465-23cb-40f9-b682-809e7aeef6ac" Sep 11 06:19:07.744585 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.744548 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-168.ec2.internal" event="NodeReady" Sep 11 06:19:07.744731 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.744695 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 11 06:19:07.783669 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.783638 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7dbf9f4985-jrffd"] Sep 11 06:19:07.788945 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.788906 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.791143 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.791105 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 11 06:19:07.791143 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.791128 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 11 06:19:07.791299 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.791198 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 11 06:19:07.791462 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.791441 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jkxq6\"" Sep 11 06:19:07.792766 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.792741 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ln8dz"] Sep 11 06:19:07.796407 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.796389 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8ns64"] Sep 11 06:19:07.797699 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.797333 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 11 06:19:07.797699 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.797549 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ln8dz" Sep 11 06:19:07.799802 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.799781 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dbf9f4985-jrffd"] Sep 11 06:19:07.799942 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.799927 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:07.801397 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.801355 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 11 06:19:07.801397 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.801380 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 11 06:19:07.801562 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.801381 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 11 06:19:07.801562 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.801360 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-skr75\"" Sep 11 06:19:07.802178 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.802156 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 11 06:19:07.802365 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.802339 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-924b2\"" Sep 11 06:19:07.802473 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.802457 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 11 06:19:07.804401 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.804377 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ln8dz"] Sep 11 06:19:07.812452 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.812430 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8ns64"] Sep 11 06:19:07.884101 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.884063 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.884279 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.884123 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bcd50b4-7f99-459e-a437-522b717cff0a-trusted-ca\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.884279 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.884155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bcd50b4-7f99-459e-a437-522b717cff0a-installation-pull-secrets\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.884279 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.884190 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-certificates\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.884279 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.884209 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bcd50b4-7f99-459e-a437-522b717cff0a-ca-trust-extracted\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.884279 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.884226 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-bound-sa-token\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.884279 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.884259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bcd50b4-7f99-459e-a437-522b717cff0a-image-registry-private-configuration\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.884514 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.884292 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l567q\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-kube-api-access-l567q\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.937837 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.937756 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:07.984677 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.984649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bcd50b4-7f99-459e-a437-522b717cff0a-installation-pull-secrets\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.984851 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.984707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-config-volume\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:07.984851 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.984736 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wj62\" (UniqueName: \"kubernetes.io/projected/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-kube-api-access-6wj62\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:07.984851 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.984774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-certificates\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.984851 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.984831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bcd50b4-7f99-459e-a437-522b717cff0a-ca-trust-extracted\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.985046 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.984868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-bound-sa-token\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.985115 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.985093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-tmp-dir\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:07.985156 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.985135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bcd50b4-7f99-459e-a437-522b717cff0a-image-registry-private-configuration\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.985191 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.985169 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjglw\" (UniqueName: \"kubernetes.io/projected/edc8ff17-b5a6-438b-8065-36b26e4c6da8-kube-api-access-mjglw\") pod \"ingress-canary-ln8dz\" (UID: \"edc8ff17-b5a6-438b-8065-36b26e4c6da8\") " pod="openshift-ingress-canary/ingress-canary-ln8dz" Sep 11 06:19:07.985222 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.985203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:07.985263 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.985248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l567q\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-kube-api-access-l567q\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.985297 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.985275 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bcd50b4-7f99-459e-a437-522b717cff0a-ca-trust-extracted\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.985297 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.985283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.985365 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.985321 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bcd50b4-7f99-459e-a437-522b717cff0a-trusted-ca\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.985421 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.985369 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edc8ff17-b5a6-438b-8065-36b26e4c6da8-cert\") pod \"ingress-canary-ln8dz\" (UID: \"edc8ff17-b5a6-438b-8065-36b26e4c6da8\") " pod="openshift-ingress-canary/ingress-canary-ln8dz" Sep 11 06:19:07.985606 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:07.985585 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 06:19:07.985701 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:07.985608 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dbf9f4985-jrffd: secret "image-registry-tls" not found Sep 11 06:19:07.985701 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.985673 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-certificates\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.985701 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:07.985680 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls podName:9bcd50b4-7f99-459e-a437-522b717cff0a nodeName:}" failed. No retries permitted until 2026-09-11 06:19:08.485659994 +0000 UTC m=+35.597788233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls") pod "image-registry-7dbf9f4985-jrffd" (UID: "9bcd50b4-7f99-459e-a437-522b717cff0a") : secret "image-registry-tls" not found Sep 11 06:19:07.986280 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.986261 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bcd50b4-7f99-459e-a437-522b717cff0a-trusted-ca\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.989327 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.989219 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bcd50b4-7f99-459e-a437-522b717cff0a-image-registry-private-configuration\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.989431 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.989276 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bcd50b4-7f99-459e-a437-522b717cff0a-installation-pull-secrets\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.995797 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.995772 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-bound-sa-token\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:07.995906 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:07.995847 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l567q\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-kube-api-access-l567q\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:08.025515 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:08.025481 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:08.086063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:08.086037 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edc8ff17-b5a6-438b-8065-36b26e4c6da8-cert\") pod \"ingress-canary-ln8dz\" (UID: \"edc8ff17-b5a6-438b-8065-36b26e4c6da8\") " pod="openshift-ingress-canary/ingress-canary-ln8dz" Sep 11 06:19:08.086449 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:08.086074 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-config-volume\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:08.086449 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:08.086108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wj62\" (UniqueName: \"kubernetes.io/projected/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-kube-api-access-6wj62\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:08.086449 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:08.086174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-tmp-dir\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:08.086449 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:08.086196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjglw\" (UniqueName: \"kubernetes.io/projected/edc8ff17-b5a6-438b-8065-36b26e4c6da8-kube-api-access-mjglw\") pod \"ingress-canary-ln8dz\" (UID: \"edc8ff17-b5a6-438b-8065-36b26e4c6da8\") " pod="openshift-ingress-canary/ingress-canary-ln8dz" Sep 11 06:19:08.086449 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:08.086215 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:08.086758 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:08.086504 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 06:19:08.086758 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:08.086564 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls podName:6135cb51-9023-4dd4-bafa-ee4e4a6a667d nodeName:}" failed. No retries permitted until 2026-09-11 06:19:08.586544023 +0000 UTC m=+35.698672252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls") pod "dns-default-8ns64" (UID: "6135cb51-9023-4dd4-bafa-ee4e4a6a667d") : secret "dns-default-metrics-tls" not found Sep 11 06:19:08.086863 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:08.086759 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-config-volume\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:08.087048 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:08.087030 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-tmp-dir\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:08.089078 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:08.089046 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edc8ff17-b5a6-438b-8065-36b26e4c6da8-cert\") pod \"ingress-canary-ln8dz\" (UID: \"edc8ff17-b5a6-438b-8065-36b26e4c6da8\") " pod="openshift-ingress-canary/ingress-canary-ln8dz" Sep 11 06:19:08.095606 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:08.095588 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wj62\" (UniqueName: \"kubernetes.io/projected/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-kube-api-access-6wj62\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:08.095682 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:08.095602 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjglw\" (UniqueName: \"kubernetes.io/projected/edc8ff17-b5a6-438b-8065-36b26e4c6da8-kube-api-access-mjglw\") pod \"ingress-canary-ln8dz\" (UID: \"edc8ff17-b5a6-438b-8065-36b26e4c6da8\") " pod="openshift-ingress-canary/ingress-canary-ln8dz" Sep 11 06:19:08.113548 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:08.113528 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ln8dz" Sep 11 06:19:08.493044 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:08.493003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:08.493235 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:08.493170 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 06:19:08.493235 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:08.493187 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dbf9f4985-jrffd: secret "image-registry-tls" not found Sep 11 06:19:08.493330 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:08.493241 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls podName:9bcd50b4-7f99-459e-a437-522b717cff0a nodeName:}" failed. No retries permitted until 2026-09-11 06:19:09.493227534 +0000 UTC m=+36.605355761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls") pod "image-registry-7dbf9f4985-jrffd" (UID: "9bcd50b4-7f99-459e-a437-522b717cff0a") : secret "image-registry-tls" not found Sep 11 06:19:08.593690 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:08.593658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:08.593855 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:08.593824 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 06:19:08.593938 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:08.593926 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls podName:6135cb51-9023-4dd4-bafa-ee4e4a6a667d nodeName:}" failed. No retries permitted until 2026-09-11 06:19:09.593905181 +0000 UTC m=+36.706033425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls") pod "dns-default-8ns64" (UID: "6135cb51-9023-4dd4-bafa-ee4e4a6a667d") : secret "dns-default-metrics-tls" not found Sep 11 06:19:09.254744 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.254470 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:09.354393 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.354330 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:09.394010 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.393986 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:19:09.394010 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.394008 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:19:09.394216 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.394038 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:19:09.396498 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.396474 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tl76h\"" Sep 11 06:19:09.396686 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.396535 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 06:19:09.397521 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.397349 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 06:19:09.397521 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.397388 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wd9pv\"" Sep 11 06:19:09.397521 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.397449 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 06:19:09.397521 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.397395 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 06:19:09.438000 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.437947 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ln8dz"] Sep 11 06:19:09.468438 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:19:09.468414 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc8ff17_b5a6_438b_8065_36b26e4c6da8.slice/crio-46a0aa81b609b3d591df298e8b7370de847615242b1355df1da911809c47a6c5 WatchSource:0}: Error finding container 46a0aa81b609b3d591df298e8b7370de847615242b1355df1da911809c47a6c5: Status 404 returned error can't find the container with id 46a0aa81b609b3d591df298e8b7370de847615242b1355df1da911809c47a6c5 Sep 11 06:19:09.499831 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.499805 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:09.499942 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:09.499930 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 06:19:09.499983 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:09.499944 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dbf9f4985-jrffd: secret "image-registry-tls" not found Sep 11 06:19:09.500020 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:09.499988 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls podName:9bcd50b4-7f99-459e-a437-522b717cff0a nodeName:}" failed. No retries permitted until 2026-09-11 06:19:11.499974762 +0000 UTC m=+38.612102990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls") pod "image-registry-7dbf9f4985-jrffd" (UID: "9bcd50b4-7f99-459e-a437-522b717cff0a") : secret "image-registry-tls" not found Sep 11 06:19:09.600468 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.600443 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:09.600552 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:09.600535 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 06:19:09.600617 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:09.600608 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls podName:6135cb51-9023-4dd4-bafa-ee4e4a6a667d nodeName:}" failed. No retries permitted until 2026-09-11 06:19:11.600593863 +0000 UTC m=+38.712722088 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls") pod "dns-default-8ns64" (UID: "6135cb51-9023-4dd4-bafa-ee4e4a6a667d") : secret "dns-default-metrics-tls" not found Sep 11 06:19:09.623050 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.623018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ln8dz" event={"ID":"edc8ff17-b5a6-438b-8065-36b26e4c6da8","Type":"ContainerStarted","Data":"46a0aa81b609b3d591df298e8b7370de847615242b1355df1da911809c47a6c5"} Sep 11 06:19:09.625838 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.625817 2578 generic.go:356] "Generic (PLEG): container finished" podID="5746b0e0-5a64-4b42-8ccb-21f7ecfc66de" containerID="b93a076796337d34bbb731701278a39cac341222fbcc572b94426c5902533c62" exitCode=0 Sep 11 06:19:09.625907 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:09.625848 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zw5v6" event={"ID":"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de","Type":"ContainerDied","Data":"b93a076796337d34bbb731701278a39cac341222fbcc572b94426c5902533c62"} Sep 11 06:19:10.207199 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:10.207164 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:10.307609 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:10.307379 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:10.632196 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:10.632162 2578 generic.go:356] "Generic (PLEG): container finished" podID="5746b0e0-5a64-4b42-8ccb-21f7ecfc66de" containerID="00576175d0a1a6bb9b141184974d413dd70cc622c16159772ab254c2977265af" exitCode=0 Sep 11 06:19:10.632353 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:10.632220 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zw5v6" event={"ID":"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de","Type":"ContainerDied","Data":"00576175d0a1a6bb9b141184974d413dd70cc622c16159772ab254c2977265af"} Sep 11 06:19:10.855882 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:10.855843 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:10.950545 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:10.950426 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:11.217519 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:11.217435 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:11.282059 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:11.282022 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:11.515292 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:11.515214 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:11.515704 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:11.515374 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 06:19:11.515704 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:11.515391 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dbf9f4985-jrffd: secret "image-registry-tls" not found Sep 11 06:19:11.515704 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:11.515450 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls podName:9bcd50b4-7f99-459e-a437-522b717cff0a nodeName:}" failed. No retries permitted until 2026-09-11 06:19:15.515434035 +0000 UTC m=+42.627562282 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls") pod "image-registry-7dbf9f4985-jrffd" (UID: "9bcd50b4-7f99-459e-a437-522b717cff0a") : secret "image-registry-tls" not found Sep 11 06:19:11.615635 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:11.615600 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:11.615788 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:11.615771 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 06:19:11.615861 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:11.615850 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls podName:6135cb51-9023-4dd4-bafa-ee4e4a6a667d nodeName:}" failed. No retries permitted until 2026-09-11 06:19:15.615827596 +0000 UTC m=+42.727955834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls") pod "dns-default-8ns64" (UID: "6135cb51-9023-4dd4-bafa-ee4e4a6a667d") : secret "dns-default-metrics-tls" not found Sep 11 06:19:11.639070 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:11.639040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zw5v6" event={"ID":"5746b0e0-5a64-4b42-8ccb-21f7ecfc66de","Type":"ContainerStarted","Data":"c4f810535e0f9dcc1b75e318dcebbe98ceabb849bdaa9a5353b467aa26fb1925"} Sep 11 06:19:11.665504 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:11.665446 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zw5v6" podStartSLOduration=7.682202724 podStartE2EDuration="37.665430466s" totalImagesPullingTime="29.983227742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 06:18:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:19:11.663904733 +0000 UTC m=+38.776032978" watchObservedRunningTime="2026-09-11 06:19:11.665430466 +0000 UTC m=+38.777558726" Sep 11 06:19:11.789383 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:11.789290 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:11.852838 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:11.852795 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:11.939977 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:11.939946 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:12.004990 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:12.004955 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:12.177112 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:12.177079 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:12.643854 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:12.643820 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ln8dz" event={"ID":"edc8ff17-b5a6-438b-8065-36b26e4c6da8","Type":"ContainerStarted","Data":"1bf2c550e31e36717eae6dae5d0586bddb2499e2c398fdfdb22789170e09c1b1"} Sep 11 06:19:12.660634 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:12.660592 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ln8dz" podStartSLOduration=2.694123237 podStartE2EDuration="5.66054952s" totalImagesPullingTime="2.966426283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:19:12.660009614 +0000 UTC m=+39.772137859" watchObservedRunningTime="2026-09-11 06:19:12.66054952 +0000 UTC m=+39.772677766" Sep 11 06:19:15.544805 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:15.544771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:15.545159 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:15.544906 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 06:19:15.545159 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:15.544919 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dbf9f4985-jrffd: secret "image-registry-tls" not found Sep 11 06:19:15.545159 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:15.544972 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls podName:9bcd50b4-7f99-459e-a437-522b717cff0a nodeName:}" failed. No retries permitted until 2026-09-11 06:19:23.544956791 +0000 UTC m=+50.657085028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls") pod "image-registry-7dbf9f4985-jrffd" (UID: "9bcd50b4-7f99-459e-a437-522b717cff0a") : secret "image-registry-tls" not found Sep 11 06:19:15.645507 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:15.645466 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:15.645658 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:15.645635 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 06:19:15.645711 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:15.645701 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls podName:6135cb51-9023-4dd4-bafa-ee4e4a6a667d nodeName:}" failed. No retries permitted until 2026-09-11 06:19:23.645685798 +0000 UTC m=+50.757814027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls") pod "dns-default-8ns64" (UID: "6135cb51-9023-4dd4-bafa-ee4e4a6a667d") : secret "dns-default-metrics-tls" not found Sep 11 06:19:16.450095 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:16.450065 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:16.596911 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:16.596873 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:16.696782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:16.696754 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:18.528384 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:18.528347 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:18.630292 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:18.630265 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:19.846777 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:19.846741 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:21.865096 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:21.865057 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:21.915171 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:21.915137 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:23.607509 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:23.607475 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:23.607908 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:23.607624 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 06:19:23.607908 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:23.607638 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dbf9f4985-jrffd: secret "image-registry-tls" not found Sep 11 06:19:23.607908 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:23.607693 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls podName:9bcd50b4-7f99-459e-a437-522b717cff0a nodeName:}" failed. No retries permitted until 2026-09-11 06:19:39.60767682 +0000 UTC m=+66.719805063 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls") pod "image-registry-7dbf9f4985-jrffd" (UID: "9bcd50b4-7f99-459e-a437-522b717cff0a") : secret "image-registry-tls" not found Sep 11 06:19:23.707892 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:23.707857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:23.708047 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:23.707988 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 06:19:23.708094 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:23.708063 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls podName:6135cb51-9023-4dd4-bafa-ee4e4a6a667d nodeName:}" failed. No retries permitted until 2026-09-11 06:19:39.708049666 +0000 UTC m=+66.820177904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls") pod "dns-default-8ns64" (UID: "6135cb51-9023-4dd4-bafa-ee4e4a6a667d") : secret "dns-default-metrics-tls" not found Sep 11 06:19:26.311373 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:26.311333 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:26.374358 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:26.374331 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:27.047714 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:27.047679 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:27.104180 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:27.104150 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:28.782886 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.782856 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d"] Sep 11 06:19:28.786458 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.786443 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:19:28.791099 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.791080 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 11 06:19:28.792151 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.792136 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bvlll\"" Sep 11 06:19:28.796809 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.796785 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 11 06:19:28.796809 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.796798 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 11 06:19:28.796992 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.796847 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 11 06:19:28.800257 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.800237 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-kcmwr"] Sep 11 06:19:28.804338 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.804320 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.810046 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.810028 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d"] Sep 11 06:19:28.812029 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.812014 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 11 06:19:28.812724 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.812709 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 11 06:19:28.813940 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.813923 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-b72lp\"" Sep 11 06:19:28.814178 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.814166 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 11 06:19:28.814996 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.814977 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 11 06:19:28.832910 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.832887 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-kcmwr"] Sep 11 06:19:28.842693 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.842667 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 11 06:19:28.844643 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.844626 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-trusted-ca-bundle\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.844697 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.844651 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-serving-cert\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.844742 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.844696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxm7d\" (UID: \"621d5ece-3c16-410c-9076-bd6ced92553c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:19:28.844742 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.844727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-service-ca-bundle\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.844833 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.844761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4wkf\" (UniqueName: \"kubernetes.io/projected/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-kube-api-access-n4wkf\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.844883 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.844852 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-snapshots\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.844934 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.844925 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-tmp\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.844996 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.844964 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/621d5ece-3c16-410c-9076-bd6ced92553c-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-nxm7d\" (UID: \"621d5ece-3c16-410c-9076-bd6ced92553c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:19:28.845043 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.844993 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjcxj\" (UniqueName: \"kubernetes.io/projected/621d5ece-3c16-410c-9076-bd6ced92553c-kube-api-access-xjcxj\") pod \"cluster-monitoring-operator-6cd954b897-nxm7d\" (UID: \"621d5ece-3c16-410c-9076-bd6ced92553c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:19:28.946254 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.946217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-trusted-ca-bundle\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.946254 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.946254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-serving-cert\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.946490 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.946313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxm7d\" (UID: \"621d5ece-3c16-410c-9076-bd6ced92553c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:19:28.946490 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.946338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-service-ca-bundle\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.946490 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.946360 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4wkf\" (UniqueName: \"kubernetes.io/projected/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-kube-api-access-n4wkf\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.946490 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.946392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-snapshots\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.946722 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:28.946510 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 11 06:19:28.946722 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:28.946618 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls podName:621d5ece-3c16-410c-9076-bd6ced92553c nodeName:}" failed. No retries permitted until 2026-09-11 06:19:29.44659605 +0000 UTC m=+56.558724290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-nxm7d" (UID: "621d5ece-3c16-410c-9076-bd6ced92553c") : secret "cluster-monitoring-operator-tls" not found Sep 11 06:19:28.946722 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.946668 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-tmp\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.946722 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.946711 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/621d5ece-3c16-410c-9076-bd6ced92553c-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-nxm7d\" (UID: \"621d5ece-3c16-410c-9076-bd6ced92553c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:19:28.947000 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.946739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjcxj\" (UniqueName: \"kubernetes.io/projected/621d5ece-3c16-410c-9076-bd6ced92553c-kube-api-access-xjcxj\") pod \"cluster-monitoring-operator-6cd954b897-nxm7d\" (UID: \"621d5ece-3c16-410c-9076-bd6ced92553c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:19:28.947082 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.947059 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-service-ca-bundle\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.947141 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.947090 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-tmp\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.947192 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.947147 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-snapshots\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.947331 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.947312 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-trusted-ca-bundle\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.947368 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.947352 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/621d5ece-3c16-410c-9076-bd6ced92553c-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-nxm7d\" (UID: \"621d5ece-3c16-410c-9076-bd6ced92553c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:19:28.950139 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.950117 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-serving-cert\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.956221 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.956202 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4wkf\" (UniqueName: \"kubernetes.io/projected/1be16ffd-0ce2-4529-bcf6-91d1be5a385f-kube-api-access-n4wkf\") pod \"insights-operator-5844b856db-kcmwr\" (UID: \"1be16ffd-0ce2-4529-bcf6-91d1be5a385f\") " pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:28.958354 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.958329 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjcxj\" (UniqueName: \"kubernetes.io/projected/621d5ece-3c16-410c-9076-bd6ced92553c-kube-api-access-xjcxj\") pod \"cluster-monitoring-operator-6cd954b897-nxm7d\" (UID: \"621d5ece-3c16-410c-9076-bd6ced92553c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:19:28.966431 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.966410 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689"] Sep 11 06:19:28.972092 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.972075 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn"] Sep 11 06:19:28.972194 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.972179 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689" Sep 11 06:19:28.974825 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.974802 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-s6shw\"" Sep 11 06:19:28.974920 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.974811 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 11 06:19:28.974920 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.974844 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 11 06:19:28.974920 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.974847 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 11 06:19:28.975195 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.975180 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 11 06:19:28.975649 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.975636 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf"] Sep 11 06:19:28.975784 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.975770 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" Sep 11 06:19:28.978090 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.978073 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 11 06:19:28.978449 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.978432 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ghsqd\"" Sep 11 06:19:28.978637 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.978615 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 11 06:19:28.979521 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.979499 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" Sep 11 06:19:28.979636 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.979547 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689"] Sep 11 06:19:28.982318 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.982300 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 11 06:19:28.982464 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.982442 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vwkg9\"" Sep 11 06:19:28.982538 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.982507 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 11 06:19:28.982687 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.982340 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 11 06:19:28.983839 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.983816 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf"] Sep 11 06:19:28.984848 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.984832 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn"] Sep 11 06:19:28.987739 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:28.987717 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:29.048032 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.047970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ff5b\" (UniqueName: \"kubernetes.io/projected/311b609c-ff40-4e19-879f-03694491573c-kube-api-access-8ff5b\") pod \"cluster-samples-operator-86499c89c4-mfctf\" (UID: \"311b609c-ff40-4e19-879f-03694491573c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" Sep 11 06:19:29.048032 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.048007 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81ccae4f-37aa-454a-9b7a-498b90c7db36-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vw689\" (UID: \"81ccae4f-37aa-454a-9b7a-498b90c7db36\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689" Sep 11 06:19:29.048032 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.048031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81ccae4f-37aa-454a-9b7a-498b90c7db36-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vw689\" (UID: \"81ccae4f-37aa-454a-9b7a-498b90c7db36\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689" Sep 11 06:19:29.048254 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.048058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t94lp\" (UniqueName: \"kubernetes.io/projected/81ccae4f-37aa-454a-9b7a-498b90c7db36-kube-api-access-t94lp\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vw689\" (UID: \"81ccae4f-37aa-454a-9b7a-498b90c7db36\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689" Sep 11 06:19:29.048254 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.048107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-qb8kn\" (UID: \"46e3967b-12e9-4d7f-9d6a-d5424edd1ddc\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" Sep 11 06:19:29.048254 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.048206 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-qb8kn\" (UID: \"46e3967b-12e9-4d7f-9d6a-d5424edd1ddc\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" Sep 11 06:19:29.048408 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.048264 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mfctf\" (UID: \"311b609c-ff40-4e19-879f-03694491573c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" Sep 11 06:19:29.086313 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.086285 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:29.112526 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.112500 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-kcmwr" Sep 11 06:19:29.148615 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.148582 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t94lp\" (UniqueName: \"kubernetes.io/projected/81ccae4f-37aa-454a-9b7a-498b90c7db36-kube-api-access-t94lp\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vw689\" (UID: \"81ccae4f-37aa-454a-9b7a-498b90c7db36\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689" Sep 11 06:19:29.148730 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.148633 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-qb8kn\" (UID: \"46e3967b-12e9-4d7f-9d6a-d5424edd1ddc\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" Sep 11 06:19:29.148730 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.148672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-qb8kn\" (UID: \"46e3967b-12e9-4d7f-9d6a-d5424edd1ddc\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" Sep 11 06:19:29.148799 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:29.148764 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 11 06:19:29.148839 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.148818 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mfctf\" (UID: \"311b609c-ff40-4e19-879f-03694491573c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" Sep 11 06:19:29.148839 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:29.148830 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert podName:46e3967b-12e9-4d7f-9d6a-d5424edd1ddc nodeName:}" failed. No retries permitted until 2026-09-11 06:19:29.648811912 +0000 UTC m=+56.760940139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-qb8kn" (UID: "46e3967b-12e9-4d7f-9d6a-d5424edd1ddc") : secret "networking-console-plugin-cert" not found Sep 11 06:19:29.148924 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.148888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ff5b\" (UniqueName: \"kubernetes.io/projected/311b609c-ff40-4e19-879f-03694491573c-kube-api-access-8ff5b\") pod \"cluster-samples-operator-86499c89c4-mfctf\" (UID: \"311b609c-ff40-4e19-879f-03694491573c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" Sep 11 06:19:29.149027 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:29.149000 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 11 06:19:29.149105 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:29.149069 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls podName:311b609c-ff40-4e19-879f-03694491573c nodeName:}" failed. No retries permitted until 2026-09-11 06:19:29.649051282 +0000 UTC m=+56.761179523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-mfctf" (UID: "311b609c-ff40-4e19-879f-03694491573c") : secret "samples-operator-tls" not found Sep 11 06:19:29.149159 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.149103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81ccae4f-37aa-454a-9b7a-498b90c7db36-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vw689\" (UID: \"81ccae4f-37aa-454a-9b7a-498b90c7db36\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689" Sep 11 06:19:29.149211 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.149194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81ccae4f-37aa-454a-9b7a-498b90c7db36-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vw689\" (UID: \"81ccae4f-37aa-454a-9b7a-498b90c7db36\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689" Sep 11 06:19:29.150422 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.149339 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-qb8kn\" (UID: \"46e3967b-12e9-4d7f-9d6a-d5424edd1ddc\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" Sep 11 06:19:29.150422 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.149709 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81ccae4f-37aa-454a-9b7a-498b90c7db36-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vw689\" (UID: \"81ccae4f-37aa-454a-9b7a-498b90c7db36\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689" Sep 11 06:19:29.152051 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.152030 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81ccae4f-37aa-454a-9b7a-498b90c7db36-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vw689\" (UID: \"81ccae4f-37aa-454a-9b7a-498b90c7db36\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689" Sep 11 06:19:29.157500 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.157452 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ff5b\" (UniqueName: \"kubernetes.io/projected/311b609c-ff40-4e19-879f-03694491573c-kube-api-access-8ff5b\") pod \"cluster-samples-operator-86499c89c4-mfctf\" (UID: \"311b609c-ff40-4e19-879f-03694491573c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" Sep 11 06:19:29.157950 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.157928 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t94lp\" (UniqueName: \"kubernetes.io/projected/81ccae4f-37aa-454a-9b7a-498b90c7db36-kube-api-access-t94lp\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vw689\" (UID: \"81ccae4f-37aa-454a-9b7a-498b90c7db36\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689" Sep 11 06:19:29.187605 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.187562 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:29.254339 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.254314 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:29.283443 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.283421 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689" Sep 11 06:19:29.383071 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.383046 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-kcmwr"] Sep 11 06:19:29.385825 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:19:29.385799 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be16ffd_0ce2_4529_bcf6_91d1be5a385f.slice/crio-6e2b9b7c3b798d97f1e82735862774086aeb50544ca2502de1f51cff56b96d67 WatchSource:0}: Error finding container 6e2b9b7c3b798d97f1e82735862774086aeb50544ca2502de1f51cff56b96d67: Status 404 returned error can't find the container with id 6e2b9b7c3b798d97f1e82735862774086aeb50544ca2502de1f51cff56b96d67 Sep 11 06:19:29.452340 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.452312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxm7d\" (UID: \"621d5ece-3c16-410c-9076-bd6ced92553c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:19:29.452448 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:29.452434 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 11 06:19:29.452493 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:29.452487 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls podName:621d5ece-3c16-410c-9076-bd6ced92553c nodeName:}" failed. No retries permitted until 2026-09-11 06:19:30.45247286 +0000 UTC m=+57.564601087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-nxm7d" (UID: "621d5ece-3c16-410c-9076-bd6ced92553c") : secret "cluster-monitoring-operator-tls" not found Sep 11 06:19:29.553664 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.553637 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689"] Sep 11 06:19:29.557081 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:19:29.557059 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81ccae4f_37aa_454a_9b7a_498b90c7db36.slice/crio-0b3bf71dc3c5042864951f7ef53ace0f1be3361b8182b44e0f2f68af8e3ff96c WatchSource:0}: Error finding container 0b3bf71dc3c5042864951f7ef53ace0f1be3361b8182b44e0f2f68af8e3ff96c: Status 404 returned error can't find the container with id 0b3bf71dc3c5042864951f7ef53ace0f1be3361b8182b44e0f2f68af8e3ff96c Sep 11 06:19:29.654078 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.654017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-qb8kn\" (UID: \"46e3967b-12e9-4d7f-9d6a-d5424edd1ddc\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" Sep 11 06:19:29.654078 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.654060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mfctf\" (UID: \"311b609c-ff40-4e19-879f-03694491573c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" Sep 11 06:19:29.654208 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:29.654171 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 11 06:19:29.654208 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:29.654194 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 11 06:19:29.654272 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:29.654229 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert podName:46e3967b-12e9-4d7f-9d6a-d5424edd1ddc nodeName:}" failed. No retries permitted until 2026-09-11 06:19:30.654215019 +0000 UTC m=+57.766343242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-qb8kn" (UID: "46e3967b-12e9-4d7f-9d6a-d5424edd1ddc") : secret "networking-console-plugin-cert" not found Sep 11 06:19:29.654272 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:29.654242 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls podName:311b609c-ff40-4e19-879f-03694491573c nodeName:}" failed. No retries permitted until 2026-09-11 06:19:30.654236879 +0000 UTC m=+57.766365103 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-mfctf" (UID: "311b609c-ff40-4e19-879f-03694491573c") : secret "samples-operator-tls" not found Sep 11 06:19:29.684615 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.684593 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689" event={"ID":"81ccae4f-37aa-454a-9b7a-498b90c7db36","Type":"ContainerStarted","Data":"0b3bf71dc3c5042864951f7ef53ace0f1be3361b8182b44e0f2f68af8e3ff96c"} Sep 11 06:19:29.685663 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:29.685642 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-kcmwr" event={"ID":"1be16ffd-0ce2-4529-bcf6-91d1be5a385f","Type":"ContainerStarted","Data":"6e2b9b7c3b798d97f1e82735862774086aeb50544ca2502de1f51cff56b96d67"} Sep 11 06:19:30.205794 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:30.205755 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:30.261930 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:30.261847 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:30.460727 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:30.460640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxm7d\" (UID: \"621d5ece-3c16-410c-9076-bd6ced92553c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:19:30.460900 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:30.460882 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 11 06:19:30.460979 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:30.460948 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls podName:621d5ece-3c16-410c-9076-bd6ced92553c nodeName:}" failed. No retries permitted until 2026-09-11 06:19:32.460929788 +0000 UTC m=+59.573058025 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-nxm7d" (UID: "621d5ece-3c16-410c-9076-bd6ced92553c") : secret "cluster-monitoring-operator-tls" not found Sep 11 06:19:30.593380 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:30.593342 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:30.662854 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:30.662824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-qb8kn\" (UID: \"46e3967b-12e9-4d7f-9d6a-d5424edd1ddc\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" Sep 11 06:19:30.663021 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:30.662880 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mfctf\" (UID: \"311b609c-ff40-4e19-879f-03694491573c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" Sep 11 06:19:30.663021 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:30.663009 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 11 06:19:30.663126 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:30.663041 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 11 06:19:30.663126 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:30.663085 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert podName:46e3967b-12e9-4d7f-9d6a-d5424edd1ddc nodeName:}" failed. No retries permitted until 2026-09-11 06:19:32.663062637 +0000 UTC m=+59.775190878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-qb8kn" (UID: "46e3967b-12e9-4d7f-9d6a-d5424edd1ddc") : secret "networking-console-plugin-cert" not found Sep 11 06:19:30.663126 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:30.663100 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls podName:311b609c-ff40-4e19-879f-03694491573c nodeName:}" failed. No retries permitted until 2026-09-11 06:19:32.663093886 +0000 UTC m=+59.775222110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-mfctf" (UID: "311b609c-ff40-4e19-879f-03694491573c") : secret "samples-operator-tls" not found Sep 11 06:19:30.693985 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:30.693948 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:32.477989 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.477955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxm7d\" (UID: \"621d5ece-3c16-410c-9076-bd6ced92553c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:19:32.478423 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:32.478078 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 11 06:19:32.478423 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:32.478140 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls podName:621d5ece-3c16-410c-9076-bd6ced92553c nodeName:}" failed. No retries permitted until 2026-09-11 06:19:36.478125729 +0000 UTC m=+63.590253958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-nxm7d" (UID: "621d5ece-3c16-410c-9076-bd6ced92553c") : secret "cluster-monitoring-operator-tls" not found Sep 11 06:19:32.496806 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.496769 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:32.510894 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.510859 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6r98r"] Sep 11 06:19:32.546125 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.546096 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6r98r"] Sep 11 06:19:32.546278 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.546214 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:32.548512 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.548489 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cs4hr\"" Sep 11 06:19:32.548776 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.548749 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 11 06:19:32.549695 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.549474 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 11 06:19:32.568949 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.568928 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:32.578861 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.578842 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:32.578925 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.578893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-crio-socket\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:32.578966 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.578953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6bs6\" (UniqueName: \"kubernetes.io/projected/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-api-access-h6bs6\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:32.578997 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.578974 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-data-volume\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:32.579032 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.579011 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:32.679968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.679939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:32.680084 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.679982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-crio-socket\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:32.680084 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.680004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-qb8kn\" (UID: \"46e3967b-12e9-4d7f-9d6a-d5424edd1ddc\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" Sep 11 06:19:32.680084 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.680036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mfctf\" (UID: \"311b609c-ff40-4e19-879f-03694491573c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" Sep 11 06:19:32.680084 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.680062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6bs6\" (UniqueName: \"kubernetes.io/projected/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-api-access-h6bs6\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:32.680084 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.680084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-data-volume\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:32.680303 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.680082 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-crio-socket\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:32.680303 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:32.680095 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 11 06:19:32.680303 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:32.680095 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 06:19:32.680303 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:32.680152 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 11 06:19:32.680303 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:32.680165 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls podName:e7977cda-d1fc-4a6b-90c8-6a034606d0fb nodeName:}" failed. No retries permitted until 2026-09-11 06:19:33.180145028 +0000 UTC m=+60.292273266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6r98r" (UID: "e7977cda-d1fc-4a6b-90c8-6a034606d0fb") : secret "insights-runtime-extractor-tls" not found Sep 11 06:19:32.680303 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:32.680182 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert podName:46e3967b-12e9-4d7f-9d6a-d5424edd1ddc nodeName:}" failed. No retries permitted until 2026-09-11 06:19:36.680172796 +0000 UTC m=+63.792301034 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-qb8kn" (UID: "46e3967b-12e9-4d7f-9d6a-d5424edd1ddc") : secret "networking-console-plugin-cert" not found Sep 11 06:19:32.680303 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.680217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:32.680303 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:32.680246 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls podName:311b609c-ff40-4e19-879f-03694491573c nodeName:}" failed. No retries permitted until 2026-09-11 06:19:36.680222466 +0000 UTC m=+63.792350702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-mfctf" (UID: "311b609c-ff40-4e19-879f-03694491573c") : secret "samples-operator-tls" not found Sep 11 06:19:32.680303 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:32.680258 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 06:19:32.680649 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:32.680342 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm podName:e7977cda-d1fc-4a6b-90c8-6a034606d0fb nodeName:}" failed. No retries permitted until 2026-09-11 06:19:33.180325313 +0000 UTC m=+60.292453565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6r98r" (UID: "e7977cda-d1fc-4a6b-90c8-6a034606d0fb") : configmap "kube-rbac-proxy" not found Sep 11 06:19:32.680649 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.680445 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-data-volume\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:32.690331 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.690306 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6bs6\" (UniqueName: \"kubernetes.io/projected/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-api-access-h6bs6\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:32.700492 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.700455 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-kcmwr" event={"ID":"1be16ffd-0ce2-4529-bcf6-91d1be5a385f","Type":"ContainerStarted","Data":"9093c5daff29a2609ec9b4e7fac3d265c87ac118a3d781efa2c8512fe4447f31"} Sep 11 06:19:32.701994 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.701973 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689" event={"ID":"81ccae4f-37aa-454a-9b7a-498b90c7db36","Type":"ContainerStarted","Data":"21ba2a3e36f3b79dfe0c5a0aac9518fa2523e33f46e3c1d840564387677725f1"} Sep 11 06:19:32.716817 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.716763 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-kcmwr" podStartSLOduration=2.417988496 podStartE2EDuration="4.716751058s" totalImagesPullingTime="2.298762562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:19:32.715454186 +0000 UTC m=+59.827582434" watchObservedRunningTime="2026-09-11 06:19:32.716751058 +0000 UTC m=+59.828879303" Sep 11 06:19:32.730946 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:32.730879 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689" podStartSLOduration=2.600726683 podStartE2EDuration="4.73086801s" totalImagesPullingTime="2.130141327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:19:32.730139483 +0000 UTC m=+59.842267730" watchObservedRunningTime="2026-09-11 06:19:32.73086801 +0000 UTC m=+59.842996255" Sep 11 06:19:33.185364 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:33.185318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:33.185558 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:33.185413 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:33.185558 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:33.185445 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 06:19:33.185558 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:33.185515 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm podName:e7977cda-d1fc-4a6b-90c8-6a034606d0fb nodeName:}" failed. No retries permitted until 2026-09-11 06:19:34.18549249 +0000 UTC m=+61.297620714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6r98r" (UID: "e7977cda-d1fc-4a6b-90c8-6a034606d0fb") : configmap "kube-rbac-proxy" not found Sep 11 06:19:33.185759 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:33.185604 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 06:19:33.185759 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:33.185674 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls podName:e7977cda-d1fc-4a6b-90c8-6a034606d0fb nodeName:}" failed. No retries permitted until 2026-09-11 06:19:34.185656389 +0000 UTC m=+61.297784628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6r98r" (UID: "e7977cda-d1fc-4a6b-90c8-6a034606d0fb") : secret "insights-runtime-extractor-tls" not found Sep 11 06:19:34.055408 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:34.055187 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:34.168715 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:34.168673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:34.193663 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:34.193636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:34.193772 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:34.193718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:34.193772 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:34.193747 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 06:19:34.193851 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:34.193810 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm podName:e7977cda-d1fc-4a6b-90c8-6a034606d0fb nodeName:}" failed. No retries permitted until 2026-09-11 06:19:36.193792172 +0000 UTC m=+63.305920409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6r98r" (UID: "e7977cda-d1fc-4a6b-90c8-6a034606d0fb") : configmap "kube-rbac-proxy" not found Sep 11 06:19:34.193908 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:34.193891 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 06:19:34.193956 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:34.193945 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls podName:e7977cda-d1fc-4a6b-90c8-6a034606d0fb nodeName:}" failed. No retries permitted until 2026-09-11 06:19:36.193929848 +0000 UTC m=+63.306058077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6r98r" (UID: "e7977cda-d1fc-4a6b-90c8-6a034606d0fb") : secret "insights-runtime-extractor-tls" not found Sep 11 06:19:34.233471 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:34.233435 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:34.329766 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:34.329733 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:34.389165 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:34.389131 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:34.652103 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:34.652034 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lzqnp_a2f7b95d-3f2a-4c11-a467-c3d3e6badf84/dns-node-resolver/0.log" Sep 11 06:19:35.188843 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:35.188818 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkzwh" Sep 11 06:19:35.335466 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:35.335415 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:35.435779 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:35.435742 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:35.452218 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:35.452168 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s5kw4_f03ec2fa-ca46-4d35-aa87-bad491b6fa58/node-ca/0.log" Sep 11 06:19:35.548204 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:35.548161 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:35.629041 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:35.629003 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:35.941560 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:35.941526 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:35.993266 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:35.993230 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:36.210342 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:36.210263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:36.210725 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:36.210399 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:36.210725 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:36.210418 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 06:19:36.210725 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:36.210486 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 06:19:36.210725 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:36.210505 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls podName:e7977cda-d1fc-4a6b-90c8-6a034606d0fb nodeName:}" failed. No retries permitted until 2026-09-11 06:19:40.210485447 +0000 UTC m=+67.322613686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6r98r" (UID: "e7977cda-d1fc-4a6b-90c8-6a034606d0fb") : secret "insights-runtime-extractor-tls" not found Sep 11 06:19:36.210725 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:36.210523 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm podName:e7977cda-d1fc-4a6b-90c8-6a034606d0fb nodeName:}" failed. No retries permitted until 2026-09-11 06:19:40.210513153 +0000 UTC m=+67.322641377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6r98r" (UID: "e7977cda-d1fc-4a6b-90c8-6a034606d0fb") : configmap "kube-rbac-proxy" not found Sep 11 06:19:36.218888 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:36.218860 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:36.252125 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:36.252092 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ln8dz_edc8ff17-b5a6-438b-8065-36b26e4c6da8/serve-healthcheck-canary/0.log" Sep 11 06:19:36.281550 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:36.281517 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:36.512380 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:36.512306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxm7d\" (UID: \"621d5ece-3c16-410c-9076-bd6ced92553c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:19:36.512503 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:36.512452 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 11 06:19:36.512544 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:36.512523 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls podName:621d5ece-3c16-410c-9076-bd6ced92553c nodeName:}" failed. No retries permitted until 2026-09-11 06:19:44.512507611 +0000 UTC m=+71.624635839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-nxm7d" (UID: "621d5ece-3c16-410c-9076-bd6ced92553c") : secret "cluster-monitoring-operator-tls" not found Sep 11 06:19:36.714066 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:36.714034 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-qb8kn\" (UID: \"46e3967b-12e9-4d7f-9d6a-d5424edd1ddc\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" Sep 11 06:19:36.714250 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:36.714079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mfctf\" (UID: \"311b609c-ff40-4e19-879f-03694491573c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" Sep 11 06:19:36.714250 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:36.714207 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 11 06:19:36.714367 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:36.714251 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 11 06:19:36.714367 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:36.714282 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert podName:46e3967b-12e9-4d7f-9d6a-d5424edd1ddc nodeName:}" failed. No retries permitted until 2026-09-11 06:19:44.714262412 +0000 UTC m=+71.826390645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-qb8kn" (UID: "46e3967b-12e9-4d7f-9d6a-d5424edd1ddc") : secret "networking-console-plugin-cert" not found Sep 11 06:19:36.714367 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:36.714307 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls podName:311b609c-ff40-4e19-879f-03694491573c nodeName:}" failed. No retries permitted until 2026-09-11 06:19:44.714293067 +0000 UTC m=+71.826421318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-mfctf" (UID: "311b609c-ff40-4e19-879f-03694491573c") : secret "samples-operator-tls" not found Sep 11 06:19:37.563906 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:37.563865 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:37.664426 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:37.664400 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:37.853412 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:37.853367 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:37.904209 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:37.904178 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:38.833077 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:38.833045 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:39.134345 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.134268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9xdv\" (UniqueName: \"kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv\") pod \"network-check-target-p8qtr\" (UID: \"45161465-23cb-40f9-b682-809e7aeef6ac\") " pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:19:39.134345 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.134342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs\") pod \"network-metrics-daemon-7mpnr\" (UID: \"b5bab53c-ef28-4f24-a84e-640462c08884\") " pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:19:39.136991 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.136974 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 06:19:39.137359 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.137345 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 06:19:39.145340 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:39.145323 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 11 06:19:39.145393 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:39.145382 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs podName:b5bab53c-ef28-4f24-a84e-640462c08884 nodeName:}" failed. No retries permitted until 2026-09-11 06:20:43.145363972 +0000 UTC m=+130.257492196 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs") pod "network-metrics-daemon-7mpnr" (UID: "b5bab53c-ef28-4f24-a84e-640462c08884") : secret "metrics-daemon-secret" not found Sep 11 06:19:39.148842 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.148827 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 06:19:39.158212 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.158187 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9xdv\" (UniqueName: \"kubernetes.io/projected/45161465-23cb-40f9-b682-809e7aeef6ac-kube-api-access-h9xdv\") pod \"network-check-target-p8qtr\" (UID: \"45161465-23cb-40f9-b682-809e7aeef6ac\") " pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:19:39.181926 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.181906 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wd9pv\"" Sep 11 06:19:39.188783 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.188765 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:19:39.234916 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.234886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret\") pod \"global-pull-secret-syncer-db87s\" (UID: \"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6\") " pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:19:39.237587 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.237551 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 06:19:39.247936 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.247911 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6-original-pull-secret\") pod \"global-pull-secret-syncer-db87s\" (UID: \"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6\") " pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:19:39.405210 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.405141 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db87s" Sep 11 06:19:39.462842 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.462816 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p8qtr"] Sep 11 06:19:39.465736 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:19:39.465712 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45161465_23cb_40f9_b682_809e7aeef6ac.slice/crio-10e97a9c0a3c2efcf371da31e9e74a210a56ff05a9835ae71d6eae6047969d32 WatchSource:0}: Error finding container 10e97a9c0a3c2efcf371da31e9e74a210a56ff05a9835ae71d6eae6047969d32: Status 404 returned error can't find the container with id 10e97a9c0a3c2efcf371da31e9e74a210a56ff05a9835ae71d6eae6047969d32 Sep 11 06:19:39.638730 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.638701 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:19:39.638882 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:39.638844 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 06:19:39.638882 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:39.638864 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dbf9f4985-jrffd: secret "image-registry-tls" not found Sep 11 06:19:39.638959 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:39.638917 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls podName:9bcd50b4-7f99-459e-a437-522b717cff0a nodeName:}" failed. No retries permitted until 2026-09-11 06:20:11.638902247 +0000 UTC m=+98.751030489 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls") pod "image-registry-7dbf9f4985-jrffd" (UID: "9bcd50b4-7f99-459e-a437-522b717cff0a") : secret "image-registry-tls" not found Sep 11 06:19:39.713044 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.712977 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-db87s"] Sep 11 06:19:39.715900 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:19:39.715872 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2ecfe5_716f_4fd8_93d4_fa48cbc38cc6.slice/crio-800c173ac2cfe951ba6677298dc8b698d211ce0bc730cb4fb5ec9fefe273901d WatchSource:0}: Error finding container 800c173ac2cfe951ba6677298dc8b698d211ce0bc730cb4fb5ec9fefe273901d: Status 404 returned error can't find the container with id 800c173ac2cfe951ba6677298dc8b698d211ce0bc730cb4fb5ec9fefe273901d Sep 11 06:19:39.719048 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.719020 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p8qtr" event={"ID":"45161465-23cb-40f9-b682-809e7aeef6ac","Type":"ContainerStarted","Data":"10e97a9c0a3c2efcf371da31e9e74a210a56ff05a9835ae71d6eae6047969d32"} Sep 11 06:19:39.740025 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:39.739998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:19:39.740114 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:39.740102 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 06:19:39.740182 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:39.740173 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls podName:6135cb51-9023-4dd4-bafa-ee4e4a6a667d nodeName:}" failed. No retries permitted until 2026-09-11 06:20:11.740159679 +0000 UTC m=+98.852287903 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls") pod "dns-default-8ns64" (UID: "6135cb51-9023-4dd4-bafa-ee4e4a6a667d") : secret "dns-default-metrics-tls" not found Sep 11 06:19:40.243253 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:40.243209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:40.243674 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:40.243360 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 06:19:40.243674 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:40.243372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:40.243674 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:40.243449 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls podName:e7977cda-d1fc-4a6b-90c8-6a034606d0fb nodeName:}" failed. No retries permitted until 2026-09-11 06:19:48.24342912 +0000 UTC m=+75.355557357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6r98r" (UID: "e7977cda-d1fc-4a6b-90c8-6a034606d0fb") : secret "insights-runtime-extractor-tls" not found Sep 11 06:19:40.243674 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:40.243452 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 06:19:40.243674 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:40.243505 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm podName:e7977cda-d1fc-4a6b-90c8-6a034606d0fb nodeName:}" failed. No retries permitted until 2026-09-11 06:19:48.243491907 +0000 UTC m=+75.355620135 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6r98r" (UID: "e7977cda-d1fc-4a6b-90c8-6a034606d0fb") : configmap "kube-rbac-proxy" not found Sep 11 06:19:40.723997 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:40.723953 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-db87s" event={"ID":"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6","Type":"ContainerStarted","Data":"800c173ac2cfe951ba6677298dc8b698d211ce0bc730cb4fb5ec9fefe273901d"} Sep 11 06:19:42.002450 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:42.002409 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:42.163353 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:42.163319 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:42.264547 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:42.264388 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:42.365261 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:42.365188 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:42.464603 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:42.464552 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:42.570058 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:42.569977 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:43.103792 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:43.103745 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:43.710965 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:43.710924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:43.898363 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:43.898328 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:44.131144 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:44.131098 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:44.496348 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:44.496304 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:44.582712 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:44.582680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxm7d\" (UID: \"621d5ece-3c16-410c-9076-bd6ced92553c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:19:44.582864 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:44.582825 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 11 06:19:44.582934 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:44.582888 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls podName:621d5ece-3c16-410c-9076-bd6ced92553c nodeName:}" failed. No retries permitted until 2026-09-11 06:20:00.582871591 +0000 UTC m=+87.694999816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-nxm7d" (UID: "621d5ece-3c16-410c-9076-bd6ced92553c") : secret "cluster-monitoring-operator-tls" not found Sep 11 06:19:44.735812 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:44.735775 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p8qtr" event={"ID":"45161465-23cb-40f9-b682-809e7aeef6ac","Type":"ContainerStarted","Data":"5abd302442bf2ad890724b0d706456eb731cbc9dd4e3b80e76483cc3e5146c05"} Sep 11 06:19:44.735963 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:44.735843 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:19:44.737277 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:44.737252 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-db87s" event={"ID":"7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6","Type":"ContainerStarted","Data":"dc8c59e35922ea49b862bb1368cdc5f10e69fc57e86111f1948fdec1bc9da066"} Sep 11 06:19:44.750674 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:44.750584 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p8qtr" podStartSLOduration=67.199968876 podStartE2EDuration="1m11.750550836s" totalImagesPullingTime="4.55058196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:19:44.750463227 +0000 UTC m=+71.862591473" watchObservedRunningTime="2026-09-11 06:19:44.750550836 +0000 UTC m=+71.862679064" Sep 11 06:19:44.766769 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:44.766727 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-db87s" podStartSLOduration=66.462153992 podStartE2EDuration="1m10.766712978s" totalImagesPullingTime="4.304558986s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 06:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:19:44.765480645 +0000 UTC m=+71.877608895" watchObservedRunningTime="2026-09-11 06:19:44.766712978 +0000 UTC m=+71.878841223" Sep 11 06:19:44.784437 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:44.784407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-qb8kn\" (UID: \"46e3967b-12e9-4d7f-9d6a-d5424edd1ddc\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" Sep 11 06:19:44.784557 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:44.784464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mfctf\" (UID: \"311b609c-ff40-4e19-879f-03694491573c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" Sep 11 06:19:44.784638 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:44.784556 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 11 06:19:44.784673 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:44.784647 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert podName:46e3967b-12e9-4d7f-9d6a-d5424edd1ddc nodeName:}" failed. No retries permitted until 2026-09-11 06:20:00.784628817 +0000 UTC m=+87.896757054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-qb8kn" (UID: "46e3967b-12e9-4d7f-9d6a-d5424edd1ddc") : secret "networking-console-plugin-cert" not found Sep 11 06:19:44.787138 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:44.787116 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/311b609c-ff40-4e19-879f-03694491573c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mfctf\" (UID: \"311b609c-ff40-4e19-879f-03694491573c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" Sep 11 06:19:44.897563 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:44.897535 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vwkg9\"" Sep 11 06:19:44.906288 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:44.906256 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" Sep 11 06:19:45.174722 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:45.174692 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf"] Sep 11 06:19:45.298785 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:45.298754 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:45.505384 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:45.505294 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:45.690634 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:45.690598 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:45.741064 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:45.741032 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" event={"ID":"311b609c-ff40-4e19-879f-03694491573c","Type":"ContainerStarted","Data":"75a758e6dc23683236e2e1be9b1cae0dd4120dba217efd2e91834472e42ae3e9"} Sep 11 06:19:45.790467 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:45.790390 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:45.898116 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:45.898087 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:46.202867 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:46.202833 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:46.897863 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:46.897836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:46.994939 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:46.994855 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:47.293182 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:47.293100 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:47.500303 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:47.500273 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:47.692948 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:47.692917 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:47.747948 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:47.747920 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" event={"ID":"311b609c-ff40-4e19-879f-03694491573c","Type":"ContainerStarted","Data":"1b4d1033381e8b6f858e2d9b7e63291f3c0707ac982e7208895480eea8f7b298"} Sep 11 06:19:47.748099 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:47.747974 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" event={"ID":"311b609c-ff40-4e19-879f-03694491573c","Type":"ContainerStarted","Data":"ab3215fdada937d0de3245fa4a81503403811a7da73dfe10bccd17aa6277b018"} Sep 11 06:19:47.762962 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:47.762916 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mfctf" podStartSLOduration=18.256813741 podStartE2EDuration="19.762902603s" totalImagesPullingTime="1.506088862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:19:47.762502343 +0000 UTC m=+74.874630591" watchObservedRunningTime="2026-09-11 06:19:47.762902603 +0000 UTC m=+74.875030871" Sep 11 06:19:47.898928 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:47.898894 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:48.313715 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:48.313681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:48.314241 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:48.313777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:48.314241 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:48.313850 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 06:19:48.314241 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:19:48.313938 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls podName:e7977cda-d1fc-4a6b-90c8-6a034606d0fb nodeName:}" failed. No retries permitted until 2026-09-11 06:20:04.313916827 +0000 UTC m=+91.426045055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6r98r" (UID: "e7977cda-d1fc-4a6b-90c8-6a034606d0fb") : secret "insights-runtime-extractor-tls" not found Sep 11 06:19:48.314241 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:48.314191 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:19:48.396473 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:48.396444 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:48.900548 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:48.900517 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:49.304815 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:49.304722 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:49.503335 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:49.503300 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:49.696110 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:49.696081 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:49.894012 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:49.893976 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:49.948212 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:49.948141 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:50.892829 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:50.892793 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:51.095586 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:51.095537 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:51.496931 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:51.496900 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:51.697859 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:51.697819 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:52.093019 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:52.092986 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:52.495593 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:52.495502 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:52.694771 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:52.694733 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:55.815621 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:55.815471 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:55.916598 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:55.916550 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:57.623657 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.623624 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh"] Sep 11 06:19:57.627677 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.627661 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh" Sep 11 06:19:57.630074 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.630052 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 11 06:19:57.631006 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.630988 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 11 06:19:57.631102 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.631062 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 11 06:19:57.631102 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.631082 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 11 06:19:57.637628 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.637607 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh"] Sep 11 06:19:57.744794 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.744768 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:57.785960 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.785934 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/28f4737c-d2e4-4784-90f0-6e2d2a8ab507-klusterlet-config\") pod \"klusterlet-addon-workmgr-585f7bffd8-xb2lh\" (UID: \"28f4737c-d2e4-4784-90f0-6e2d2a8ab507\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh" Sep 11 06:19:57.786067 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.786042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qfp9\" (UniqueName: \"kubernetes.io/projected/28f4737c-d2e4-4784-90f0-6e2d2a8ab507-kube-api-access-5qfp9\") pod \"klusterlet-addon-workmgr-585f7bffd8-xb2lh\" (UID: \"28f4737c-d2e4-4784-90f0-6e2d2a8ab507\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh" Sep 11 06:19:57.786128 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.786077 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28f4737c-d2e4-4784-90f0-6e2d2a8ab507-tmp\") pod \"klusterlet-addon-workmgr-585f7bffd8-xb2lh\" (UID: \"28f4737c-d2e4-4784-90f0-6e2d2a8ab507\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh" Sep 11 06:19:57.849106 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.849081 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:57.886941 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.886883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28f4737c-d2e4-4784-90f0-6e2d2a8ab507-tmp\") pod \"klusterlet-addon-workmgr-585f7bffd8-xb2lh\" (UID: \"28f4737c-d2e4-4784-90f0-6e2d2a8ab507\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh" Sep 11 06:19:57.887049 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.886939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/28f4737c-d2e4-4784-90f0-6e2d2a8ab507-klusterlet-config\") pod \"klusterlet-addon-workmgr-585f7bffd8-xb2lh\" (UID: \"28f4737c-d2e4-4784-90f0-6e2d2a8ab507\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh" Sep 11 06:19:57.887110 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.887039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qfp9\" (UniqueName: \"kubernetes.io/projected/28f4737c-d2e4-4784-90f0-6e2d2a8ab507-kube-api-access-5qfp9\") pod \"klusterlet-addon-workmgr-585f7bffd8-xb2lh\" (UID: \"28f4737c-d2e4-4784-90f0-6e2d2a8ab507\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh" Sep 11 06:19:57.887275 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.887256 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28f4737c-d2e4-4784-90f0-6e2d2a8ab507-tmp\") pod \"klusterlet-addon-workmgr-585f7bffd8-xb2lh\" (UID: \"28f4737c-d2e4-4784-90f0-6e2d2a8ab507\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh" Sep 11 06:19:57.889657 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.889637 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/28f4737c-d2e4-4784-90f0-6e2d2a8ab507-klusterlet-config\") pod \"klusterlet-addon-workmgr-585f7bffd8-xb2lh\" (UID: \"28f4737c-d2e4-4784-90f0-6e2d2a8ab507\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh" Sep 11 06:19:57.899007 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.898986 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qfp9\" (UniqueName: \"kubernetes.io/projected/28f4737c-d2e4-4784-90f0-6e2d2a8ab507-kube-api-access-5qfp9\") pod \"klusterlet-addon-workmgr-585f7bffd8-xb2lh\" (UID: \"28f4737c-d2e4-4784-90f0-6e2d2a8ab507\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh" Sep 11 06:19:57.936270 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.936252 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh" Sep 11 06:19:57.936386 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:57.936362 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:58.036788 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:58.036752 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:19:58.203300 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:58.203233 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh"] Sep 11 06:19:58.205975 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:19:58.205953 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f4737c_d2e4_4784_90f0_6e2d2a8ab507.slice/crio-4e41fdd40d520267e6defc6af6658c4cc645292688e1fa7c5ff7fb7a4fccac75 WatchSource:0}: Error finding container 4e41fdd40d520267e6defc6af6658c4cc645292688e1fa7c5ff7fb7a4fccac75: Status 404 returned error can't find the container with id 4e41fdd40d520267e6defc6af6658c4cc645292688e1fa7c5ff7fb7a4fccac75 Sep 11 06:19:58.786156 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:19:58.786086 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh" event={"ID":"28f4737c-d2e4-4784-90f0-6e2d2a8ab507","Type":"ContainerStarted","Data":"4e41fdd40d520267e6defc6af6658c4cc645292688e1fa7c5ff7fb7a4fccac75"} Sep 11 06:20:00.612854 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:00.612818 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxm7d\" (UID: \"621d5ece-3c16-410c-9076-bd6ced92553c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:20:00.615359 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:00.615334 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/621d5ece-3c16-410c-9076-bd6ced92553c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-nxm7d\" (UID: \"621d5ece-3c16-410c-9076-bd6ced92553c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:20:00.814988 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:00.814949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-qb8kn\" (UID: \"46e3967b-12e9-4d7f-9d6a-d5424edd1ddc\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" Sep 11 06:20:00.817754 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:00.817724 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46e3967b-12e9-4d7f-9d6a-d5424edd1ddc-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-qb8kn\" (UID: \"46e3967b-12e9-4d7f-9d6a-d5424edd1ddc\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" Sep 11 06:20:00.901110 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:00.901031 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bvlll\"" Sep 11 06:20:00.909082 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:00.909058 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" Sep 11 06:20:01.092623 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:01.092592 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ghsqd\"" Sep 11 06:20:01.101338 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:01.101305 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" Sep 11 06:20:01.797458 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:01.797426 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh" event={"ID":"28f4737c-d2e4-4784-90f0-6e2d2a8ab507","Type":"ContainerStarted","Data":"6d80b639fc087354d115afcebe41ada872e321d6a0130bc672a10b2cc52f6a39"} Sep 11 06:20:01.797879 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:01.797711 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh" Sep 11 06:20:01.798970 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:01.798948 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh" Sep 11 06:20:01.817414 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:01.815194 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-585f7bffd8-xb2lh" podStartSLOduration=1.357627956 podStartE2EDuration="4.815169778s" totalImagesPullingTime="3.457541822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:19:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:20:01.813350697 +0000 UTC m=+88.925478943" watchObservedRunningTime="2026-09-11 06:20:01.815169778 +0000 UTC m=+88.927298025" Sep 11 06:20:01.836600 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:01.836561 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn"] Sep 11 06:20:01.839850 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:01.839830 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d"] Sep 11 06:20:01.840145 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:20:01.840124 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46e3967b_12e9_4d7f_9d6a_d5424edd1ddc.slice/crio-3410a1957386febb3157979b03438f9e60fa48b6f0782d196a0c7184e809576c WatchSource:0}: Error finding container 3410a1957386febb3157979b03438f9e60fa48b6f0782d196a0c7184e809576c: Status 404 returned error can't find the container with id 3410a1957386febb3157979b03438f9e60fa48b6f0782d196a0c7184e809576c Sep 11 06:20:01.843896 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:20:01.843870 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod621d5ece_3c16_410c_9076_bd6ced92553c.slice/crio-02c16bfd2d70703ebd64960650cba5b68fbdaa42cb12032a91990d249567d3f0 WatchSource:0}: Error finding container 02c16bfd2d70703ebd64960650cba5b68fbdaa42cb12032a91990d249567d3f0: Status 404 returned error can't find the container with id 02c16bfd2d70703ebd64960650cba5b68fbdaa42cb12032a91990d249567d3f0 Sep 11 06:20:02.803341 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:02.803290 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" event={"ID":"621d5ece-3c16-410c-9076-bd6ced92553c","Type":"ContainerStarted","Data":"02c16bfd2d70703ebd64960650cba5b68fbdaa42cb12032a91990d249567d3f0"} Sep 11 06:20:02.805124 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:02.805084 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" event={"ID":"46e3967b-12e9-4d7f-9d6a-d5424edd1ddc","Type":"ContainerStarted","Data":"3410a1957386febb3157979b03438f9e60fa48b6f0782d196a0c7184e809576c"} Sep 11 06:20:03.810291 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:03.810252 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" event={"ID":"46e3967b-12e9-4d7f-9d6a-d5424edd1ddc","Type":"ContainerStarted","Data":"1a984f3d210cd8a1177ca3cd5e0295d4d50aef9252b72287c89db1c814656472"} Sep 11 06:20:03.824609 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:03.824545 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-qb8kn" podStartSLOduration=34.521484696 podStartE2EDuration="35.824526795s" totalImagesPullingTime="1.303042099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:20:03.824134931 +0000 UTC m=+90.936263178" watchObservedRunningTime="2026-09-11 06:20:03.824526795 +0000 UTC m=+90.936655046" Sep 11 06:20:03.925418 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:03.925357 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:04.026850 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:04.026811 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:04.230979 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:04.230942 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:04.342604 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:04.342554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:20:04.345595 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:04.345550 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e7977cda-d1fc-4a6b-90c8-6a034606d0fb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6r98r\" (UID: \"e7977cda-d1fc-4a6b-90c8-6a034606d0fb\") " pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:20:04.359909 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:04.359885 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cs4hr\"" Sep 11 06:20:04.367949 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:04.367927 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6r98r" Sep 11 06:20:04.409363 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:04.409327 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:04.463329 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:04.463293 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:04.639513 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:04.639491 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6r98r"] Sep 11 06:20:04.642588 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:20:04.642550 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7977cda_d1fc_4a6b_90c8_6a034606d0fb.slice/crio-c8039e4d249400b10edd165e76d0fd6980c6b7f0939b3358dbb9a6be46ab05fd WatchSource:0}: Error finding container c8039e4d249400b10edd165e76d0fd6980c6b7f0939b3358dbb9a6be46ab05fd: Status 404 returned error can't find the container with id c8039e4d249400b10edd165e76d0fd6980c6b7f0939b3358dbb9a6be46ab05fd Sep 11 06:20:04.668035 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:04.668008 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:04.763502 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:04.763473 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:04.814717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:04.814689 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6r98r" event={"ID":"e7977cda-d1fc-4a6b-90c8-6a034606d0fb","Type":"ContainerStarted","Data":"20cb4f0252e642f5398657c4492aae820682790004c6c216e6baed7ad637cdce"} Sep 11 06:20:04.815144 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:04.814752 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6r98r" event={"ID":"e7977cda-d1fc-4a6b-90c8-6a034606d0fb","Type":"ContainerStarted","Data":"c8039e4d249400b10edd165e76d0fd6980c6b7f0939b3358dbb9a6be46ab05fd"} Sep 11 06:20:04.815992 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:04.815961 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:04.816423 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:04.816402 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" event={"ID":"621d5ece-3c16-410c-9076-bd6ced92553c","Type":"ContainerStarted","Data":"42b5935e9684e5368d8e5f36b101ccec0258e6b9916eca040cdd8ebbcb15bc69"} Sep 11 06:20:04.832550 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:04.832509 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-nxm7d" podStartSLOduration=34.765879218 podStartE2EDuration="36.832496156s" totalImagesPullingTime="2.066616938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:20:04.831792815 +0000 UTC m=+91.943921061" watchObservedRunningTime="2026-09-11 06:20:04.832496156 +0000 UTC m=+91.944624399" Sep 11 06:20:05.821743 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:05.821710 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6r98r" event={"ID":"e7977cda-d1fc-4a6b-90c8-6a034606d0fb","Type":"ContainerStarted","Data":"2361f4a401fed090f68715bb0417b430dc577c2561a15c013abacdd046cae410"} Sep 11 06:20:07.397375 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:07.397345 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:07.451457 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:07.451428 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:07.830062 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:07.830025 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6r98r" event={"ID":"e7977cda-d1fc-4a6b-90c8-6a034606d0fb","Type":"ContainerStarted","Data":"e0adf7c456c2cc7849fccb9c6fb89033497245314ceac352af35b7314cf4eb69"} Sep 11 06:20:07.848340 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:07.848295 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6r98r" podStartSLOduration=33.649310603 podStartE2EDuration="35.848277397s" totalImagesPullingTime="2.198966794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 06:19:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:20:07.847407845 +0000 UTC m=+94.959536085" watchObservedRunningTime="2026-09-11 06:20:07.848277397 +0000 UTC m=+94.960405625" Sep 11 06:20:08.405992 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:08.405957 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:08.467269 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:08.467233 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:08.804117 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:08.804016 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:10.075988 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:10.075959 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:10.126397 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:10.126371 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:11.379422 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:11.379376 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:11.700982 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:11.700901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:20:11.703199 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:11.703181 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls\") pod \"image-registry-7dbf9f4985-jrffd\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:20:11.708682 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:11.708657 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jkxq6\"" Sep 11 06:20:11.716651 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:11.716633 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:20:11.802061 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:11.802033 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:20:11.804284 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:11.804259 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6135cb51-9023-4dd4-bafa-ee4e4a6a667d-metrics-tls\") pod \"dns-default-8ns64\" (UID: \"6135cb51-9023-4dd4-bafa-ee4e4a6a667d\") " pod="openshift-dns/dns-default-8ns64" Sep 11 06:20:11.988897 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:11.988820 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dbf9f4985-jrffd"] Sep 11 06:20:11.991893 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:20:11.991867 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bcd50b4_7f99_459e_a437_522b717cff0a.slice/crio-f07b709ae2f04dbbad82b03d84969ffd3703564aaac36bd09fd6b8f9767a2680 WatchSource:0}: Error finding container f07b709ae2f04dbbad82b03d84969ffd3703564aaac36bd09fd6b8f9767a2680: Status 404 returned error can't find the container with id f07b709ae2f04dbbad82b03d84969ffd3703564aaac36bd09fd6b8f9767a2680 Sep 11 06:20:12.022543 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.022523 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-924b2\"" Sep 11 06:20:12.030274 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.030253 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8ns64" Sep 11 06:20:12.298976 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.298900 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8ns64"] Sep 11 06:20:12.301469 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:20:12.301445 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6135cb51_9023_4dd4_bafa_ee4e4a6a667d.slice/crio-d5d97b3ceab4379a5e75a1999f6a00e340a755a0de03933f10984afac4ab193f WatchSource:0}: Error finding container d5d97b3ceab4379a5e75a1999f6a00e340a755a0de03933f10984afac4ab193f: Status 404 returned error can't find the container with id d5d97b3ceab4379a5e75a1999f6a00e340a755a0de03933f10984afac4ab193f Sep 11 06:20:12.543154 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.543119 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:12.751361 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.751329 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:12.775247 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.775214 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925"] Sep 11 06:20:12.779895 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.779875 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" Sep 11 06:20:12.782466 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.782445 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 11 06:20:12.782548 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.782446 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zph5l\"" Sep 11 06:20:12.782632 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.782613 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 11 06:20:12.783507 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.783492 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 11 06:20:12.786325 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.786299 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xz5qq"] Sep 11 06:20:12.789431 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.789413 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.791220 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.791201 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925"] Sep 11 06:20:12.792059 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.792042 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 11 06:20:12.792658 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.792640 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 11 06:20:12.792835 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.792765 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 11 06:20:12.792835 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.792771 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8nnxx\"" Sep 11 06:20:12.808903 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.808874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-tls\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.809014 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.808921 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvnxn\" (UniqueName: \"kubernetes.io/projected/a6b70ee8-4123-4002-8745-b1d3f456e8bb-kube-api-access-qvnxn\") pod \"openshift-state-metrics-67dcf8c979-z8925\" (UID: \"a6b70ee8-4123-4002-8745-b1d3f456e8bb\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" Sep 11 06:20:12.809014 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.808974 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.809014 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.808999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-wtmp\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.809152 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.809034 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-root\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.809152 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.809050 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-textfile\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.809152 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.809067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6b70ee8-4123-4002-8745-b1d3f456e8bb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-z8925\" (UID: \"a6b70ee8-4123-4002-8745-b1d3f456e8bb\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" Sep 11 06:20:12.809152 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.809090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-sys\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.809152 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.809149 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-metrics-client-ca\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.809377 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.809186 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6b70ee8-4123-4002-8745-b1d3f456e8bb-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-z8925\" (UID: \"a6b70ee8-4123-4002-8745-b1d3f456e8bb\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" Sep 11 06:20:12.809377 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.809202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wd9d\" (UniqueName: \"kubernetes.io/projected/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-kube-api-access-5wd9d\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.809377 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.809228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-accelerators-collector-config\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.809377 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.809265 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6b70ee8-4123-4002-8745-b1d3f456e8bb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-z8925\" (UID: \"a6b70ee8-4123-4002-8745-b1d3f456e8bb\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" Sep 11 06:20:12.831880 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.831853 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:12.848545 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.848517 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8ns64" event={"ID":"6135cb51-9023-4dd4-bafa-ee4e4a6a667d","Type":"ContainerStarted","Data":"d5d97b3ceab4379a5e75a1999f6a00e340a755a0de03933f10984afac4ab193f"} Sep 11 06:20:12.850559 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.850431 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" event={"ID":"9bcd50b4-7f99-459e-a437-522b717cff0a","Type":"ContainerStarted","Data":"1794b55a0e40f612c82e5a3e8be85ef655084a44a5bcc60d33d34338d5129b7c"} Sep 11 06:20:12.850559 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.850478 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" event={"ID":"9bcd50b4-7f99-459e-a437-522b717cff0a","Type":"ContainerStarted","Data":"f07b709ae2f04dbbad82b03d84969ffd3703564aaac36bd09fd6b8f9767a2680"} Sep 11 06:20:12.850710 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.850592 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:20:12.872779 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.872730 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" podStartSLOduration=98.872711198 podStartE2EDuration="1m38.872711198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:18:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:20:12.872356364 +0000 UTC m=+99.984484612" watchObservedRunningTime="2026-09-11 06:20:12.872711198 +0000 UTC m=+99.984839448" Sep 11 06:20:12.909992 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.909963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-tls\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.910142 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.910044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvnxn\" (UniqueName: \"kubernetes.io/projected/a6b70ee8-4123-4002-8745-b1d3f456e8bb-kube-api-access-qvnxn\") pod \"openshift-state-metrics-67dcf8c979-z8925\" (UID: \"a6b70ee8-4123-4002-8745-b1d3f456e8bb\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" Sep 11 06:20:12.910142 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.910087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.910142 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.910107 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-wtmp\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.910142 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:20:12.910118 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 11 06:20:12.910364 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.910191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-root\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.910364 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.910211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-textfile\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.910364 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.910228 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6b70ee8-4123-4002-8745-b1d3f456e8bb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-z8925\" (UID: \"a6b70ee8-4123-4002-8745-b1d3f456e8bb\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" Sep 11 06:20:12.910364 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.910262 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-sys\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.910364 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.910278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-metrics-client-ca\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.910364 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.910298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6b70ee8-4123-4002-8745-b1d3f456e8bb-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-z8925\" (UID: \"a6b70ee8-4123-4002-8745-b1d3f456e8bb\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" Sep 11 06:20:12.910364 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.910314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wd9d\" (UniqueName: \"kubernetes.io/projected/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-kube-api-access-5wd9d\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.910364 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.910340 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-accelerators-collector-config\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.910364 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.910357 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6b70ee8-4123-4002-8745-b1d3f456e8bb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-z8925\" (UID: \"a6b70ee8-4123-4002-8745-b1d3f456e8bb\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" Sep 11 06:20:12.911047 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.910651 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-textfile\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.911047 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:20:12.910740 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-tls podName:5765f3de-6fb5-431e-95b5-cfa6de8d3fed nodeName:}" failed. No retries permitted until 2026-09-11 06:20:13.410716607 +0000 UTC m=+100.522844844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-tls") pod "node-exporter-xz5qq" (UID: "5765f3de-6fb5-431e-95b5-cfa6de8d3fed") : secret "node-exporter-tls" not found Sep 11 06:20:12.911047 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.910774 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-root\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.911933 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.911297 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-metrics-client-ca\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.911933 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.911368 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-sys\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.911933 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.911487 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-wtmp\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.911933 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.911849 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6b70ee8-4123-4002-8745-b1d3f456e8bb-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-z8925\" (UID: \"a6b70ee8-4123-4002-8745-b1d3f456e8bb\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" Sep 11 06:20:12.911933 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.911862 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-accelerators-collector-config\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.913461 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.913435 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:12.913803 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.913783 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6b70ee8-4123-4002-8745-b1d3f456e8bb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-z8925\" (UID: \"a6b70ee8-4123-4002-8745-b1d3f456e8bb\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" Sep 11 06:20:12.913975 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.913955 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6b70ee8-4123-4002-8745-b1d3f456e8bb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-z8925\" (UID: \"a6b70ee8-4123-4002-8745-b1d3f456e8bb\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" Sep 11 06:20:12.917846 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.917820 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:12.919609 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.919586 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvnxn\" (UniqueName: \"kubernetes.io/projected/a6b70ee8-4123-4002-8745-b1d3f456e8bb-kube-api-access-qvnxn\") pod \"openshift-state-metrics-67dcf8c979-z8925\" (UID: \"a6b70ee8-4123-4002-8745-b1d3f456e8bb\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" Sep 11 06:20:12.920390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:12.920370 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wd9d\" (UniqueName: \"kubernetes.io/projected/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-kube-api-access-5wd9d\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:13.017210 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:13.017133 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:13.089934 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:13.089902 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" Sep 11 06:20:13.118488 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:13.118454 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:13.230124 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:13.230094 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:13.355322 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:13.355228 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:13.373989 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:13.373952 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925"] Sep 11 06:20:13.378494 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:20:13.378456 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b70ee8_4123_4002_8745_b1d3f456e8bb.slice/crio-d682e9e27dd232e3696b82ef8789d45e8e07670eb16bef9095816a2fad4802f7 WatchSource:0}: Error finding container d682e9e27dd232e3696b82ef8789d45e8e07670eb16bef9095816a2fad4802f7: Status 404 returned error can't find the container with id d682e9e27dd232e3696b82ef8789d45e8e07670eb16bef9095816a2fad4802f7 Sep 11 06:20:13.414291 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:13.414264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-tls\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:13.416771 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:13.416752 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5765f3de-6fb5-431e-95b5-cfa6de8d3fed-node-exporter-tls\") pod \"node-exporter-xz5qq\" (UID: \"5765f3de-6fb5-431e-95b5-cfa6de8d3fed\") " pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:13.698487 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:13.698419 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xz5qq" Sep 11 06:20:13.781447 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:13.781326 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:13.857146 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:13.857107 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" event={"ID":"a6b70ee8-4123-4002-8745-b1d3f456e8bb","Type":"ContainerStarted","Data":"c5e3c5dddf51f33ecb04489d289514b00309b465dff3667532e2df2908cc43d1"} Sep 11 06:20:13.857312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:13.857182 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" event={"ID":"a6b70ee8-4123-4002-8745-b1d3f456e8bb","Type":"ContainerStarted","Data":"eedbdfa3480d3d1f833d89775711658eebf4dfc2658ceb359b71163825795156"} Sep 11 06:20:13.857312 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:13.857210 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" event={"ID":"a6b70ee8-4123-4002-8745-b1d3f456e8bb","Type":"ContainerStarted","Data":"d682e9e27dd232e3696b82ef8789d45e8e07670eb16bef9095816a2fad4802f7"} Sep 11 06:20:13.882811 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:13.882778 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:13.962439 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:13.962360 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:14.169208 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:20:14.169178 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5765f3de_6fb5_431e_95b5_cfa6de8d3fed.slice/crio-79fb81001b5b1175b8d6d7e9010c50461c0f34b0b7f842ef38d8f82b7e3af043 WatchSource:0}: Error finding container 79fb81001b5b1175b8d6d7e9010c50461c0f34b0b7f842ef38d8f82b7e3af043: Status 404 returned error can't find the container with id 79fb81001b5b1175b8d6d7e9010c50461c0f34b0b7f842ef38d8f82b7e3af043 Sep 11 06:20:14.770296 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.770271 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn"] Sep 11 06:20:14.782235 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.782117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.782743 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.782721 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn"] Sep 11 06:20:14.784625 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.784340 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eve0d2lf21i64\"" Sep 11 06:20:14.784625 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.784408 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 11 06:20:14.784625 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.784617 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-sjbmn\"" Sep 11 06:20:14.784855 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.784806 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 11 06:20:14.785078 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.785056 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 11 06:20:14.785274 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.785120 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 11 06:20:14.785818 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.785797 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 11 06:20:14.826533 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.826509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.826660 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.826547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.826660 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.826588 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr7tt\" (UniqueName: \"kubernetes.io/projected/6713f712-fc39-4571-a7a0-8e6853142590-kube-api-access-dr7tt\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.826660 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.826611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6713f712-fc39-4571-a7a0-8e6853142590-metrics-client-ca\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.826660 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.826627 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.826660 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.826645 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.826883 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.826716 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-grpc-tls\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.826883 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.826764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-thanos-querier-tls\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.864707 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.864681 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xz5qq" event={"ID":"5765f3de-6fb5-431e-95b5-cfa6de8d3fed","Type":"ContainerStarted","Data":"79fb81001b5b1175b8d6d7e9010c50461c0f34b0b7f842ef38d8f82b7e3af043"} Sep 11 06:20:14.867768 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.867740 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8ns64" event={"ID":"6135cb51-9023-4dd4-bafa-ee4e4a6a667d","Type":"ContainerStarted","Data":"6b7a63cb0935f912a3cd5e9cb52a6cf68e71cc8ee1e030a025e5ce97bc86d224"} Sep 11 06:20:14.927522 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.927483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-grpc-tls\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.927697 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.927558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-thanos-querier-tls\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.927697 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.927620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.927697 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.927660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.927697 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.927686 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr7tt\" (UniqueName: \"kubernetes.io/projected/6713f712-fc39-4571-a7a0-8e6853142590-kube-api-access-dr7tt\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.927901 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.927718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6713f712-fc39-4571-a7a0-8e6853142590-metrics-client-ca\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.927901 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.927743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.927901 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.927772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.928628 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.928601 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6713f712-fc39-4571-a7a0-8e6853142590-metrics-client-ca\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.930656 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.930632 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.930997 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.930973 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-thanos-querier-tls\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.931342 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.931318 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-grpc-tls\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.931629 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.931605 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.931738 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.931650 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.931803 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.931787 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6713f712-fc39-4571-a7a0-8e6853142590-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:14.936024 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:14.936003 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr7tt\" (UniqueName: \"kubernetes.io/projected/6713f712-fc39-4571-a7a0-8e6853142590-kube-api-access-dr7tt\") pod \"thanos-querier-6ff96bd95c-cz2pn\" (UID: \"6713f712-fc39-4571-a7a0-8e6853142590\") " pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:15.113652 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:15.113623 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:15.406122 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:15.406094 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn"] Sep 11 06:20:15.408885 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:20:15.408859 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6713f712_fc39_4571_a7a0_8e6853142590.slice/crio-4057d7c7881085629d577647c13cbb2e0a8cd5ed4525502906e5a77963b73f57 WatchSource:0}: Error finding container 4057d7c7881085629d577647c13cbb2e0a8cd5ed4525502906e5a77963b73f57: Status 404 returned error can't find the container with id 4057d7c7881085629d577647c13cbb2e0a8cd5ed4525502906e5a77963b73f57 Sep 11 06:20:15.743718 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:15.743639 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p8qtr" Sep 11 06:20:15.755262 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:15.755228 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:15.856625 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:15.856599 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:15.873507 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:15.873477 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8ns64" event={"ID":"6135cb51-9023-4dd4-bafa-ee4e4a6a667d","Type":"ContainerStarted","Data":"0cf6693e1df266fa21b20e8865fc3b27bc60653efe46ca1b55c2e82daa206ef6"} Sep 11 06:20:15.873685 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:15.873604 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8ns64" Sep 11 06:20:15.875778 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:15.875751 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" event={"ID":"a6b70ee8-4123-4002-8745-b1d3f456e8bb","Type":"ContainerStarted","Data":"38f964e0141e23e49f18116279d3a45ab1108bb8674ba6a8f269cf86d3fe2c4d"} Sep 11 06:20:15.877010 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:15.876987 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" event={"ID":"6713f712-fc39-4571-a7a0-8e6853142590","Type":"ContainerStarted","Data":"4057d7c7881085629d577647c13cbb2e0a8cd5ed4525502906e5a77963b73f57"} Sep 11 06:20:15.890233 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:15.889673 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8ns64" podStartSLOduration=66.664635837 podStartE2EDuration="1m8.889660971s" totalImagesPullingTime="2.225025134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:20:15.889426255 +0000 UTC m=+103.001554503" watchObservedRunningTime="2026-09-11 06:20:15.889660971 +0000 UTC m=+103.001789199" Sep 11 06:20:15.907248 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:15.907209 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-z8925" podStartSLOduration=2.096875776 podStartE2EDuration="3.907196839s" totalImagesPullingTime="1.810321063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:20:15.90599878 +0000 UTC m=+103.018127031" watchObservedRunningTime="2026-09-11 06:20:15.907196839 +0000 UTC m=+103.019325085" Sep 11 06:20:15.969284 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:15.969256 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:16.056778 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:16.056708 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:16.640098 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:16.640020 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:16.743439 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:16.743361 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:16.882146 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:16.882117 2578 generic.go:356] "Generic (PLEG): container finished" podID="5765f3de-6fb5-431e-95b5-cfa6de8d3fed" containerID="a95bd4db22ad184e5f954a7c246415699ab076ca174eb1595a21cfb696bdc945" exitCode=0 Sep 11 06:20:16.882596 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:16.882212 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xz5qq" event={"ID":"5765f3de-6fb5-431e-95b5-cfa6de8d3fed","Type":"ContainerDied","Data":"a95bd4db22ad184e5f954a7c246415699ab076ca174eb1595a21cfb696bdc945"} Sep 11 06:20:17.561063 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:17.560962 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:17.853641 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:17.853607 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:17.889761 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:17.889738 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xz5qq" event={"ID":"5765f3de-6fb5-431e-95b5-cfa6de8d3fed","Type":"ContainerStarted","Data":"544c2c1408b59d0b2f9a2d33ba82aee6d563408661cb66f3dd7ec48b9d4176e3"} Sep 11 06:20:17.890074 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:17.889784 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xz5qq" event={"ID":"5765f3de-6fb5-431e-95b5-cfa6de8d3fed","Type":"ContainerStarted","Data":"843dd4230fde3a32b42725925ebe8e5afc2747a55bfbdbb2cb6d6c69c0891c95"} Sep 11 06:20:17.908080 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:17.908043 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xz5qq" podStartSLOduration=3.806487528 podStartE2EDuration="5.908027316s" totalImagesPullingTime="2.010486902s" totalInitContainerRuntime="91.052886ms" isStatefulPod=true podCreationTimestamp="2026-09-11 06:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:20:17.906552126 +0000 UTC m=+105.018680372" watchObservedRunningTime="2026-09-11 06:20:17.908027316 +0000 UTC m=+105.020155561" Sep 11 06:20:18.897507 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:18.897474 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" event={"ID":"6713f712-fc39-4571-a7a0-8e6853142590","Type":"ContainerStarted","Data":"0018c7f1678596d8a025fc71e54c686c2ed9cf59099f6053a6583846a8868e7f"} Sep 11 06:20:18.897866 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:18.897559 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" event={"ID":"6713f712-fc39-4571-a7a0-8e6853142590","Type":"ContainerStarted","Data":"78eb77e646a57c80cb403520f09b68afacbe710f6db5de36f9d96cb59ee92e64"} Sep 11 06:20:18.897866 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:18.897699 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" event={"ID":"6713f712-fc39-4571-a7a0-8e6853142590","Type":"ContainerStarted","Data":"b150a7b4bf89bcddb1ca9a918631caf45c6fe29cd11b1fa85867fb5dc0b1897d"} Sep 11 06:20:18.897866 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:18.897739 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" event={"ID":"6713f712-fc39-4571-a7a0-8e6853142590","Type":"ContainerStarted","Data":"df930042792d5d62e7e9800f5ca2c9cc9fc6ee724dd37fe77a7b32691b6973cc"} Sep 11 06:20:18.897866 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:18.897776 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" event={"ID":"6713f712-fc39-4571-a7a0-8e6853142590","Type":"ContainerStarted","Data":"9b36684d2b5e46c04c27d6dc3e944619d99b718fcb6041a0ab762eb18d7db8b6"} Sep 11 06:20:19.051342 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.051268 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 06:20:19.055025 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.055008 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.057318 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.057295 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 11 06:20:19.057523 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.057508 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 11 06:20:19.057669 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.057653 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x5n47\"" Sep 11 06:20:19.057731 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.057711 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 11 06:20:19.058094 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.058064 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 11 06:20:19.058192 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.058161 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 11 06:20:19.058287 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.058268 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 11 06:20:19.058714 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.058700 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 11 06:20:19.058790 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.058728 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 11 06:20:19.059600 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.059554 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 11 06:20:19.059966 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.059948 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 11 06:20:19.060092 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.060020 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fjrqgjv8cm6pb\"" Sep 11 06:20:19.060242 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.060221 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 11 06:20:19.060330 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.060247 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 11 06:20:19.060392 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.060342 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 11 06:20:19.061721 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.061705 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 11 06:20:19.064936 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.064916 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 11 06:20:19.072179 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.072158 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 06:20:19.076244 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.076208 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:19.161726 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.161696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.161726 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.161726 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/136cc91a-91c7-4673-a9a5-8621ea387ccd-config-out\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.161915 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.161749 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.161915 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.161779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.161915 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.161840 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.161915 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.161858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.162077 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.161926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.162077 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.161968 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-config\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.162077 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.161984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/136cc91a-91c7-4673-a9a5-8621ea387ccd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.162077 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.162001 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.162077 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.162015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-web-config\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.162077 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.162031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.162077 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.162049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.162358 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.162124 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.162358 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.162153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.162358 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.162171 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fncj\" (UniqueName: \"kubernetes.io/projected/136cc91a-91c7-4673-a9a5-8621ea387ccd-kube-api-access-7fncj\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.162358 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.162188 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.162358 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.162255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.162358 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.162314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.162358 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.162339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.203649 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.203615 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:19.262942 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.262915 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.262942 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.262942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-config\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263122 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.262957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/136cc91a-91c7-4673-a9a5-8621ea387ccd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263122 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.262971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263122 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-web-config\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263271 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263271 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263169 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263271 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263218 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263271 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263271 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fncj\" (UniqueName: \"kubernetes.io/projected/136cc91a-91c7-4673-a9a5-8621ea387ccd-kube-api-access-7fncj\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263513 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263513 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263513 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263377 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263513 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263513 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263440 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263513 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/136cc91a-91c7-4673-a9a5-8621ea387ccd-config-out\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263513 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263898 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263523 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263898 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263898 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.263898 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.263733 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.264110 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.264045 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.265982 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.264317 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.265982 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.264753 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.265982 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.264976 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.265982 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.265956 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.266256 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.266167 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/136cc91a-91c7-4673-a9a5-8621ea387ccd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.266359 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.266333 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-config\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.266658 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.266634 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.266748 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.266696 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-web-config\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.267997 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.267947 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.268115 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.268017 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.268251 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.268142 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.269100 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.269072 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.269285 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.269266 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/136cc91a-91c7-4673-a9a5-8621ea387ccd-config-out\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.269354 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.269272 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.269625 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.269605 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.270143 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.270123 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.270405 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.270390 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.275542 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.275525 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fncj\" (UniqueName: \"kubernetes.io/projected/136cc91a-91c7-4673-a9a5-8621ea387ccd-kube-api-access-7fncj\") pod \"prometheus-k8s-0\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.303296 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.303242 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:19.365847 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.365812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:19.658800 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.658778 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 06:20:19.661145 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:20:19.661123 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136cc91a_91c7_4673_a9a5_8621ea387ccd.slice/crio-8251bc4030303f881037f56e5af40b269a89062aa474adbab7d02227191b9171 WatchSource:0}: Error finding container 8251bc4030303f881037f56e5af40b269a89062aa474adbab7d02227191b9171: Status 404 returned error can't find the container with id 8251bc4030303f881037f56e5af40b269a89062aa474adbab7d02227191b9171 Sep 11 06:20:19.904054 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.904019 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" event={"ID":"6713f712-fc39-4571-a7a0-8e6853142590","Type":"ContainerStarted","Data":"c18c05dec778d934c2025113e86eb1f650c6268bf137f0b02d6ecb3522622152"} Sep 11 06:20:19.904479 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.904161 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:19.905408 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.905376 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136cc91a-91c7-4673-a9a5-8621ea387ccd","Type":"ContainerStarted","Data":"8251bc4030303f881037f56e5af40b269a89062aa474adbab7d02227191b9171"} Sep 11 06:20:19.929458 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:19.929366 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" podStartSLOduration=2.787647377 podStartE2EDuration="5.92934836s" totalImagesPullingTime="3.141700983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:20:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:20:19.928055722 +0000 UTC m=+107.040183999" watchObservedRunningTime="2026-09-11 06:20:19.92934836 +0000 UTC m=+107.041476607" Sep 11 06:20:20.349926 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:20.349889 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dbf9f4985-jrffd"] Sep 11 06:20:20.442257 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:20.442224 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:20.518681 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:20.518638 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:20.618609 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:20.618518 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:20.910109 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:20.910080 2578 generic.go:356] "Generic (PLEG): container finished" podID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerID="cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45" exitCode=0 Sep 11 06:20:20.910433 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:20.910152 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136cc91a-91c7-4673-a9a5-8621ea387ccd","Type":"ContainerDied","Data":"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45"} Sep 11 06:20:22.007086 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:22.007041 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:22.101914 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:22.101871 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:22.202297 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:22.202266 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:22.302823 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:22.302747 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:22.661169 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:22.661137 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:22.718743 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:22.718707 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:23.062412 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:23.062306 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:23.289628 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:23.289561 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:23.390770 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:23.390732 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:23.492670 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:23.492632 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:23.663208 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:23.663113 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:23.763404 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:23.763369 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:23.868677 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:23.868636 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:24.928699 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:24.928668 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136cc91a-91c7-4673-a9a5-8621ea387ccd","Type":"ContainerStarted","Data":"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8"} Sep 11 06:20:24.929068 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:24.928728 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136cc91a-91c7-4673-a9a5-8621ea387ccd","Type":"ContainerStarted","Data":"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570"} Sep 11 06:20:24.929068 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:24.928755 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136cc91a-91c7-4673-a9a5-8621ea387ccd","Type":"ContainerStarted","Data":"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5"} Sep 11 06:20:24.929068 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:24.928778 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136cc91a-91c7-4673-a9a5-8621ea387ccd","Type":"ContainerStarted","Data":"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602"} Sep 11 06:20:24.929068 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:24.928801 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136cc91a-91c7-4673-a9a5-8621ea387ccd","Type":"ContainerStarted","Data":"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7"} Sep 11 06:20:24.929068 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:24.928837 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136cc91a-91c7-4673-a9a5-8621ea387ccd","Type":"ContainerStarted","Data":"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7"} Sep 11 06:20:24.956554 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:24.956509 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.6690044290000001 podStartE2EDuration="5.956493819s" totalImagesPullingTime="4.271716744s" totalInitContainerRuntime="15.772646ms" isStatefulPod=false podCreationTimestamp="2026-09-11 06:20:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:20:24.954083917 +0000 UTC m=+112.066212165" watchObservedRunningTime="2026-09-11 06:20:24.956493819 +0000 UTC m=+112.068622065" Sep 11 06:20:25.817442 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:25.817402 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:25.885110 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:25.885086 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8ns64" Sep 11 06:20:25.905579 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:25.905549 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:25.917138 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:25.917116 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6ff96bd95c-cz2pn" Sep 11 06:20:25.964385 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:25.964351 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:29.366447 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:29.366402 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:20:30.355393 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:30.355365 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:20:32.689322 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:32.689283 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:33.114301 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:33.114272 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:33.168976 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:33.168939 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:34.993266 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:34.993231 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:35.040053 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:35.040019 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:35.485240 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:35.485205 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:35.545867 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:35.545837 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:40.286004 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:40.285971 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:40.341617 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:40.341588 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:40.814148 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:40.814110 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:40.865224 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:40.865182 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:43.000083 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:43.000048 2578 generic.go:356] "Generic (PLEG): container finished" podID="1be16ffd-0ce2-4529-bcf6-91d1be5a385f" containerID="9093c5daff29a2609ec9b4e7fac3d265c87ac118a3d781efa2c8512fe4447f31" exitCode=0 Sep 11 06:20:43.000462 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:43.000122 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-kcmwr" event={"ID":"1be16ffd-0ce2-4529-bcf6-91d1be5a385f","Type":"ContainerDied","Data":"9093c5daff29a2609ec9b4e7fac3d265c87ac118a3d781efa2c8512fe4447f31"} Sep 11 06:20:43.000462 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:43.000454 2578 scope.go:117] "RemoveContainer" containerID="9093c5daff29a2609ec9b4e7fac3d265c87ac118a3d781efa2c8512fe4447f31" Sep 11 06:20:43.168013 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:43.167971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs\") pod \"network-metrics-daemon-7mpnr\" (UID: \"b5bab53c-ef28-4f24-a84e-640462c08884\") " pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:20:43.170526 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:43.170502 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5bab53c-ef28-4f24-a84e-640462c08884-metrics-certs\") pod \"network-metrics-daemon-7mpnr\" (UID: \"b5bab53c-ef28-4f24-a84e-640462c08884\") " pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:20:43.313077 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:43.312996 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tl76h\"" Sep 11 06:20:43.320999 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:43.320971 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mpnr" Sep 11 06:20:43.592955 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:43.592929 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7mpnr"] Sep 11 06:20:43.594595 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:20:43.594554 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5bab53c_ef28_4f24_a84e_640462c08884.slice/crio-cdf19fc8db78b82dceada71dc9d0c772409d6027603175afe43d7cb9e3f1f2e8 WatchSource:0}: Error finding container cdf19fc8db78b82dceada71dc9d0c772409d6027603175afe43d7cb9e3f1f2e8: Status 404 returned error can't find the container with id cdf19fc8db78b82dceada71dc9d0c772409d6027603175afe43d7cb9e3f1f2e8 Sep 11 06:20:43.991369 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:43.991291 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ln8dz_edc8ff17-b5a6-438b-8065-36b26e4c6da8/serve-healthcheck-canary/0.log" Sep 11 06:20:44.005903 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:44.005870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-kcmwr" event={"ID":"1be16ffd-0ce2-4529-bcf6-91d1be5a385f","Type":"ContainerStarted","Data":"3e05a71649718dc7edc42349a6e0d79ac5260bfa5a69cb104430130cb8f58191"} Sep 11 06:20:44.007070 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:44.007047 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7mpnr" event={"ID":"b5bab53c-ef28-4f24-a84e-640462c08884","Type":"ContainerStarted","Data":"cdf19fc8db78b82dceada71dc9d0c772409d6027603175afe43d7cb9e3f1f2e8"} Sep 11 06:20:44.883078 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:44.882995 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:45.012393 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.012361 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7mpnr" event={"ID":"b5bab53c-ef28-4f24-a84e-640462c08884","Type":"ContainerStarted","Data":"feee69df0ac58ea9cf39ee5bd6fb061a981ea40a9420c2c23b399c7529b4c630"} Sep 11 06:20:45.012785 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.012417 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7mpnr" event={"ID":"b5bab53c-ef28-4f24-a84e-640462c08884","Type":"ContainerStarted","Data":"528d5624c585c2f12fd258caaea9350e38911a8e75d4968f7cc8e8515a4e68d0"} Sep 11 06:20:45.028154 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.028098 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7mpnr" podStartSLOduration=130.031007539 podStartE2EDuration="2m11.028082556s" totalImagesPullingTime="997.075017ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:20:45.026780783 +0000 UTC m=+132.138909029" watchObservedRunningTime="2026-09-11 06:20:45.028082556 +0000 UTC m=+132.140210801" Sep 11 06:20:45.114831 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.114795 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:45.171079 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.171002 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:45.369780 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.369745 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" podUID="9bcd50b4-7f99-459e-a437-522b717cff0a" containerName="registry" containerID="cri-o://1794b55a0e40f612c82e5a3e8be85ef655084a44a5bcc60d33d34338d5129b7c" gracePeriod=30 Sep 11 06:20:45.623315 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.623288 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:20:45.792476 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.792401 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bcd50b4-7f99-459e-a437-522b717cff0a-image-registry-private-configuration\") pod \"9bcd50b4-7f99-459e-a437-522b717cff0a\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " Sep 11 06:20:45.792476 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.792437 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l567q\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-kube-api-access-l567q\") pod \"9bcd50b4-7f99-459e-a437-522b717cff0a\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " Sep 11 06:20:45.792476 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.792464 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls\") pod \"9bcd50b4-7f99-459e-a437-522b717cff0a\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " Sep 11 06:20:45.792726 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.792518 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bcd50b4-7f99-459e-a437-522b717cff0a-installation-pull-secrets\") pod \"9bcd50b4-7f99-459e-a437-522b717cff0a\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " Sep 11 06:20:45.792726 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.792558 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bcd50b4-7f99-459e-a437-522b717cff0a-ca-trust-extracted\") pod \"9bcd50b4-7f99-459e-a437-522b717cff0a\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " Sep 11 06:20:45.792726 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.792614 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-certificates\") pod \"9bcd50b4-7f99-459e-a437-522b717cff0a\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " Sep 11 06:20:45.792726 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.792669 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bcd50b4-7f99-459e-a437-522b717cff0a-trusted-ca\") pod \"9bcd50b4-7f99-459e-a437-522b717cff0a\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " Sep 11 06:20:45.792726 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.792713 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-bound-sa-token\") pod \"9bcd50b4-7f99-459e-a437-522b717cff0a\" (UID: \"9bcd50b4-7f99-459e-a437-522b717cff0a\") " Sep 11 06:20:45.793187 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.793102 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9bcd50b4-7f99-459e-a437-522b717cff0a" (UID: "9bcd50b4-7f99-459e-a437-522b717cff0a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 06:20:45.793502 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.793465 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bcd50b4-7f99-459e-a437-522b717cff0a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9bcd50b4-7f99-459e-a437-522b717cff0a" (UID: "9bcd50b4-7f99-459e-a437-522b717cff0a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 06:20:45.795650 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.795622 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bcd50b4-7f99-459e-a437-522b717cff0a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9bcd50b4-7f99-459e-a437-522b717cff0a" (UID: "9bcd50b4-7f99-459e-a437-522b717cff0a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 06:20:45.795754 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.795727 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bcd50b4-7f99-459e-a437-522b717cff0a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9bcd50b4-7f99-459e-a437-522b717cff0a" (UID: "9bcd50b4-7f99-459e-a437-522b717cff0a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 06:20:45.795809 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.795760 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9bcd50b4-7f99-459e-a437-522b717cff0a" (UID: "9bcd50b4-7f99-459e-a437-522b717cff0a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 06:20:45.795809 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.795765 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-kube-api-access-l567q" (OuterVolumeSpecName: "kube-api-access-l567q") pod "9bcd50b4-7f99-459e-a437-522b717cff0a" (UID: "9bcd50b4-7f99-459e-a437-522b717cff0a"). InnerVolumeSpecName "kube-api-access-l567q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 06:20:45.795879 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.795847 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9bcd50b4-7f99-459e-a437-522b717cff0a" (UID: "9bcd50b4-7f99-459e-a437-522b717cff0a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 06:20:45.801498 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.801473 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bcd50b4-7f99-459e-a437-522b717cff0a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9bcd50b4-7f99-459e-a437-522b717cff0a" (UID: "9bcd50b4-7f99-459e-a437-522b717cff0a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 06:20:45.894236 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.894210 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bcd50b4-7f99-459e-a437-522b717cff0a-trusted-ca\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:20:45.894236 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.894234 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-bound-sa-token\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:20:45.894431 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.894247 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bcd50b4-7f99-459e-a437-522b717cff0a-image-registry-private-configuration\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:20:45.894431 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.894257 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l567q\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-kube-api-access-l567q\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:20:45.894431 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.894267 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-tls\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:20:45.894431 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.894275 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bcd50b4-7f99-459e-a437-522b717cff0a-installation-pull-secrets\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:20:45.894431 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.894283 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bcd50b4-7f99-459e-a437-522b717cff0a-ca-trust-extracted\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:20:45.894431 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:45.894291 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bcd50b4-7f99-459e-a437-522b717cff0a-registry-certificates\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:20:46.017897 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:46.017866 2578 generic.go:356] "Generic (PLEG): container finished" podID="9bcd50b4-7f99-459e-a437-522b717cff0a" containerID="1794b55a0e40f612c82e5a3e8be85ef655084a44a5bcc60d33d34338d5129b7c" exitCode=0 Sep 11 06:20:46.018244 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:46.017915 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" Sep 11 06:20:46.018244 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:46.017957 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" event={"ID":"9bcd50b4-7f99-459e-a437-522b717cff0a","Type":"ContainerDied","Data":"1794b55a0e40f612c82e5a3e8be85ef655084a44a5bcc60d33d34338d5129b7c"} Sep 11 06:20:46.018244 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:46.018046 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dbf9f4985-jrffd" event={"ID":"9bcd50b4-7f99-459e-a437-522b717cff0a","Type":"ContainerDied","Data":"f07b709ae2f04dbbad82b03d84969ffd3703564aaac36bd09fd6b8f9767a2680"} Sep 11 06:20:46.018244 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:46.018082 2578 scope.go:117] "RemoveContainer" containerID="1794b55a0e40f612c82e5a3e8be85ef655084a44a5bcc60d33d34338d5129b7c" Sep 11 06:20:46.026609 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:46.026560 2578 scope.go:117] "RemoveContainer" containerID="1794b55a0e40f612c82e5a3e8be85ef655084a44a5bcc60d33d34338d5129b7c" Sep 11 06:20:46.026853 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:20:46.026835 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1794b55a0e40f612c82e5a3e8be85ef655084a44a5bcc60d33d34338d5129b7c\": container with ID starting with 1794b55a0e40f612c82e5a3e8be85ef655084a44a5bcc60d33d34338d5129b7c not found: ID does not exist" containerID="1794b55a0e40f612c82e5a3e8be85ef655084a44a5bcc60d33d34338d5129b7c" Sep 11 06:20:46.026905 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:46.026861 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1794b55a0e40f612c82e5a3e8be85ef655084a44a5bcc60d33d34338d5129b7c"} err="failed to get container status \"1794b55a0e40f612c82e5a3e8be85ef655084a44a5bcc60d33d34338d5129b7c\": rpc error: code = NotFound desc = could not find container \"1794b55a0e40f612c82e5a3e8be85ef655084a44a5bcc60d33d34338d5129b7c\": container with ID starting with 1794b55a0e40f612c82e5a3e8be85ef655084a44a5bcc60d33d34338d5129b7c not found: ID does not exist" Sep 11 06:20:46.038963 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:46.038938 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dbf9f4985-jrffd"] Sep 11 06:20:46.042346 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:46.042326 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7dbf9f4985-jrffd"] Sep 11 06:20:47.398520 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:47.398485 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bcd50b4-7f99-459e-a437-522b717cff0a" path="/var/lib/kubelet/pods/9bcd50b4-7f99-459e-a437-522b717cff0a/volumes" Sep 11 06:20:54.050300 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:54.050263 2578 generic.go:356] "Generic (PLEG): container finished" podID="81ccae4f-37aa-454a-9b7a-498b90c7db36" containerID="21ba2a3e36f3b79dfe0c5a0aac9518fa2523e33f46e3c1d840564387677725f1" exitCode=0 Sep 11 06:20:54.050726 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:54.050338 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689" event={"ID":"81ccae4f-37aa-454a-9b7a-498b90c7db36","Type":"ContainerDied","Data":"21ba2a3e36f3b79dfe0c5a0aac9518fa2523e33f46e3c1d840564387677725f1"} Sep 11 06:20:54.050726 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:54.050673 2578 scope.go:117] "RemoveContainer" containerID="21ba2a3e36f3b79dfe0c5a0aac9518fa2523e33f46e3c1d840564387677725f1" Sep 11 06:20:55.057379 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:55.057337 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vw689" event={"ID":"81ccae4f-37aa-454a-9b7a-498b90c7db36","Type":"ContainerStarted","Data":"9b8c3060b69f4a2c6d1a94858cf09f9e3878578bd38aa9b9fb4c87a25aa0683b"} Sep 11 06:20:55.503275 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:55.503233 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:55.559891 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:55.559852 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:55.820785 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:55.820685 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:55.874930 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:55.874896 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:56.689168 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:56.689128 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:56.744065 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:56.744034 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:58.887647 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:58.887607 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:20:58.988306 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:20:58.988271 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:21:03.301942 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:03.301894 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:21:03.404640 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:03.404602 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:21:03.545232 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:03.545191 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:21:10.819061 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:10.819025 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:21:10.873286 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:10.873259 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:21:19.366209 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:19.366170 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:19.385533 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:19.385509 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:20.172381 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:20.172354 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:31.991255 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:31.991168 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:21:32.197265 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:32.197235 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:21:37.332225 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.332196 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 06:21:37.332663 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.332462 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="prometheus" containerID="cri-o://165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7" gracePeriod=600 Sep 11 06:21:37.332663 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.332503 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="thanos-sidecar" containerID="cri-o://d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602" gracePeriod=600 Sep 11 06:21:37.332663 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.332548 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="kube-rbac-proxy-thanos" containerID="cri-o://13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8" gracePeriod=600 Sep 11 06:21:37.332663 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.332499 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="kube-rbac-proxy" containerID="cri-o://7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570" gracePeriod=600 Sep 11 06:21:37.332663 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.332586 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="config-reloader" containerID="cri-o://84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7" gracePeriod=600 Sep 11 06:21:37.332928 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.332522 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="kube-rbac-proxy-web" containerID="cri-o://944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5" gracePeriod=600 Sep 11 06:21:37.568763 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.568739 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:37.723705 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.723617 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/136cc91a-91c7-4673-a9a5-8621ea387ccd-config-out\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.723705 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.723673 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-kubelet-serving-ca-bundle\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.723705 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.723699 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fncj\" (UniqueName: \"kubernetes.io/projected/136cc91a-91c7-4673-a9a5-8621ea387ccd-kube-api-access-7fncj\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.723982 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.723723 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.723982 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.723749 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-kube-rbac-proxy\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.723982 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.723775 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-web-config\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.723982 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.723808 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-trusted-ca-bundle\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.723982 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.723835 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-0\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.723982 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.723862 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-1\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.723982 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.723890 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-tls\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.723982 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.723929 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-serving-certs-ca-bundle\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.723982 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.723960 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-metrics-client-ca\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.723982 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.723984 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-metrics-client-certs\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.724664 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.724051 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-grpc-tls\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.724664 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.724084 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-config\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.724664 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.724123 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/136cc91a-91c7-4673-a9a5-8621ea387ccd-tls-assets\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.724664 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.724136 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 06:21:37.724664 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.724154 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-thanos-prometheus-http-client-file\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.724664 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.724185 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.724664 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.724233 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-db\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.724664 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.724255 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-2\") pod \"136cc91a-91c7-4673-a9a5-8621ea387ccd\" (UID: \"136cc91a-91c7-4673-a9a5-8621ea387ccd\") " Sep 11 06:21:37.725094 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.724686 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.725383 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.725309 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 06:21:37.726203 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.726065 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 06:21:37.727147 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.727120 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 06:21:37.728518 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.727632 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 06:21:37.728518 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.728182 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 06:21:37.728518 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.728198 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 06:21:37.728518 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.728282 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 06:21:37.728518 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.728352 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136cc91a-91c7-4673-a9a5-8621ea387ccd-config-out" (OuterVolumeSpecName: "config-out") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 06:21:37.728518 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.728465 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 06:21:37.728916 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.728540 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 06:21:37.728916 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.728562 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136cc91a-91c7-4673-a9a5-8621ea387ccd-kube-api-access-7fncj" (OuterVolumeSpecName: "kube-api-access-7fncj") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "kube-api-access-7fncj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 06:21:37.728916 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.728756 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 06:21:37.728916 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.728866 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 06:21:37.729098 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.728910 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 06:21:37.729164 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.729145 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136cc91a-91c7-4673-a9a5-8621ea387ccd-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 06:21:37.729258 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.729192 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 06:21:37.729754 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.729731 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 06:21:37.730350 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.730333 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-config" (OuterVolumeSpecName: "config") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 06:21:37.738782 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.738763 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-web-config" (OuterVolumeSpecName: "web-config") pod "136cc91a-91c7-4673-a9a5-8621ea387ccd" (UID: "136cc91a-91c7-4673-a9a5-8621ea387ccd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 06:21:37.825262 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825238 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825262 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825260 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-configmap-metrics-client-ca\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825410 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825276 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-metrics-client-certs\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825410 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825287 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-grpc-tls\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825410 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825300 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-config\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825410 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825311 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/136cc91a-91c7-4673-a9a5-8621ea387ccd-tls-assets\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825410 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825324 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825410 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825337 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825410 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825352 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-db\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825410 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825365 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825410 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825378 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/136cc91a-91c7-4673-a9a5-8621ea387ccd-config-out\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825410 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825391 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fncj\" (UniqueName: \"kubernetes.io/projected/136cc91a-91c7-4673-a9a5-8621ea387ccd-kube-api-access-7fncj\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825410 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825404 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825813 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825418 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-kube-rbac-proxy\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825813 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825431 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-web-config\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825813 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825445 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825813 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825458 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825813 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825471 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/136cc91a-91c7-4673-a9a5-8621ea387ccd-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:37.825813 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:37.825484 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/136cc91a-91c7-4673-a9a5-8621ea387ccd-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:21:38.226857 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.226824 2578 generic.go:356] "Generic (PLEG): container finished" podID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerID="13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8" exitCode=0 Sep 11 06:21:38.226857 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.226852 2578 generic.go:356] "Generic (PLEG): container finished" podID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerID="7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570" exitCode=0 Sep 11 06:21:38.226857 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.226860 2578 generic.go:356] "Generic (PLEG): container finished" podID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerID="944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5" exitCode=0 Sep 11 06:21:38.226857 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.226866 2578 generic.go:356] "Generic (PLEG): container finished" podID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerID="d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602" exitCode=0 Sep 11 06:21:38.227124 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.226871 2578 generic.go:356] "Generic (PLEG): container finished" podID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerID="84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7" exitCode=0 Sep 11 06:21:38.227124 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.226876 2578 generic.go:356] "Generic (PLEG): container finished" podID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerID="165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7" exitCode=0 Sep 11 06:21:38.227124 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.226900 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.227124 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.226913 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136cc91a-91c7-4673-a9a5-8621ea387ccd","Type":"ContainerDied","Data":"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8"} Sep 11 06:21:38.227124 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.226991 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136cc91a-91c7-4673-a9a5-8621ea387ccd","Type":"ContainerDied","Data":"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570"} Sep 11 06:21:38.227124 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.227034 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136cc91a-91c7-4673-a9a5-8621ea387ccd","Type":"ContainerDied","Data":"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5"} Sep 11 06:21:38.227124 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.227055 2578 scope.go:117] "RemoveContainer" containerID="13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8" Sep 11 06:21:38.227124 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.227074 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136cc91a-91c7-4673-a9a5-8621ea387ccd","Type":"ContainerDied","Data":"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602"} Sep 11 06:21:38.227124 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.227115 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136cc91a-91c7-4673-a9a5-8621ea387ccd","Type":"ContainerDied","Data":"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7"} Sep 11 06:21:38.227433 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.227156 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136cc91a-91c7-4673-a9a5-8621ea387ccd","Type":"ContainerDied","Data":"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7"} Sep 11 06:21:38.227433 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.227197 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"136cc91a-91c7-4673-a9a5-8621ea387ccd","Type":"ContainerDied","Data":"8251bc4030303f881037f56e5af40b269a89062aa474adbab7d02227191b9171"} Sep 11 06:21:38.235935 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.235916 2578 scope.go:117] "RemoveContainer" containerID="7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570" Sep 11 06:21:38.242672 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.242653 2578 scope.go:117] "RemoveContainer" containerID="944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5" Sep 11 06:21:38.249786 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.249734 2578 scope.go:117] "RemoveContainer" containerID="d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602" Sep 11 06:21:38.250744 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.250714 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 06:21:38.257249 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.257232 2578 scope.go:117] "RemoveContainer" containerID="84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7" Sep 11 06:21:38.257987 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.257968 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 06:21:38.263810 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.263792 2578 scope.go:117] "RemoveContainer" containerID="165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7" Sep 11 06:21:38.270613 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.270599 2578 scope.go:117] "RemoveContainer" containerID="cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45" Sep 11 06:21:38.277027 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.277010 2578 scope.go:117] "RemoveContainer" containerID="13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8" Sep 11 06:21:38.277283 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:21:38.277263 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8\": container with ID starting with 13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8 not found: ID does not exist" containerID="13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8" Sep 11 06:21:38.277367 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.277295 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8"} err="failed to get container status \"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8\": rpc error: code = NotFound desc = could not find container \"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8\": container with ID starting with 13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8 not found: ID does not exist" Sep 11 06:21:38.277367 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.277311 2578 scope.go:117] "RemoveContainer" containerID="7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570" Sep 11 06:21:38.277633 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:21:38.277554 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570\": container with ID starting with 7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570 not found: ID does not exist" containerID="7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570" Sep 11 06:21:38.277728 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.277665 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570"} err="failed to get container status \"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570\": rpc error: code = NotFound desc = could not find container \"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570\": container with ID starting with 7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570 not found: ID does not exist" Sep 11 06:21:38.277728 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.277683 2578 scope.go:117] "RemoveContainer" containerID="944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5" Sep 11 06:21:38.277966 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:21:38.277947 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5\": container with ID starting with 944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5 not found: ID does not exist" containerID="944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5" Sep 11 06:21:38.278006 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.277975 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5"} err="failed to get container status \"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5\": rpc error: code = NotFound desc = could not find container \"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5\": container with ID starting with 944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5 not found: ID does not exist" Sep 11 06:21:38.278006 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.277991 2578 scope.go:117] "RemoveContainer" containerID="d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602" Sep 11 06:21:38.278246 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:21:38.278226 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602\": container with ID starting with d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602 not found: ID does not exist" containerID="d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602" Sep 11 06:21:38.278315 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.278250 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602"} err="failed to get container status \"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602\": rpc error: code = NotFound desc = could not find container \"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602\": container with ID starting with d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602 not found: ID does not exist" Sep 11 06:21:38.278315 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.278266 2578 scope.go:117] "RemoveContainer" containerID="84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7" Sep 11 06:21:38.278496 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:21:38.278480 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7\": container with ID starting with 84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7 not found: ID does not exist" containerID="84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7" Sep 11 06:21:38.278537 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.278502 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7"} err="failed to get container status \"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7\": rpc error: code = NotFound desc = could not find container \"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7\": container with ID starting with 84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7 not found: ID does not exist" Sep 11 06:21:38.278537 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.278516 2578 scope.go:117] "RemoveContainer" containerID="165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7" Sep 11 06:21:38.278747 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:21:38.278733 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7\": container with ID starting with 165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7 not found: ID does not exist" containerID="165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7" Sep 11 06:21:38.278793 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.278749 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7"} err="failed to get container status \"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7\": rpc error: code = NotFound desc = could not find container \"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7\": container with ID starting with 165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7 not found: ID does not exist" Sep 11 06:21:38.278793 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.278761 2578 scope.go:117] "RemoveContainer" containerID="cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45" Sep 11 06:21:38.279002 ip-10-0-135-168 kubenswrapper[2578]: E0911 06:21:38.278987 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45\": container with ID starting with cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45 not found: ID does not exist" containerID="cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45" Sep 11 06:21:38.279047 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.279007 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45"} err="failed to get container status \"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45\": rpc error: code = NotFound desc = could not find container \"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45\": container with ID starting with cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45 not found: ID does not exist" Sep 11 06:21:38.279047 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.279020 2578 scope.go:117] "RemoveContainer" containerID="13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8" Sep 11 06:21:38.279239 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.279219 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8"} err="failed to get container status \"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8\": rpc error: code = NotFound desc = could not find container \"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8\": container with ID starting with 13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8 not found: ID does not exist" Sep 11 06:21:38.279282 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.279240 2578 scope.go:117] "RemoveContainer" containerID="7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570" Sep 11 06:21:38.279434 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.279420 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570"} err="failed to get container status \"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570\": rpc error: code = NotFound desc = could not find container \"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570\": container with ID starting with 7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570 not found: ID does not exist" Sep 11 06:21:38.279517 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.279434 2578 scope.go:117] "RemoveContainer" containerID="944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5" Sep 11 06:21:38.279673 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.279653 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5"} err="failed to get container status \"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5\": rpc error: code = NotFound desc = could not find container \"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5\": container with ID starting with 944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5 not found: ID does not exist" Sep 11 06:21:38.279731 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.279674 2578 scope.go:117] "RemoveContainer" containerID="d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602" Sep 11 06:21:38.280181 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.280144 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602"} err="failed to get container status \"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602\": rpc error: code = NotFound desc = could not find container \"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602\": container with ID starting with d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602 not found: ID does not exist" Sep 11 06:21:38.280181 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.280172 2578 scope.go:117] "RemoveContainer" containerID="84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7" Sep 11 06:21:38.280508 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.280482 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7"} err="failed to get container status \"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7\": rpc error: code = NotFound desc = could not find container \"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7\": container with ID starting with 84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7 not found: ID does not exist" Sep 11 06:21:38.280740 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.280511 2578 scope.go:117] "RemoveContainer" containerID="165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7" Sep 11 06:21:38.280828 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.280800 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7"} err="failed to get container status \"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7\": rpc error: code = NotFound desc = could not find container \"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7\": container with ID starting with 165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7 not found: ID does not exist" Sep 11 06:21:38.280893 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.280830 2578 scope.go:117] "RemoveContainer" containerID="cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45" Sep 11 06:21:38.281108 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.281089 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45"} err="failed to get container status \"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45\": rpc error: code = NotFound desc = could not find container \"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45\": container with ID starting with cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45 not found: ID does not exist" Sep 11 06:21:38.281179 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.281109 2578 scope.go:117] "RemoveContainer" containerID="13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8" Sep 11 06:21:38.281369 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.281351 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8"} err="failed to get container status \"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8\": rpc error: code = NotFound desc = could not find container \"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8\": container with ID starting with 13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8 not found: ID does not exist" Sep 11 06:21:38.281407 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.281370 2578 scope.go:117] "RemoveContainer" containerID="7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570" Sep 11 06:21:38.281621 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.281605 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570"} err="failed to get container status \"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570\": rpc error: code = NotFound desc = could not find container \"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570\": container with ID starting with 7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570 not found: ID does not exist" Sep 11 06:21:38.281683 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.281622 2578 scope.go:117] "RemoveContainer" containerID="944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5" Sep 11 06:21:38.281787 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.281770 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 06:21:38.281868 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.281851 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5"} err="failed to get container status \"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5\": rpc error: code = NotFound desc = could not find container \"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5\": container with ID starting with 944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5 not found: ID does not exist" Sep 11 06:21:38.281925 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.281870 2578 scope.go:117] "RemoveContainer" containerID="d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602" Sep 11 06:21:38.282055 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282041 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="kube-rbac-proxy-web" Sep 11 06:21:38.282098 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282059 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="kube-rbac-proxy-web" Sep 11 06:21:38.282098 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282069 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="config-reloader" Sep 11 06:21:38.282098 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282075 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="config-reloader" Sep 11 06:21:38.282098 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282084 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="prometheus" Sep 11 06:21:38.282098 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282089 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="prometheus" Sep 11 06:21:38.282098 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282086 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602"} err="failed to get container status \"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602\": rpc error: code = NotFound desc = could not find container \"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602\": container with ID starting with d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602 not found: ID does not exist" Sep 11 06:21:38.282295 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282104 2578 scope.go:117] "RemoveContainer" containerID="84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7" Sep 11 06:21:38.282295 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282097 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="kube-rbac-proxy-thanos" Sep 11 06:21:38.282295 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282151 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="kube-rbac-proxy-thanos" Sep 11 06:21:38.282295 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282169 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="thanos-sidecar" Sep 11 06:21:38.282295 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282174 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="thanos-sidecar" Sep 11 06:21:38.282295 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282188 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bcd50b4-7f99-459e-a437-522b717cff0a" containerName="registry" Sep 11 06:21:38.282295 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282193 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bcd50b4-7f99-459e-a437-522b717cff0a" containerName="registry" Sep 11 06:21:38.282295 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282200 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="init-config-reloader" Sep 11 06:21:38.282295 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282206 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="init-config-reloader" Sep 11 06:21:38.282295 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282211 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="kube-rbac-proxy" Sep 11 06:21:38.282295 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282220 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="kube-rbac-proxy" Sep 11 06:21:38.282702 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282306 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="kube-rbac-proxy-web" Sep 11 06:21:38.282702 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282316 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="thanos-sidecar" Sep 11 06:21:38.282702 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282322 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bcd50b4-7f99-459e-a437-522b717cff0a" containerName="registry" Sep 11 06:21:38.282702 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282327 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="config-reloader" Sep 11 06:21:38.282702 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282333 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="kube-rbac-proxy-thanos" Sep 11 06:21:38.282702 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282332 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7"} err="failed to get container status \"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7\": rpc error: code = NotFound desc = could not find container \"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7\": container with ID starting with 84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7 not found: ID does not exist" Sep 11 06:21:38.282702 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282361 2578 scope.go:117] "RemoveContainer" containerID="165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7" Sep 11 06:21:38.282702 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282339 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="prometheus" Sep 11 06:21:38.282702 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282406 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" containerName="kube-rbac-proxy" Sep 11 06:21:38.282702 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282649 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7"} err="failed to get container status \"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7\": rpc error: code = NotFound desc = could not find container \"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7\": container with ID starting with 165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7 not found: ID does not exist" Sep 11 06:21:38.282702 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282664 2578 scope.go:117] "RemoveContainer" containerID="cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45" Sep 11 06:21:38.283150 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282909 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45"} err="failed to get container status \"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45\": rpc error: code = NotFound desc = could not find container \"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45\": container with ID starting with cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45 not found: ID does not exist" Sep 11 06:21:38.283150 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.282933 2578 scope.go:117] "RemoveContainer" containerID="13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8" Sep 11 06:21:38.283221 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.283183 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8"} err="failed to get container status \"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8\": rpc error: code = NotFound desc = could not find container \"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8\": container with ID starting with 13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8 not found: ID does not exist" Sep 11 06:21:38.283221 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.283207 2578 scope.go:117] "RemoveContainer" containerID="7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570" Sep 11 06:21:38.283447 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.283427 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570"} err="failed to get container status \"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570\": rpc error: code = NotFound desc = could not find container \"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570\": container with ID starting with 7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570 not found: ID does not exist" Sep 11 06:21:38.283493 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.283447 2578 scope.go:117] "RemoveContainer" containerID="944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5" Sep 11 06:21:38.283725 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.283707 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5"} err="failed to get container status \"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5\": rpc error: code = NotFound desc = could not find container \"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5\": container with ID starting with 944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5 not found: ID does not exist" Sep 11 06:21:38.283799 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.283726 2578 scope.go:117] "RemoveContainer" containerID="d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602" Sep 11 06:21:38.283964 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.283949 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602"} err="failed to get container status \"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602\": rpc error: code = NotFound desc = could not find container \"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602\": container with ID starting with d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602 not found: ID does not exist" Sep 11 06:21:38.284009 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.283964 2578 scope.go:117] "RemoveContainer" containerID="84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7" Sep 11 06:21:38.284160 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.284143 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7"} err="failed to get container status \"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7\": rpc error: code = NotFound desc = could not find container \"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7\": container with ID starting with 84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7 not found: ID does not exist" Sep 11 06:21:38.284228 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.284161 2578 scope.go:117] "RemoveContainer" containerID="165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7" Sep 11 06:21:38.284375 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.284360 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7"} err="failed to get container status \"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7\": rpc error: code = NotFound desc = could not find container \"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7\": container with ID starting with 165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7 not found: ID does not exist" Sep 11 06:21:38.284420 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.284376 2578 scope.go:117] "RemoveContainer" containerID="cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45" Sep 11 06:21:38.284585 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.284555 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45"} err="failed to get container status \"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45\": rpc error: code = NotFound desc = could not find container \"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45\": container with ID starting with cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45 not found: ID does not exist" Sep 11 06:21:38.284648 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.284588 2578 scope.go:117] "RemoveContainer" containerID="13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8" Sep 11 06:21:38.284846 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.284829 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8"} err="failed to get container status \"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8\": rpc error: code = NotFound desc = could not find container \"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8\": container with ID starting with 13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8 not found: ID does not exist" Sep 11 06:21:38.284923 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.284847 2578 scope.go:117] "RemoveContainer" containerID="7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570" Sep 11 06:21:38.285108 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.285089 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570"} err="failed to get container status \"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570\": rpc error: code = NotFound desc = could not find container \"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570\": container with ID starting with 7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570 not found: ID does not exist" Sep 11 06:21:38.285163 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.285110 2578 scope.go:117] "RemoveContainer" containerID="944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5" Sep 11 06:21:38.285331 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.285309 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5"} err="failed to get container status \"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5\": rpc error: code = NotFound desc = could not find container \"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5\": container with ID starting with 944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5 not found: ID does not exist" Sep 11 06:21:38.285380 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.285332 2578 scope.go:117] "RemoveContainer" containerID="d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602" Sep 11 06:21:38.285647 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.285557 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602"} err="failed to get container status \"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602\": rpc error: code = NotFound desc = could not find container \"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602\": container with ID starting with d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602 not found: ID does not exist" Sep 11 06:21:38.285762 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.285650 2578 scope.go:117] "RemoveContainer" containerID="84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7" Sep 11 06:21:38.285886 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.285867 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7"} err="failed to get container status \"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7\": rpc error: code = NotFound desc = could not find container \"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7\": container with ID starting with 84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7 not found: ID does not exist" Sep 11 06:21:38.285930 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.285888 2578 scope.go:117] "RemoveContainer" containerID="165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7" Sep 11 06:21:38.286110 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.286091 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7"} err="failed to get container status \"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7\": rpc error: code = NotFound desc = could not find container \"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7\": container with ID starting with 165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7 not found: ID does not exist" Sep 11 06:21:38.286177 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.286113 2578 scope.go:117] "RemoveContainer" containerID="cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45" Sep 11 06:21:38.286338 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.286323 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45"} err="failed to get container status \"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45\": rpc error: code = NotFound desc = could not find container \"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45\": container with ID starting with cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45 not found: ID does not exist" Sep 11 06:21:38.286385 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.286338 2578 scope.go:117] "RemoveContainer" containerID="13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8" Sep 11 06:21:38.286531 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.286513 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8"} err="failed to get container status \"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8\": rpc error: code = NotFound desc = could not find container \"13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8\": container with ID starting with 13e2bc1e1c6a6e62fd9cb78b4eb6a04d4b45f170f9e3d0a72ade016d8d4484b8 not found: ID does not exist" Sep 11 06:21:38.286531 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.286528 2578 scope.go:117] "RemoveContainer" containerID="7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570" Sep 11 06:21:38.286773 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.286755 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570"} err="failed to get container status \"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570\": rpc error: code = NotFound desc = could not find container \"7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570\": container with ID starting with 7c58e8699b3cfcaa6f6b78a74294ada6349bd91ffab647e219cc88bc7734a570 not found: ID does not exist" Sep 11 06:21:38.286818 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.286773 2578 scope.go:117] "RemoveContainer" containerID="944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5" Sep 11 06:21:38.286986 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.286971 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5"} err="failed to get container status \"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5\": rpc error: code = NotFound desc = could not find container \"944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5\": container with ID starting with 944e698898b180679b211faaeb57a50163195f9a2033e20e764d1639a26359f5 not found: ID does not exist" Sep 11 06:21:38.287023 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.286986 2578 scope.go:117] "RemoveContainer" containerID="d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602" Sep 11 06:21:38.287471 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.287454 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602"} err="failed to get container status \"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602\": rpc error: code = NotFound desc = could not find container \"d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602\": container with ID starting with d06bf5809c77093ca337b7d876e25b5aaca13b90345a0d114c94a88221f99602 not found: ID does not exist" Sep 11 06:21:38.287513 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.287471 2578 scope.go:117] "RemoveContainer" containerID="84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7" Sep 11 06:21:38.287650 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.287634 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.287711 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.287694 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7"} err="failed to get container status \"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7\": rpc error: code = NotFound desc = could not find container \"84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7\": container with ID starting with 84c81a67fbecee3e0b4fe776a580cf5c840bc5ccf7320bca785b61f4d1448ec7 not found: ID does not exist" Sep 11 06:21:38.287747 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.287712 2578 scope.go:117] "RemoveContainer" containerID="165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7" Sep 11 06:21:38.287964 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.287936 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7"} err="failed to get container status \"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7\": rpc error: code = NotFound desc = could not find container \"165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7\": container with ID starting with 165c195765676359d3d1dee5784b4177b0d62386d00b7c7658efd3c9b4aea9e7 not found: ID does not exist" Sep 11 06:21:38.288043 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.287966 2578 scope.go:117] "RemoveContainer" containerID="cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45" Sep 11 06:21:38.288233 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.288189 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45"} err="failed to get container status \"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45\": rpc error: code = NotFound desc = could not find container \"cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45\": container with ID starting with cb9d06e541b6cc3dc10010a741b40b6192c7bc8f1763ed481b22b06c4e0aab45 not found: ID does not exist" Sep 11 06:21:38.290168 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.290118 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 11 06:21:38.290262 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.290144 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 11 06:21:38.290554 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.290319 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 11 06:21:38.290554 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.290145 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 11 06:21:38.290554 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.290154 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 11 06:21:38.290554 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.290154 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 11 06:21:38.290554 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.290444 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fjrqgjv8cm6pb\"" Sep 11 06:21:38.290554 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.290459 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 11 06:21:38.290554 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.290470 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 11 06:21:38.290554 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.290556 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 11 06:21:38.291005 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.290662 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 11 06:21:38.291005 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.290712 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x5n47\"" Sep 11 06:21:38.291005 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.290734 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 11 06:21:38.291005 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.290784 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 11 06:21:38.291292 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.291274 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 11 06:21:38.293536 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.293518 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 11 06:21:38.295500 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.295482 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 11 06:21:38.301701 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.301675 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 06:21:38.429238 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-web-config\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.429615 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.429615 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429263 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.429615 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429285 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.429615 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429334 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.429615 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.429615 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk4lc\" (UniqueName: \"kubernetes.io/projected/4053074d-b728-4172-8892-dd1175ed8083-kube-api-access-kk4lc\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.429615 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429414 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4053074d-b728-4172-8892-dd1175ed8083-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.429615 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.429615 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429492 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-config\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.429615 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.429615 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429545 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.429615 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429585 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.429615 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4053074d-b728-4172-8892-dd1175ed8083-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.429615 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.430065 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4053074d-b728-4172-8892-dd1175ed8083-config-out\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.430065 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.430065 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.430065 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429718 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.430065 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.429744 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.530353 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530288 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.530353 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.530353 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4053074d-b728-4172-8892-dd1175ed8083-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.530537 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.530537 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530485 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4053074d-b728-4172-8892-dd1175ed8083-config-out\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.530537 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.530723 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.530723 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.530723 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.530723 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530653 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-web-config\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.530723 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.530723 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530704 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.531067 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530738 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.531067 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.531067 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530789 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.531067 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk4lc\" (UniqueName: \"kubernetes.io/projected/4053074d-b728-4172-8892-dd1175ed8083-kube-api-access-kk4lc\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.531067 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4053074d-b728-4172-8892-dd1175ed8083-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.531067 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530880 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.531067 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-config\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.531067 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.530930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.531067 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.531018 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4053074d-b728-4172-8892-dd1175ed8083-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.531809 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.531562 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.531809 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.531712 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.534055 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.532469 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.534055 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.533169 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.534055 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.533534 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.534055 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.533850 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.534055 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.533985 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.534841 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.534143 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4053074d-b728-4172-8892-dd1175ed8083-config-out\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.534841 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.534292 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4053074d-b728-4172-8892-dd1175ed8083-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.534841 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.534782 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.535072 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.535022 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-web-config\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.535496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.535457 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.535976 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.535954 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.536298 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.536280 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4053074d-b728-4172-8892-dd1175ed8083-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.536495 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.536466 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.536852 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.536831 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-config\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.536933 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.536919 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.537290 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.537268 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4053074d-b728-4172-8892-dd1175ed8083-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.541118 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.541099 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk4lc\" (UniqueName: \"kubernetes.io/projected/4053074d-b728-4172-8892-dd1175ed8083-kube-api-access-kk4lc\") pod \"prometheus-k8s-0\" (UID: \"4053074d-b728-4172-8892-dd1175ed8083\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.598068 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.598043 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:38.882680 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:38.882654 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 06:21:38.883926 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:21:38.883899 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4053074d_b728_4172_8892_dd1175ed8083.slice/crio-fb635e2a23a6c7579a06ce4954d7379f42ea7b1a1619f8e276e5f030b3fd63cf WatchSource:0}: Error finding container fb635e2a23a6c7579a06ce4954d7379f42ea7b1a1619f8e276e5f030b3fd63cf: Status 404 returned error can't find the container with id fb635e2a23a6c7579a06ce4954d7379f42ea7b1a1619f8e276e5f030b3fd63cf Sep 11 06:21:39.233157 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:39.233073 2578 generic.go:356] "Generic (PLEG): container finished" podID="4053074d-b728-4172-8892-dd1175ed8083" containerID="a97b9e9466f62940fe34195e315c2182b736373803553e3c1b83dc425822ff91" exitCode=0 Sep 11 06:21:39.233157 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:39.233110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4053074d-b728-4172-8892-dd1175ed8083","Type":"ContainerDied","Data":"a97b9e9466f62940fe34195e315c2182b736373803553e3c1b83dc425822ff91"} Sep 11 06:21:39.233325 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:39.233171 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4053074d-b728-4172-8892-dd1175ed8083","Type":"ContainerStarted","Data":"fb635e2a23a6c7579a06ce4954d7379f42ea7b1a1619f8e276e5f030b3fd63cf"} Sep 11 06:21:39.400111 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:39.400080 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="136cc91a-91c7-4673-a9a5-8621ea387ccd" path="/var/lib/kubelet/pods/136cc91a-91c7-4673-a9a5-8621ea387ccd/volumes" Sep 11 06:21:39.941819 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:39.941786 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:21:40.086973 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:40.086932 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:21:40.187493 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:40.187456 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:21:40.241000 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:40.240919 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4053074d-b728-4172-8892-dd1175ed8083","Type":"ContainerStarted","Data":"205139e2b3d544a19c0f04dd5547871cf766e55be89353d93ab29f75d912d0b3"} Sep 11 06:21:40.241000 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:40.240980 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4053074d-b728-4172-8892-dd1175ed8083","Type":"ContainerStarted","Data":"6c5e250bc3165d25189e2e375232954547d764dcd25d1dbd56d40943b7a854da"} Sep 11 06:21:40.241230 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:40.241007 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4053074d-b728-4172-8892-dd1175ed8083","Type":"ContainerStarted","Data":"52a5383c5ae35937ba69446a13bd11f884bb960aca9013f31f4fa69eaab2499f"} Sep 11 06:21:40.241230 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:40.241031 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4053074d-b728-4172-8892-dd1175ed8083","Type":"ContainerStarted","Data":"29e9124763af726f2cff898f2491db294e8d84f63042f2b8130bfd5502bcfd9c"} Sep 11 06:21:40.241230 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:40.241054 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4053074d-b728-4172-8892-dd1175ed8083","Type":"ContainerStarted","Data":"742111fcc6d90b668fb3ece0154c676c71c330404baf54c0ef448f78ad1abdd9"} Sep 11 06:21:40.241230 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:40.241076 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4053074d-b728-4172-8892-dd1175ed8083","Type":"ContainerStarted","Data":"7c693170c921030623d6d0a395eeb97a3c6dad3f7c25cacc9a2b7228bb04eabd"} Sep 11 06:21:40.301198 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:40.301145 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.284514624 podStartE2EDuration="2.30112947s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.614846ms" isStatefulPod=false podCreationTimestamp="2026-09-11 06:21:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:21:40.298175564 +0000 UTC m=+187.410303809" watchObservedRunningTime="2026-09-11 06:21:40.30112947 +0000 UTC m=+187.413257716" Sep 11 06:21:40.703776 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:40.703736 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:21:40.765952 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:40.765918 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:21:43.598441 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:43.598408 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:21:51.001552 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:51.001513 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:21:51.054702 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:51.054673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:21:51.112868 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:21:51.112833 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:22:14.091627 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:22:14.091560 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:22:33.835908 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:22:33.835867 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:22:33.884481 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:22:33.884453 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:22:38.598350 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:22:38.598312 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:22:38.614424 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:22:38.614400 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:22:39.475105 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:22:39.475080 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 06:22:47.204434 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:22:47.204402 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:22:47.256375 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:22:47.256343 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:22:59.182800 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:22:59.182710 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:22:59.240920 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:22:59.240886 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:23:08.751872 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:23:08.751837 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:23:08.819662 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:23:08.819631 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:23:08.898242 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:23:08.898208 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:23:08.996432 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:23:08.996398 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:23:09.486356 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:23:09.486309 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:23:09.539968 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:23:09.539937 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:23:10.823854 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:23:10.823805 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:23:10.924449 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:23:10.924419 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:23:19.331798 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:23:19.331763 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:23:19.458284 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:23:19.458250 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:23:19.512481 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:23:19.512449 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:23:33.323195 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:23:33.323165 2578 kubelet.go:1648] "Image garbage collection succeeded" Sep 11 06:23:52.235352 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:23:52.235310 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:23:53.365800 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:23:53.365766 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:13.999507 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:13.999474 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:14.768104 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:14.768068 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:17.603939 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:17.603905 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:17.659257 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:17.659229 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:19.174789 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.174746 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:19.271769 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.271740 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:19.285940 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.285917 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xxrfj"] Sep 11 06:24:19.289226 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.289212 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xxrfj" Sep 11 06:24:19.293273 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.293255 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-p9jlx\"" Sep 11 06:24:19.293517 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.293500 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 11 06:24:19.294125 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.294111 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 11 06:24:19.301468 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.301451 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xxrfj"] Sep 11 06:24:19.323252 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.323227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68cb8e3e-0e3a-4677-a3b6-c72fadc0b36f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xxrfj\" (UID: \"68cb8e3e-0e3a-4677-a3b6-c72fadc0b36f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xxrfj" Sep 11 06:24:19.323347 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.323258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76cqw\" (UniqueName: \"kubernetes.io/projected/68cb8e3e-0e3a-4677-a3b6-c72fadc0b36f-kube-api-access-76cqw\") pod \"cert-manager-webhook-6486ffd997-xxrfj\" (UID: \"68cb8e3e-0e3a-4677-a3b6-c72fadc0b36f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xxrfj" Sep 11 06:24:19.424291 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.424265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68cb8e3e-0e3a-4677-a3b6-c72fadc0b36f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xxrfj\" (UID: \"68cb8e3e-0e3a-4677-a3b6-c72fadc0b36f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xxrfj" Sep 11 06:24:19.424394 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.424293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76cqw\" (UniqueName: \"kubernetes.io/projected/68cb8e3e-0e3a-4677-a3b6-c72fadc0b36f-kube-api-access-76cqw\") pod \"cert-manager-webhook-6486ffd997-xxrfj\" (UID: \"68cb8e3e-0e3a-4677-a3b6-c72fadc0b36f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xxrfj" Sep 11 06:24:19.431792 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.431737 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68cb8e3e-0e3a-4677-a3b6-c72fadc0b36f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xxrfj\" (UID: \"68cb8e3e-0e3a-4677-a3b6-c72fadc0b36f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xxrfj" Sep 11 06:24:19.431975 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.431957 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76cqw\" (UniqueName: \"kubernetes.io/projected/68cb8e3e-0e3a-4677-a3b6-c72fadc0b36f-kube-api-access-76cqw\") pod \"cert-manager-webhook-6486ffd997-xxrfj\" (UID: \"68cb8e3e-0e3a-4677-a3b6-c72fadc0b36f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xxrfj" Sep 11 06:24:19.612551 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.612520 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xxrfj" Sep 11 06:24:19.882660 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.882545 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xxrfj"] Sep 11 06:24:19.885324 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:24:19.885291 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68cb8e3e_0e3a_4677_a3b6_c72fadc0b36f.slice/crio-fc9b42de689f14cbf37ff2271fa0d2f81db1320c810166a7ee9d0a31c7c6c8b7 WatchSource:0}: Error finding container fc9b42de689f14cbf37ff2271fa0d2f81db1320c810166a7ee9d0a31c7c6c8b7: Status 404 returned error can't find the container with id fc9b42de689f14cbf37ff2271fa0d2f81db1320c810166a7ee9d0a31c7c6c8b7 Sep 11 06:24:19.887338 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:19.887324 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 06:24:20.843766 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:20.843721 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xxrfj" event={"ID":"68cb8e3e-0e3a-4677-a3b6-c72fadc0b36f","Type":"ContainerStarted","Data":"fc9b42de689f14cbf37ff2271fa0d2f81db1320c810166a7ee9d0a31c7c6c8b7"} Sep 11 06:24:21.534860 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:21.534799 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:21.929372 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:21.929334 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:22.402017 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:22.401981 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:22.502833 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:22.502782 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:23.856997 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:23.856964 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xxrfj" event={"ID":"68cb8e3e-0e3a-4677-a3b6-c72fadc0b36f","Type":"ContainerStarted","Data":"3993787692a02fa30a20b12ca70602c6dc7930f790e8f36faa680fd099926ae3"} Sep 11 06:24:23.857462 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:23.857020 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xxrfj" Sep 11 06:24:23.873476 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:23.873435 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xxrfj" podStartSLOduration=1.6945471570000001 podStartE2EDuration="4.873420126s" totalImagesPullingTime="3.178872969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:24:23.872091266 +0000 UTC m=+350.984219511" watchObservedRunningTime="2026-09-11 06:24:23.873420126 +0000 UTC m=+350.985548372" Sep 11 06:24:29.569849 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:29.569750 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:29.744184 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:29.744150 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:29.805337 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:29.805304 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:29.863061 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:29.863036 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xxrfj" Sep 11 06:24:33.658069 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:33.658033 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:33.757637 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:33.757607 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:44.819051 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:44.818996 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:44.917172 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:44.917133 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:47.107486 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:47.107451 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-m2bzd"] Sep 11 06:24:47.110844 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:47.110825 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-m2bzd" Sep 11 06:24:47.113400 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:47.113382 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 11 06:24:47.113488 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:47.113386 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-9c6sl\"" Sep 11 06:24:47.114171 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:47.114158 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 11 06:24:47.122560 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:47.122540 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-m2bzd"] Sep 11 06:24:47.237743 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:47.237709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/770dc90b-3c0b-4ed3-846e-321c0475f89c-tmp\") pod \"jobset-operator-5bc45f897-m2bzd\" (UID: \"770dc90b-3c0b-4ed3-846e-321c0475f89c\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-m2bzd" Sep 11 06:24:47.237910 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:47.237767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv2ct\" (UniqueName: \"kubernetes.io/projected/770dc90b-3c0b-4ed3-846e-321c0475f89c-kube-api-access-lv2ct\") pod \"jobset-operator-5bc45f897-m2bzd\" (UID: \"770dc90b-3c0b-4ed3-846e-321c0475f89c\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-m2bzd" Sep 11 06:24:47.338790 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:47.338752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/770dc90b-3c0b-4ed3-846e-321c0475f89c-tmp\") pod \"jobset-operator-5bc45f897-m2bzd\" (UID: \"770dc90b-3c0b-4ed3-846e-321c0475f89c\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-m2bzd" Sep 11 06:24:47.338941 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:47.338820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv2ct\" (UniqueName: \"kubernetes.io/projected/770dc90b-3c0b-4ed3-846e-321c0475f89c-kube-api-access-lv2ct\") pod \"jobset-operator-5bc45f897-m2bzd\" (UID: \"770dc90b-3c0b-4ed3-846e-321c0475f89c\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-m2bzd" Sep 11 06:24:47.339116 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:47.339101 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/770dc90b-3c0b-4ed3-846e-321c0475f89c-tmp\") pod \"jobset-operator-5bc45f897-m2bzd\" (UID: \"770dc90b-3c0b-4ed3-846e-321c0475f89c\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-m2bzd" Sep 11 06:24:47.346751 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:47.346730 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv2ct\" (UniqueName: \"kubernetes.io/projected/770dc90b-3c0b-4ed3-846e-321c0475f89c-kube-api-access-lv2ct\") pod \"jobset-operator-5bc45f897-m2bzd\" (UID: \"770dc90b-3c0b-4ed3-846e-321c0475f89c\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-m2bzd" Sep 11 06:24:47.420275 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:47.420215 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-m2bzd" Sep 11 06:24:47.689131 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:47.689105 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-m2bzd"] Sep 11 06:24:47.691613 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:24:47.691582 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod770dc90b_3c0b_4ed3_846e_321c0475f89c.slice/crio-743d664b9f10219707460f47b9b67b0d6c8d99055e5604dc88d728d01647d7d9 WatchSource:0}: Error finding container 743d664b9f10219707460f47b9b67b0d6c8d99055e5604dc88d728d01647d7d9: Status 404 returned error can't find the container with id 743d664b9f10219707460f47b9b67b0d6c8d99055e5604dc88d728d01647d7d9 Sep 11 06:24:47.949858 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:47.949779 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-m2bzd" event={"ID":"770dc90b-3c0b-4ed3-846e-321c0475f89c","Type":"ContainerStarted","Data":"743d664b9f10219707460f47b9b67b0d6c8d99055e5604dc88d728d01647d7d9"} Sep 11 06:24:50.964243 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:50.964206 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-m2bzd" event={"ID":"770dc90b-3c0b-4ed3-846e-321c0475f89c","Type":"ContainerStarted","Data":"208e9858332ea0c676c8360cb7c4babe55d09475e17feef6cb8ba7bc8b944ee6"} Sep 11 06:24:50.978933 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:50.978891 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-m2bzd" podStartSLOduration=1.486548476 podStartE2EDuration="3.97887695s" totalImagesPullingTime="2.492328474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:24:50.978351032 +0000 UTC m=+378.090479278" watchObservedRunningTime="2026-09-11 06:24:50.97887695 +0000 UTC m=+378.091005190" Sep 11 06:24:54.834817 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:54.834788 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:56.394492 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:56.394459 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:59.347702 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:59.347659 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:24:59.404101 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:24:59.404031 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:25:07.870995 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:25:07.870937 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:25:08.076814 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:25:08.076778 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:25:33.490626 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:25:33.490590 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:25:47.805236 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:25:47.805156 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:25:53.910469 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:25:53.910428 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:25:54.012471 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:25:54.012437 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:25:54.298252 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:25:54.298182 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:25:54.595241 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:25:54.595200 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:26:16.598421 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:16.598385 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:26:22.666922 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:22.666890 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:26:22.720549 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:22.720515 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:26:23.271790 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:23.271758 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:26:33.228041 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:33.228006 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:26:33.363801 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:33.363768 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:26:33.464497 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:33.464465 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:26:39.929445 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:39.929404 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:26:40.029864 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:40.029833 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:26:42.386458 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.386425 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls"] Sep 11 06:26:42.387897 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.387871 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:26:42.389650 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.389635 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" Sep 11 06:26:42.391903 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.391883 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 11 06:26:42.391989 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.391892 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 11 06:26:42.393122 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.393104 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 11 06:26:42.393122 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.393120 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 11 06:26:42.393237 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.393134 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-rplvt\"" Sep 11 06:26:42.397887 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.397862 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls"] Sep 11 06:26:42.427260 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.427231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f5545-ca11-4f79-bda1-925070a6b57d-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-qh4ls\" (UID: \"508f5545-ca11-4f79-bda1-925070a6b57d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" Sep 11 06:26:42.427369 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.427274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sdh9\" (UniqueName: \"kubernetes.io/projected/508f5545-ca11-4f79-bda1-925070a6b57d-kube-api-access-5sdh9\") pod \"kubeflow-trainer-controller-manager-7f9b886978-qh4ls\" (UID: \"508f5545-ca11-4f79-bda1-925070a6b57d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" Sep 11 06:26:42.427369 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.427306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/508f5545-ca11-4f79-bda1-925070a6b57d-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-qh4ls\" (UID: \"508f5545-ca11-4f79-bda1-925070a6b57d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" Sep 11 06:26:42.528725 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.528691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f5545-ca11-4f79-bda1-925070a6b57d-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-qh4ls\" (UID: \"508f5545-ca11-4f79-bda1-925070a6b57d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" Sep 11 06:26:42.528911 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.528737 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sdh9\" (UniqueName: \"kubernetes.io/projected/508f5545-ca11-4f79-bda1-925070a6b57d-kube-api-access-5sdh9\") pod \"kubeflow-trainer-controller-manager-7f9b886978-qh4ls\" (UID: \"508f5545-ca11-4f79-bda1-925070a6b57d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" Sep 11 06:26:42.528911 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.528757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/508f5545-ca11-4f79-bda1-925070a6b57d-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-qh4ls\" (UID: \"508f5545-ca11-4f79-bda1-925070a6b57d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" Sep 11 06:26:42.529375 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.529358 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/508f5545-ca11-4f79-bda1-925070a6b57d-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-qh4ls\" (UID: \"508f5545-ca11-4f79-bda1-925070a6b57d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" Sep 11 06:26:42.531159 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.531141 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f5545-ca11-4f79-bda1-925070a6b57d-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-qh4ls\" (UID: \"508f5545-ca11-4f79-bda1-925070a6b57d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" Sep 11 06:26:42.539679 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.539656 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sdh9\" (UniqueName: \"kubernetes.io/projected/508f5545-ca11-4f79-bda1-925070a6b57d-kube-api-access-5sdh9\") pod \"kubeflow-trainer-controller-manager-7f9b886978-qh4ls\" (UID: \"508f5545-ca11-4f79-bda1-925070a6b57d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" Sep 11 06:26:42.675158 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.675082 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:26:42.698899 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.698877 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" Sep 11 06:26:42.771743 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.771705 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:26:42.968686 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:42.968621 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls"] Sep 11 06:26:42.972048 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:26:42.972025 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod508f5545_ca11_4f79_bda1_925070a6b57d.slice/crio-645853d284c6246f14962703eabe3d6a789f59bdcdc7c5595bf62d48c212d4d3 WatchSource:0}: Error finding container 645853d284c6246f14962703eabe3d6a789f59bdcdc7c5595bf62d48c212d4d3: Status 404 returned error can't find the container with id 645853d284c6246f14962703eabe3d6a789f59bdcdc7c5595bf62d48c212d4d3 Sep 11 06:26:43.390397 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:43.390348 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" event={"ID":"508f5545-ca11-4f79-bda1-925070a6b57d","Type":"ContainerStarted","Data":"645853d284c6246f14962703eabe3d6a789f59bdcdc7c5595bf62d48c212d4d3"} Sep 11 06:26:45.400390 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:45.400350 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" event={"ID":"508f5545-ca11-4f79-bda1-925070a6b57d","Type":"ContainerStarted","Data":"e2eab804d29d0ba6ec28760a7d6a0a876af34c3cc4dd4b1a56c5eb68ffb4a276"} Sep 11 06:26:45.400857 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:45.400428 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" Sep 11 06:26:45.416820 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:45.416776 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" podStartSLOduration=1.371031891 podStartE2EDuration="3.416762587s" totalImagesPullingTime="2.045730696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:26:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:26:45.416064462 +0000 UTC m=+492.528192708" watchObservedRunningTime="2026-09-11 06:26:45.416762587 +0000 UTC m=+492.528890832" Sep 11 06:26:45.771406 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:45.771325 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:26:45.875375 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:26:45.875343 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:27:01.409654 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:27:01.409627 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" Sep 11 06:27:03.124928 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:27:03.124889 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:28:24.381594 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:24.381530 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:28:24.584197 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:24.584158 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:28:24.588462 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:24.588436 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls"] Sep 11 06:28:24.588660 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:24.588639 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" podUID="508f5545-ca11-4f79-bda1-925070a6b57d" containerName="manager" containerID="cri-o://e2eab804d29d0ba6ec28760a7d6a0a876af34c3cc4dd4b1a56c5eb68ffb4a276" gracePeriod=30 Sep 11 06:28:24.684684 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:24.684601 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:28:24.782078 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:24.782051 2578 generic.go:356] "Generic (PLEG): container finished" podID="508f5545-ca11-4f79-bda1-925070a6b57d" containerID="e2eab804d29d0ba6ec28760a7d6a0a876af34c3cc4dd4b1a56c5eb68ffb4a276" exitCode=0 Sep 11 06:28:24.782231 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:24.782114 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" event={"ID":"508f5545-ca11-4f79-bda1-925070a6b57d","Type":"ContainerDied","Data":"e2eab804d29d0ba6ec28760a7d6a0a876af34c3cc4dd4b1a56c5eb68ffb4a276"} Sep 11 06:28:24.826498 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:24.826476 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" Sep 11 06:28:24.877280 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:24.877230 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:28:24.912792 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:24.912769 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sdh9\" (UniqueName: \"kubernetes.io/projected/508f5545-ca11-4f79-bda1-925070a6b57d-kube-api-access-5sdh9\") pod \"508f5545-ca11-4f79-bda1-925070a6b57d\" (UID: \"508f5545-ca11-4f79-bda1-925070a6b57d\") " Sep 11 06:28:24.912945 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:24.912857 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/508f5545-ca11-4f79-bda1-925070a6b57d-kubeflow-trainer-config\") pod \"508f5545-ca11-4f79-bda1-925070a6b57d\" (UID: \"508f5545-ca11-4f79-bda1-925070a6b57d\") " Sep 11 06:28:24.912945 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:24.912922 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f5545-ca11-4f79-bda1-925070a6b57d-cert\") pod \"508f5545-ca11-4f79-bda1-925070a6b57d\" (UID: \"508f5545-ca11-4f79-bda1-925070a6b57d\") " Sep 11 06:28:24.915060 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:24.915029 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/508f5545-ca11-4f79-bda1-925070a6b57d-kube-api-access-5sdh9" (OuterVolumeSpecName: "kube-api-access-5sdh9") pod "508f5545-ca11-4f79-bda1-925070a6b57d" (UID: "508f5545-ca11-4f79-bda1-925070a6b57d"). InnerVolumeSpecName "kube-api-access-5sdh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 06:28:24.915160 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:24.915030 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/508f5545-ca11-4f79-bda1-925070a6b57d-cert" (OuterVolumeSpecName: "cert") pod "508f5545-ca11-4f79-bda1-925070a6b57d" (UID: "508f5545-ca11-4f79-bda1-925070a6b57d"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 06:28:24.917200 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:24.917180 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/508f5545-ca11-4f79-bda1-925070a6b57d-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "508f5545-ca11-4f79-bda1-925070a6b57d" (UID: "508f5545-ca11-4f79-bda1-925070a6b57d"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 06:28:24.930180 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:24.930154 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:28:25.014396 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:25.014323 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sdh9\" (UniqueName: \"kubernetes.io/projected/508f5545-ca11-4f79-bda1-925070a6b57d-kube-api-access-5sdh9\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:28:25.014396 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:25.014359 2578 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/508f5545-ca11-4f79-bda1-925070a6b57d-kubeflow-trainer-config\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:28:25.014396 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:25.014368 2578 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508f5545-ca11-4f79-bda1-925070a6b57d-cert\") on node \"ip-10-0-135-168.ec2.internal\" DevicePath \"\"" Sep 11 06:28:25.727444 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:25.727372 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:28:25.780730 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:25.780707 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:28:25.787022 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:25.786996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" event={"ID":"508f5545-ca11-4f79-bda1-925070a6b57d","Type":"ContainerDied","Data":"645853d284c6246f14962703eabe3d6a789f59bdcdc7c5595bf62d48c212d4d3"} Sep 11 06:28:25.787134 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:25.787020 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls" Sep 11 06:28:25.787134 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:25.787034 2578 scope.go:117] "RemoveContainer" containerID="e2eab804d29d0ba6ec28760a7d6a0a876af34c3cc4dd4b1a56c5eb68ffb4a276" Sep 11 06:28:25.807281 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:25.807256 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls"] Sep 11 06:28:25.810625 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:25.810606 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-qh4ls"] Sep 11 06:28:27.399348 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:28:27.399316 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="508f5545-ca11-4f79-bda1-925070a6b57d" path="/var/lib/kubelet/pods/508f5545-ca11-4f79-bda1-925070a6b57d/volumes" Sep 11 06:29:07.553557 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:07.553474 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:29:09.255552 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:09.255523 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:29:19.166640 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.166601 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:29:19.297496 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.297462 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q2stp/must-gather-2tcgb"] Sep 11 06:29:19.297797 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.297785 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="508f5545-ca11-4f79-bda1-925070a6b57d" containerName="manager" Sep 11 06:29:19.297843 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.297799 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="508f5545-ca11-4f79-bda1-925070a6b57d" containerName="manager" Sep 11 06:29:19.297881 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.297861 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="508f5545-ca11-4f79-bda1-925070a6b57d" containerName="manager" Sep 11 06:29:19.300749 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.300734 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q2stp/must-gather-2tcgb" Sep 11 06:29:19.302800 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.302779 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q2stp\"/\"openshift-service-ca.crt\"" Sep 11 06:29:19.303026 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.303009 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q2stp\"/\"kube-root-ca.crt\"" Sep 11 06:29:19.303074 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.303021 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q2stp\"/\"default-dockercfg-phkmd\"" Sep 11 06:29:19.310557 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.310534 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q2stp/must-gather-2tcgb"] Sep 11 06:29:19.318748 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.318637 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:29:19.370935 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.370910 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:29:19.425725 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.425661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e72f4cf4-8aae-4f8f-b473-727e9a9a99bc-must-gather-output\") pod \"must-gather-2tcgb\" (UID: \"e72f4cf4-8aae-4f8f-b473-727e9a9a99bc\") " pod="openshift-must-gather-q2stp/must-gather-2tcgb" Sep 11 06:29:19.425825 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.425731 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqr2j\" (UniqueName: \"kubernetes.io/projected/e72f4cf4-8aae-4f8f-b473-727e9a9a99bc-kube-api-access-kqr2j\") pod \"must-gather-2tcgb\" (UID: \"e72f4cf4-8aae-4f8f-b473-727e9a9a99bc\") " pod="openshift-must-gather-q2stp/must-gather-2tcgb" Sep 11 06:29:19.526490 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.526458 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqr2j\" (UniqueName: \"kubernetes.io/projected/e72f4cf4-8aae-4f8f-b473-727e9a9a99bc-kube-api-access-kqr2j\") pod \"must-gather-2tcgb\" (UID: \"e72f4cf4-8aae-4f8f-b473-727e9a9a99bc\") " pod="openshift-must-gather-q2stp/must-gather-2tcgb" Sep 11 06:29:19.526656 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.526502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e72f4cf4-8aae-4f8f-b473-727e9a9a99bc-must-gather-output\") pod \"must-gather-2tcgb\" (UID: \"e72f4cf4-8aae-4f8f-b473-727e9a9a99bc\") " pod="openshift-must-gather-q2stp/must-gather-2tcgb" Sep 11 06:29:19.526825 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.526807 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e72f4cf4-8aae-4f8f-b473-727e9a9a99bc-must-gather-output\") pod \"must-gather-2tcgb\" (UID: \"e72f4cf4-8aae-4f8f-b473-727e9a9a99bc\") " pod="openshift-must-gather-q2stp/must-gather-2tcgb" Sep 11 06:29:19.534427 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.534399 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqr2j\" (UniqueName: \"kubernetes.io/projected/e72f4cf4-8aae-4f8f-b473-727e9a9a99bc-kube-api-access-kqr2j\") pod \"must-gather-2tcgb\" (UID: \"e72f4cf4-8aae-4f8f-b473-727e9a9a99bc\") " pod="openshift-must-gather-q2stp/must-gather-2tcgb" Sep 11 06:29:19.610011 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.609975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q2stp/must-gather-2tcgb" Sep 11 06:29:19.878437 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:19.878412 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q2stp/must-gather-2tcgb"] Sep 11 06:29:19.880965 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:29:19.880932 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode72f4cf4_8aae_4f8f_b473_727e9a9a99bc.slice/crio-db0c3965e47399b03e7ca5c495b98f8ddd97d7b0997560e7590613b8226dd57d WatchSource:0}: Error finding container db0c3965e47399b03e7ca5c495b98f8ddd97d7b0997560e7590613b8226dd57d: Status 404 returned error can't find the container with id db0c3965e47399b03e7ca5c495b98f8ddd97d7b0997560e7590613b8226dd57d Sep 11 06:29:20.005175 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:20.005141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q2stp/must-gather-2tcgb" event={"ID":"e72f4cf4-8aae-4f8f-b473-727e9a9a99bc","Type":"ContainerStarted","Data":"db0c3965e47399b03e7ca5c495b98f8ddd97d7b0997560e7590613b8226dd57d"} Sep 11 06:29:21.012690 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:21.012604 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q2stp/must-gather-2tcgb" event={"ID":"e72f4cf4-8aae-4f8f-b473-727e9a9a99bc","Type":"ContainerStarted","Data":"8744649d10eb09626090f75647ea1750d2d4bbcc2b88d8b6b02f90d826d749ba"} Sep 11 06:29:21.012690 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:21.012660 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q2stp/must-gather-2tcgb" event={"ID":"e72f4cf4-8aae-4f8f-b473-727e9a9a99bc","Type":"ContainerStarted","Data":"764d7ac7de18382a33b9056b8d5e4a4e439da508e74d18f841aaa65a0aee5aed"} Sep 11 06:29:21.030766 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:21.029837 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q2stp/must-gather-2tcgb" podStartSLOduration=1.242083425 podStartE2EDuration="2.029817981s" totalImagesPullingTime="787.734556ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 06:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:29:21.027465612 +0000 UTC m=+648.139593857" watchObservedRunningTime="2026-09-11 06:29:21.029817981 +0000 UTC m=+648.141946227" Sep 11 06:29:21.986662 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:21.986635 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-db87s_7c2ecfe5-716f-4fd8-93d4-fa48cbc38cc6/global-pull-secret-syncer/0.log" Sep 11 06:29:22.118524 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:22.118477 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" Sep 11 06:29:22.185106 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:22.185069 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-168.ec2.internal_fa6ea2416a19c5884a3df0b3ea9c984b/haproxy/0.log" Sep 11 06:29:24.714040 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:24.714001 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:29:24.768851 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:24.768813 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7wkvx_59a3c67d-d236-44e3-ba64-5253f5ca2087/konnectivity-agent/0.log" limit=1024 Sep 11 06:29:26.542542 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:26.542508 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-nxm7d_621d5ece-3c16-410c-9076-bd6ced92553c/cluster-monitoring-operator/0.log" Sep 11 06:29:26.769828 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:26.769798 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xz5qq_5765f3de-6fb5-431e-95b5-cfa6de8d3fed/node-exporter/0.log" Sep 11 06:29:26.789373 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:26.789261 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xz5qq_5765f3de-6fb5-431e-95b5-cfa6de8d3fed/kube-rbac-proxy/0.log" Sep 11 06:29:26.809330 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:26.809303 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xz5qq_5765f3de-6fb5-431e-95b5-cfa6de8d3fed/init-textfile/0.log" Sep 11 06:29:26.915538 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:26.915468 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-z8925_a6b70ee8-4123-4002-8745-b1d3f456e8bb/kube-rbac-proxy-main/0.log" Sep 11 06:29:26.938871 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:26.938838 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-z8925_a6b70ee8-4123-4002-8745-b1d3f456e8bb/kube-rbac-proxy-self/0.log" Sep 11 06:29:26.963843 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:26.963817 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-z8925_a6b70ee8-4123-4002-8745-b1d3f456e8bb/openshift-state-metrics/0.log" Sep 11 06:29:27.000227 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:27.000178 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4053074d-b728-4172-8892-dd1175ed8083/prometheus/0.log" Sep 11 06:29:27.024639 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:27.024612 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4053074d-b728-4172-8892-dd1175ed8083/config-reloader/0.log" Sep 11 06:29:27.046674 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:27.046604 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4053074d-b728-4172-8892-dd1175ed8083/thanos-sidecar/0.log" Sep 11 06:29:27.070163 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:27.070139 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4053074d-b728-4172-8892-dd1175ed8083/kube-rbac-proxy-web/0.log" Sep 11 06:29:27.094342 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:27.094312 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4053074d-b728-4172-8892-dd1175ed8083/kube-rbac-proxy/0.log" Sep 11 06:29:27.126168 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:27.126144 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4053074d-b728-4172-8892-dd1175ed8083/kube-rbac-proxy-thanos/0.log" Sep 11 06:29:27.163191 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:27.163107 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4053074d-b728-4172-8892-dd1175ed8083/init-config-reloader/0.log" Sep 11 06:29:27.404878 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:27.404853 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ff96bd95c-cz2pn_6713f712-fc39-4571-a7a0-8e6853142590/thanos-query/0.log" Sep 11 06:29:27.434490 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:27.434462 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ff96bd95c-cz2pn_6713f712-fc39-4571-a7a0-8e6853142590/kube-rbac-proxy-web/0.log" Sep 11 06:29:27.463522 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:27.463491 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ff96bd95c-cz2pn_6713f712-fc39-4571-a7a0-8e6853142590/kube-rbac-proxy/0.log" Sep 11 06:29:27.489519 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:27.489490 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ff96bd95c-cz2pn_6713f712-fc39-4571-a7a0-8e6853142590/prom-label-proxy/0.log" Sep 11 06:29:27.519191 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:27.519144 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ff96bd95c-cz2pn_6713f712-fc39-4571-a7a0-8e6853142590/kube-rbac-proxy-rules/0.log" Sep 11 06:29:27.537414 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:27.537366 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ff96bd95c-cz2pn_6713f712-fc39-4571-a7a0-8e6853142590/kube-rbac-proxy-metrics/0.log" Sep 11 06:29:28.724933 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:28.724901 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-qb8kn_46e3967b-12e9-4d7f-9d6a-d5424edd1ddc/networking-console-plugin/0.log" Sep 11 06:29:29.585345 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.585299 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w"] Sep 11 06:29:29.590681 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.590642 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:29.597406 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.597371 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w"] Sep 11 06:29:29.720744 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.720707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f128c222-0a03-4450-ba95-1ca425e3631b-proc\") pod \"perf-node-gather-daemonset-pxg4w\" (UID: \"f128c222-0a03-4450-ba95-1ca425e3631b\") " pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:29.720744 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.720743 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvgmk\" (UniqueName: \"kubernetes.io/projected/f128c222-0a03-4450-ba95-1ca425e3631b-kube-api-access-jvgmk\") pod \"perf-node-gather-daemonset-pxg4w\" (UID: \"f128c222-0a03-4450-ba95-1ca425e3631b\") " pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:29.720984 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.720772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f128c222-0a03-4450-ba95-1ca425e3631b-sys\") pod \"perf-node-gather-daemonset-pxg4w\" (UID: \"f128c222-0a03-4450-ba95-1ca425e3631b\") " pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:29.720984 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.720854 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f128c222-0a03-4450-ba95-1ca425e3631b-lib-modules\") pod \"perf-node-gather-daemonset-pxg4w\" (UID: \"f128c222-0a03-4450-ba95-1ca425e3631b\") " pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:29.720984 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.720939 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f128c222-0a03-4450-ba95-1ca425e3631b-podres\") pod \"perf-node-gather-daemonset-pxg4w\" (UID: \"f128c222-0a03-4450-ba95-1ca425e3631b\") " pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:29.822540 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.822404 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f128c222-0a03-4450-ba95-1ca425e3631b-sys\") pod \"perf-node-gather-daemonset-pxg4w\" (UID: \"f128c222-0a03-4450-ba95-1ca425e3631b\") " pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:29.823134 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.823112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f128c222-0a03-4450-ba95-1ca425e3631b-lib-modules\") pod \"perf-node-gather-daemonset-pxg4w\" (UID: \"f128c222-0a03-4450-ba95-1ca425e3631b\") " pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:29.823477 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.823458 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f128c222-0a03-4450-ba95-1ca425e3631b-podres\") pod \"perf-node-gather-daemonset-pxg4w\" (UID: \"f128c222-0a03-4450-ba95-1ca425e3631b\") " pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:29.823773 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.823756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f128c222-0a03-4450-ba95-1ca425e3631b-proc\") pod \"perf-node-gather-daemonset-pxg4w\" (UID: \"f128c222-0a03-4450-ba95-1ca425e3631b\") " pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:29.823987 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.823971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvgmk\" (UniqueName: \"kubernetes.io/projected/f128c222-0a03-4450-ba95-1ca425e3631b-kube-api-access-jvgmk\") pod \"perf-node-gather-daemonset-pxg4w\" (UID: \"f128c222-0a03-4450-ba95-1ca425e3631b\") " pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:29.824199 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.823352 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f128c222-0a03-4450-ba95-1ca425e3631b-lib-modules\") pod \"perf-node-gather-daemonset-pxg4w\" (UID: \"f128c222-0a03-4450-ba95-1ca425e3631b\") " pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:29.824199 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.823921 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f128c222-0a03-4450-ba95-1ca425e3631b-proc\") pod \"perf-node-gather-daemonset-pxg4w\" (UID: \"f128c222-0a03-4450-ba95-1ca425e3631b\") " pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:29.824369 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.822519 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f128c222-0a03-4450-ba95-1ca425e3631b-sys\") pod \"perf-node-gather-daemonset-pxg4w\" (UID: \"f128c222-0a03-4450-ba95-1ca425e3631b\") " pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:29.824369 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.823671 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f128c222-0a03-4450-ba95-1ca425e3631b-podres\") pod \"perf-node-gather-daemonset-pxg4w\" (UID: \"f128c222-0a03-4450-ba95-1ca425e3631b\") " pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:29.832790 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.832765 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvgmk\" (UniqueName: \"kubernetes.io/projected/f128c222-0a03-4450-ba95-1ca425e3631b-kube-api-access-jvgmk\") pod \"perf-node-gather-daemonset-pxg4w\" (UID: \"f128c222-0a03-4450-ba95-1ca425e3631b\") " pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:29.909872 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:29.909264 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:30.208300 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:30.208228 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w"] Sep 11 06:29:30.212305 ip-10-0-135-168 kubenswrapper[2578]: W0911 06:29:30.212275 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf128c222_0a03_4450_ba95_1ca425e3631b.slice/crio-ac0b1260218479efd5e2df54a01e61062a1771ff553692012c9eb7c382c2bbf5 WatchSource:0}: Error finding container ac0b1260218479efd5e2df54a01e61062a1771ff553692012c9eb7c382c2bbf5: Status 404 returned error can't find the container with id ac0b1260218479efd5e2df54a01e61062a1771ff553692012c9eb7c382c2bbf5 Sep 11 06:29:30.831780 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:30.831753 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8ns64_6135cb51-9023-4dd4-bafa-ee4e4a6a667d/dns/0.log" Sep 11 06:29:30.850299 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:30.850279 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8ns64_6135cb51-9023-4dd4-bafa-ee4e4a6a667d/kube-rbac-proxy/0.log" Sep 11 06:29:30.951717 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:30.951686 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lzqnp_a2f7b95d-3f2a-4c11-a467-c3d3e6badf84/dns-node-resolver/0.log" Sep 11 06:29:31.069529 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:31.069498 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" event={"ID":"f128c222-0a03-4450-ba95-1ca425e3631b","Type":"ContainerStarted","Data":"a763f4da41391e40f0bd09ce258f46e73d056ebc2153391afa591c1c180ad675"} Sep 11 06:29:31.069723 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:31.069556 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" event={"ID":"f128c222-0a03-4450-ba95-1ca425e3631b","Type":"ContainerStarted","Data":"ac0b1260218479efd5e2df54a01e61062a1771ff553692012c9eb7c382c2bbf5"} Sep 11 06:29:31.069723 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:31.069654 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:31.085846 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:31.085736 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" podStartSLOduration=2.085718476 podStartE2EDuration="2.085718476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 06:29:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 06:29:31.084070585 +0000 UTC m=+658.196198831" watchObservedRunningTime="2026-09-11 06:29:31.085718476 +0000 UTC m=+658.197846725" Sep 11 06:29:31.345263 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:31.345183 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s5kw4_f03ec2fa-ca46-4d35-aa87-bad491b6fa58/node-ca/0.log" Sep 11 06:29:32.312029 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:32.312001 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ln8dz_edc8ff17-b5a6-438b-8065-36b26e4c6da8/serve-healthcheck-canary/0.log" Sep 11 06:29:32.649954 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:32.649901 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-kcmwr_1be16ffd-0ce2-4529-bcf6-91d1be5a385f/insights-operator/1.log" Sep 11 06:29:32.650242 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:32.650224 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-kcmwr_1be16ffd-0ce2-4529-bcf6-91d1be5a385f/insights-operator/0.log" Sep 11 06:29:32.669904 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:32.669870 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6r98r_e7977cda-d1fc-4a6b-90c8-6a034606d0fb/kube-rbac-proxy/0.log" Sep 11 06:29:32.692418 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:32.692397 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6r98r_e7977cda-d1fc-4a6b-90c8-6a034606d0fb/exporter/0.log" Sep 11 06:29:32.711478 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:32.711434 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6r98r_e7977cda-d1fc-4a6b-90c8-6a034606d0fb/extractor/0.log" Sep 11 06:29:34.420722 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:34.420692 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-m2bzd_770dc90b-3c0b-4ed3-846e-321c0475f89c/jobset-operator/0.log" Sep 11 06:29:37.088405 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:37.088373 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q2stp/perf-node-gather-daemonset-pxg4w" Sep 11 06:29:37.815449 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:37.815420 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-vw689_81ccae4f-37aa-454a-9b7a-498b90c7db36/kube-storage-version-migrator-operator/1.log" Sep 11 06:29:37.817334 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:37.817304 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-vw689_81ccae4f-37aa-454a-9b7a-498b90c7db36/kube-storage-version-migrator-operator/0.log" Sep 11 06:29:39.138246 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:39.138217 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zw5v6_5746b0e0-5a64-4b42-8ccb-21f7ecfc66de/kube-multus-additional-cni-plugins/0.log" Sep 11 06:29:39.157278 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:39.157246 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zw5v6_5746b0e0-5a64-4b42-8ccb-21f7ecfc66de/egress-router-binary-copy/0.log" Sep 11 06:29:39.177237 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:39.177205 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zw5v6_5746b0e0-5a64-4b42-8ccb-21f7ecfc66de/cni-plugins/0.log" Sep 11 06:29:39.203016 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:39.202983 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zw5v6_5746b0e0-5a64-4b42-8ccb-21f7ecfc66de/bond-cni-plugin/0.log" Sep 11 06:29:39.223012 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:39.222976 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zw5v6_5746b0e0-5a64-4b42-8ccb-21f7ecfc66de/routeoverride-cni/0.log" Sep 11 06:29:39.240047 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:39.240027 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zw5v6_5746b0e0-5a64-4b42-8ccb-21f7ecfc66de/whereabouts-cni-bincopy/0.log" Sep 11 06:29:39.260999 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:39.260979 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zw5v6_5746b0e0-5a64-4b42-8ccb-21f7ecfc66de/whereabouts-cni/0.log" Sep 11 06:29:39.293444 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:39.293373 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mm84v_be86ac5f-0bf8-4641-8ece-4eef5ab1d580/kube-multus/0.log" Sep 11 06:29:39.373119 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:39.373089 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7mpnr_b5bab53c-ef28-4f24-a84e-640462c08884/network-metrics-daemon/0.log" Sep 11 06:29:39.389001 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:39.388977 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7mpnr_b5bab53c-ef28-4f24-a84e-640462c08884/kube-rbac-proxy/0.log" Sep 11 06:29:40.352440 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:40.352412 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gkzwh_39545d0c-44ed-4a03-a545-f0e61abb52d0/ovn-controller/0.log" Sep 11 06:29:40.371546 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:40.371525 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gkzwh_39545d0c-44ed-4a03-a545-f0e61abb52d0/ovn-acl-logging/0.log" Sep 11 06:29:40.396471 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:40.396449 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gkzwh_39545d0c-44ed-4a03-a545-f0e61abb52d0/kube-rbac-proxy-node/0.log" Sep 11 06:29:40.418216 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:40.418186 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gkzwh_39545d0c-44ed-4a03-a545-f0e61abb52d0/kube-rbac-proxy-ovn-metrics/0.log" Sep 11 06:29:40.439594 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:40.439544 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gkzwh_39545d0c-44ed-4a03-a545-f0e61abb52d0/northd/0.log" Sep 11 06:29:40.459741 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:40.459696 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gkzwh_39545d0c-44ed-4a03-a545-f0e61abb52d0/nbdb/0.log" Sep 11 06:29:40.482111 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:40.482085 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gkzwh_39545d0c-44ed-4a03-a545-f0e61abb52d0/sbdb/0.log" Sep 11 06:29:40.529053 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:40.529028 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gkzwh_39545d0c-44ed-4a03-a545-f0e61abb52d0/ovnkube-controller/0.log" Sep 11 06:29:41.691965 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:41.691934 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-p8qtr_45161465-23cb-40f9-b682-809e7aeef6ac/network-check-target-container/0.log" Sep 11 06:29:42.567777 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:42.567745 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-7lw7b_9202f543-8508-4616-9b49-9c3063006a76/iptables-alerter/0.log" Sep 11 06:29:43.191639 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:43.191605 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-ftc27_02292fc4-88eb-48f2-859d-31af30865593/tuned/0.log" Sep 11 06:29:44.786468 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:44.786439 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-mfctf_311b609c-ff40-4e19-879f-03694491573c/cluster-samples-operator/0.log" Sep 11 06:29:44.800143 ip-10-0-135-168 kubenswrapper[2578]: I0911 06:29:44.800120 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-mfctf_311b609c-ff40-4e19-879f-03694491573c/cluster-samples-operator-watch/0.log"