Sep 07 12:40:43.019877 ip-10-0-139-78 systemd[1]: Starting Kubernetes Kubelet... Sep 07 12:40:43.456485 ip-10-0-139-78 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 12:40:43.456485 ip-10-0-139-78 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 07 12:40:43.456485 ip-10-0-139-78 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 12:40:43.456485 ip-10-0-139-78 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 07 12:40:43.456485 ip-10-0-139-78 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 12:40:43.457175 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.456589 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 07 12:40:43.460685 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460669 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:40:43.460685 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460684 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460687 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460691 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460694 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460697 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460699 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460702 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460704 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460708 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460710 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460713 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460716 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460719 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460728 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460733 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460736 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460739 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460741 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460744 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:40:43.460749 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460746 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460749 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460752 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460754 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460757 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460760 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460762 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460765 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460768 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460770 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460773 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460775 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460777 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460781 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460784 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460787 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460790 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460793 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460795 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460799 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:40:43.461237 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460801 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460804 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460806 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460809 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460811 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460813 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460817 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460819 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460822 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460824 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460827 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460829 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460832 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460834 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460837 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460839 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460842 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460845 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460848 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460850 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:40:43.462015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460853 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460855 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460857 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460860 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460862 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460865 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460867 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460870 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460872 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460874 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460877 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460879 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460882 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460885 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460887 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460891 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460894 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460896 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460898 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460901 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:40:43.462525 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460903 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460905 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460908 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460910 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460913 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460915 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460919 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460922 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460926 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460929 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460932 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460935 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460938 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460940 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460943 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460945 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460948 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460950 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:40:43.463114 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.460952 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:40:43.463811 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463796 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:40:43.463811 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463810 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463814 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463817 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463822 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463825 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463829 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463832 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463834 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463837 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463840 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463842 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463845 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463847 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463850 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463852 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463855 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463857 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463860 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463863 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:40:43.463873 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463865 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463869 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463872 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463875 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463879 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463883 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463886 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463889 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463892 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463894 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463896 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463899 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463902 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463904 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463907 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463909 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463912 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463914 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463917 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463919 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:40:43.464326 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463922 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463924 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463927 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463930 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463933 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463935 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463938 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463940 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463942 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463945 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463947 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463949 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463952 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463954 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463957 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463960 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463962 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463965 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463967 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463970 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:40:43.464855 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463972 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463975 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463977 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463980 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463983 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463985 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463987 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463990 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463992 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463995 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.463998 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464000 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464002 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464004 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464008 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464010 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464012 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464015 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464018 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:40:43.465343 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464020 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464023 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464025 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464028 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464031 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464034 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464036 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464041 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464043 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464046 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464048 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464051 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464053 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464056 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464058 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464060 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464063 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464065 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464068 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464070 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:40:43.465895 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464443 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464449 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464452 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464454 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464457 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464460 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464464 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464467 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464470 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464473 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464475 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464478 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464480 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464483 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464486 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464488 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464491 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464494 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464497 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464500 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:40:43.466381 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464502 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464505 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464507 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464510 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464512 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464515 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464517 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464520 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464523 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464525 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464528 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464530 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464533 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464536 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464538 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464541 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464545 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464548 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464551 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:40:43.466867 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464553 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464556 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464560 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464564 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464567 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464583 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464586 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464589 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464592 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464594 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464597 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464600 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464603 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464605 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464608 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464610 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464613 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464615 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464618 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:40:43.467341 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464620 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464623 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464625 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464628 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464631 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464633 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464635 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464638 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464642 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464645 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464647 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464651 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464654 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464657 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464659 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464662 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464664 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464667 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464669 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:40:43.467853 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464672 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464675 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464677 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464680 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464682 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464685 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464688 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464691 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464693 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464696 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464698 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464701 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464703 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464705 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464708 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464710 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464713 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464715 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464717 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464720 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:40:43.468319 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464722 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.464725 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464797 2579 flags.go:64] FLAG: --address="0.0.0.0" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464833 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464838 2579 flags.go:64] FLAG: --anonymous-auth="true" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464842 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464846 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464849 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464853 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464857 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464860 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464863 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464867 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464870 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464873 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464877 2579 flags.go:64] FLAG: --cgroup-root="" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464880 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464882 2579 flags.go:64] FLAG: --client-ca-file="" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464887 2579 flags.go:64] FLAG: --cloud-provider="external" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464890 2579 flags.go:64] FLAG: --cluster-dns="[]" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464895 2579 flags.go:64] FLAG: --cluster-domain="" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464897 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464900 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464903 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 07 12:40:43.468831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464906 2579 flags.go:64] FLAG: --container-log-max-files="5" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464914 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464917 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464920 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464923 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464925 2579 flags.go:64] FLAG: --contention-profiling="false" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464928 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464931 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464934 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464937 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464940 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464943 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464946 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464949 2579 flags.go:64] FLAG: --enable-load-reader="false" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464952 2579 flags.go:64] FLAG: --enable-server="true" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464954 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464958 2579 flags.go:64] FLAG: --event-burst="100" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464961 2579 flags.go:64] FLAG: --event-qps="50" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464963 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464967 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464969 2579 flags.go:64] FLAG: --eviction-hard="" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464972 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464975 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464978 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464980 2579 flags.go:64] FLAG: --eviction-soft="" Sep 07 12:40:43.469447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464983 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464987 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464991 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464994 2579 flags.go:64] FLAG: --experimental-mounter-path="" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464996 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.464999 2579 flags.go:64] FLAG: --fail-swap-on="true" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465001 2579 flags.go:64] FLAG: --feature-gates="" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465005 2579 flags.go:64] FLAG: --file-check-frequency="20s" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465007 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465010 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465013 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465016 2579 flags.go:64] FLAG: --healthz-port="10248" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465019 2579 flags.go:64] FLAG: --help="false" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465021 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-139-78.ec2.internal" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465024 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465026 2579 flags.go:64] FLAG: --http-check-frequency="20s" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465029 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465032 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465035 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465038 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465040 2579 flags.go:64] FLAG: --image-service-endpoint="" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465043 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465045 2579 flags.go:64] FLAG: --kube-api-burst="100" Sep 07 12:40:43.470027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465048 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465051 2579 flags.go:64] FLAG: --kube-api-qps="50" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465053 2579 flags.go:64] FLAG: --kube-reserved="" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465056 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465059 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465061 2579 flags.go:64] FLAG: --kubelet-cgroups="" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465064 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465066 2579 flags.go:64] FLAG: --lock-file="" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465069 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465072 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465076 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465081 2579 flags.go:64] FLAG: --log-json-split-stream="false" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465084 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465086 2579 flags.go:64] FLAG: --log-text-split-stream="false" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465089 2579 flags.go:64] FLAG: --logging-format="text" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465092 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465095 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465098 2579 flags.go:64] FLAG: --manifest-url="" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465100 2579 flags.go:64] FLAG: --manifest-url-header="" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465105 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465107 2579 flags.go:64] FLAG: --max-open-files="1000000" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465111 2579 flags.go:64] FLAG: --max-pods="110" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465114 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465116 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465119 2579 flags.go:64] FLAG: --memory-manager-policy="None" Sep 07 12:40:43.470613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465122 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465124 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465128 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465131 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465137 2579 flags.go:64] FLAG: --node-status-max-images="50" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465140 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465143 2579 flags.go:64] FLAG: --oom-score-adj="-999" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465146 2579 flags.go:64] FLAG: --pod-cidr="" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465148 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465153 2579 flags.go:64] FLAG: --pod-manifest-path="" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465156 2579 flags.go:64] FLAG: --pod-max-pids="-1" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465159 2579 flags.go:64] FLAG: --pods-per-core="0" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465161 2579 flags.go:64] FLAG: --port="10250" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465165 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465167 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-067994e3461a1cf22" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465170 2579 flags.go:64] FLAG: --qos-reserved="" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465173 2579 flags.go:64] FLAG: --read-only-port="10255" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465177 2579 flags.go:64] FLAG: --register-node="true" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465180 2579 flags.go:64] FLAG: --register-with-taints="" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465183 2579 flags.go:64] FLAG: --registry-burst="10" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465187 2579 flags.go:64] FLAG: --registry-qps="5" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465189 2579 flags.go:64] FLAG: --reserved-cpus="" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465192 2579 flags.go:64] FLAG: --reserved-memory="" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465195 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465198 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 07 12:40:43.471206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465201 2579 flags.go:64] FLAG: --rotate-certificates="false" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465204 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465206 2579 flags.go:64] FLAG: --runonce="false" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465209 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465212 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465215 2579 flags.go:64] FLAG: --seccomp-default="false" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465217 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465220 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465223 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465225 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465231 2579 flags.go:64] FLAG: --storage-driver-password="root" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465233 2579 flags.go:64] FLAG: --storage-driver-secure="false" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465236 2579 flags.go:64] FLAG: --storage-driver-table="stats" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465239 2579 flags.go:64] FLAG: --storage-driver-user="root" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465242 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465245 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465247 2579 flags.go:64] FLAG: --system-cgroups="" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465250 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465255 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465258 2579 flags.go:64] FLAG: --tls-cert-file="" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465260 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465264 2579 flags.go:64] FLAG: --tls-min-version="" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465267 2579 flags.go:64] FLAG: --tls-private-key-file="" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465270 2579 flags.go:64] FLAG: --topology-manager-policy="none" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465274 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 07 12:40:43.471805 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465276 2579 flags.go:64] FLAG: --topology-manager-scope="container" Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465279 2579 flags.go:64] FLAG: --v="2" Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465283 2579 flags.go:64] FLAG: --version="false" Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465287 2579 flags.go:64] FLAG: --vmodule="" Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465290 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465293 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465400 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465404 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465407 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465410 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465412 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465415 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465418 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465421 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465425 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465428 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465430 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465434 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465437 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465439 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:40:43.472896 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465443 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465446 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465450 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465453 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465456 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465459 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465461 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465464 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465466 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465469 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465472 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465476 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465478 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465481 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465484 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465486 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465489 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465503 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465506 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465508 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:40:43.473807 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465510 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465513 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465515 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465517 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465520 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465522 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465525 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465527 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465529 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465533 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465535 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465538 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465540 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465544 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465547 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465550 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465552 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465555 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465558 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:40:43.474675 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465560 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465563 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465566 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465568 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465585 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465587 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465590 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465592 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465595 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465597 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465600 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465602 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465605 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465607 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465610 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465612 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465615 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465617 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465619 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465622 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:40:43.475485 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465624 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465626 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465630 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465633 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465635 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465637 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465640 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465642 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465644 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465647 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465649 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465652 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465655 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465657 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465660 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465662 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465666 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465668 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465671 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465673 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:40:43.476196 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465675 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:40:43.476815 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465678 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:40:43.476815 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465680 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:40:43.476815 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465683 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:40:43.476815 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465685 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:40:43.476815 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.465687 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:40:43.476815 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.465692 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 12:40:43.476815 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.474543 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 07 12:40:43.476815 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.474561 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 07 12:40:43.476815 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.474595 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 07 12:40:43.476815 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.474605 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 07 12:40:43.476815 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474691 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:40:43.476815 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474699 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:40:43.476815 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474703 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:40:43.476815 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474709 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474713 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474718 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474722 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474726 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474730 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474734 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474738 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474742 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474745 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474749 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474753 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474757 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474761 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474765 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474769 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474773 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474777 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474781 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474785 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:40:43.477367 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474788 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474793 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474797 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474801 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474805 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474809 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474814 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474818 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474824 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474830 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474834 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474838 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474842 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474847 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474853 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474859 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474863 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474868 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474874 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:40:43.477904 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474878 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474883 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474887 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474892 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474896 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474900 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474904 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474908 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474912 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474916 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474920 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474923 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474928 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474931 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474935 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474941 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474945 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474949 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474953 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474958 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:40:43.478656 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474962 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474965 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474970 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474973 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474977 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474981 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474985 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474989 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474993 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.474997 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475001 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475005 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475009 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475013 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475017 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475021 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475026 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475030 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475034 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475037 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:40:43.479303 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475041 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:40:43.479883 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475045 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:40:43.479883 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475049 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:40:43.479883 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475053 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:40:43.479883 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475057 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:40:43.479883 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475061 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:40:43.479883 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475065 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:40:43.479883 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475069 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:40:43.479883 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475073 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:40:43.479883 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475077 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:40:43.479883 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475081 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:40:43.479883 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475086 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:40:43.479883 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475089 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:40:43.479883 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475093 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:40:43.479883 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475097 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:40:43.479883 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475101 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:40:43.479883 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475105 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:40:43.480301 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.475112 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 12:40:43.480301 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475280 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:40:43.480301 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475287 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:40:43.480301 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475292 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:40:43.480301 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475296 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:40:43.480301 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475300 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:40:43.480301 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475305 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:40:43.480301 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475309 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:40:43.480301 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475313 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:40:43.480301 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475317 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:40:43.480301 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475321 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:40:43.480301 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475325 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:40:43.480301 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475329 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:40:43.480301 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475333 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:40:43.480301 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475337 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475341 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475344 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475348 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475352 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475356 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475362 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475367 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475373 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475377 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475382 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475388 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475392 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475396 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475400 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475404 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475407 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475411 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475415 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:40:43.480733 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475419 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475424 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475428 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475432 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475436 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475439 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475443 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475447 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475451 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475454 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475459 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475462 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475466 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475470 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475474 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475478 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475482 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475487 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475490 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475494 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:40:43.481239 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475497 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475501 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475505 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475508 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475513 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475518 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475522 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475526 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475530 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475533 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475537 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475541 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475545 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475549 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475553 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475557 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475560 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475565 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475586 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475590 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:40:43.481797 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475594 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475598 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475601 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475605 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475609 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475613 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475617 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475623 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475628 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475633 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475637 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475641 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475645 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475649 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475653 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475658 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475662 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475668 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475672 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:40:43.482291 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475676 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:40:43.482808 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475679 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:40:43.482808 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475683 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:40:43.482808 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475687 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:40:43.482808 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475691 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:40:43.482808 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475695 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:40:43.482808 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475699 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:40:43.482808 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:43.475703 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:40:43.482808 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.475711 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 12:40:43.482808 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.475850 2579 server.go:962] "Client rotation is on, will bootstrap in background" Sep 07 12:40:43.482808 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.479748 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 07 12:40:43.482808 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.480851 2579 server.go:1019] "Starting client certificate rotation" Sep 07 12:40:43.482808 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.480953 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 12:40:43.482808 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.480991 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 12:40:43.483888 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.483872 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 12:40:43.485349 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.485329 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 12:40:43.496216 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.496201 2579 log.go:25] "Validated CRI v1 runtime API" Sep 07 12:40:43.499482 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.499468 2579 log.go:25] "Validated CRI v1 image API" Sep 07 12:40:43.500254 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.500241 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 07 12:40:43.505355 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.505338 2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 97ff7c57-2c78-40fb-80db-20fe69d45fd7:/dev/nvme0n1p4 aa19f222-9be2-436c-917c-37e7f56be958:/dev/nvme0n1p3] Sep 07 12:40:43.505421 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.505354 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 07 12:40:43.509881 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.509859 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 12:40:43.510545 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.510447 2579 manager.go:216] Machine: {Timestamp:2026-09-07 12:40:43.509952696 +0000 UTC m=+0.379696077 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3176118 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e676c405b932ee6d955eb50d4bc7a SystemUUID:ec2e676c-405b-932e-e6d9-55eb50d4bc7a BootID:e2186cd2-4f57-4dd9-b790-503d9837e1a1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:15:9c:9e:a4:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:15:9c:9e:a4:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:40:d0:dd:45:f5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 07 12:40:43.510545 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.510540 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 07 12:40:43.510655 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.510621 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 07 12:40:43.514077 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.514048 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 07 12:40:43.514203 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.514080 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-78.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 07 12:40:43.514973 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.514964 2579 topology_manager.go:138] "Creating topology manager with none policy" Sep 07 12:40:43.515008 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.514976 2579 container_manager_linux.go:309] "Creating device plugin manager" Sep 07 12:40:43.515008 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.514983 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 12:40:43.515970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.515959 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 12:40:43.517807 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.517797 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 07 12:40:43.523838 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.523827 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 07 12:40:43.523951 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.523942 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 07 12:40:43.523989 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.523971 2579 kubelet.go:486] "Attempting to sync node with API server" Sep 07 12:40:43.523989 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.523981 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 07 12:40:43.524052 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.523998 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 07 12:40:43.524052 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.524007 2579 kubelet.go:398] "Adding apiserver pod source" Sep 07 12:40:43.524052 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.524015 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 07 12:40:43.524371 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.524359 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 12:40:43.524426 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.524382 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 12:40:43.527954 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.527931 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 07 12:40:43.531248 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.531234 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 07 12:40:43.531311 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.531266 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 07 12:40:43.532146 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.532132 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 07 12:40:43.532233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.532151 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 07 12:40:43.532233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.532157 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 07 12:40:43.532233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.532162 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 07 12:40:43.532233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.532170 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 07 12:40:43.532233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.532176 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 07 12:40:43.532233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.532188 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 07 12:40:43.532233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.532193 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 07 12:40:43.532233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.532200 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 07 12:40:43.532233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.532205 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 07 12:40:43.532233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.532213 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 07 12:40:43.532233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.532218 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 07 12:40:43.532924 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.532904 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 07 12:40:43.533027 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.533009 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 07 12:40:43.533132 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.533122 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 07 12:40:43.533167 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.533133 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 07 12:40:43.535091 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.535074 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-78.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 07 12:40:43.536670 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.536658 2579 server.go:1268] "Started kubelet" Sep 07 12:40:43.536753 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.536728 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 07 12:40:43.536800 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.536735 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 07 12:40:43.536800 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.536793 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 07 12:40:43.537435 ip-10-0-139-78 systemd[1]: Started Kubernetes Kubelet. Sep 07 12:40:43.539315 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.539172 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 07 12:40:43.541328 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.541312 2579 server.go:310] "Adding debug handlers to kubelet server" Sep 07 12:40:43.545145 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.545124 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 07 12:40:43.547556 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.547537 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 07 12:40:43.547657 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.547559 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 07 12:40:43.547721 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.547657 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-78.ec2.internal\" not found" Sep 07 12:40:43.548393 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.548299 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 07 12:40:43.548393 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.548341 2579 factory.go:55] Registering systemd factory Sep 07 12:40:43.548393 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.548363 2579 factory.go:223] Registration of the systemd container factory successfully Sep 07 12:40:43.548589 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.548391 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 07 12:40:43.548589 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.548500 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 07 12:40:43.548679 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.548615 2579 factory.go:153] Registering CRI-O factory Sep 07 12:40:43.548679 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.548631 2579 factory.go:223] Registration of the crio container factory successfully Sep 07 12:40:43.548679 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.548632 2579 reconstruct.go:97] "Volume reconstruction finished" Sep 07 12:40:43.548679 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.548643 2579 reconciler.go:29] "Reconciler: start to sync state" Sep 07 12:40:43.548679 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.548678 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 07 12:40:43.548899 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.548697 2579 factory.go:103] Registering Raw factory Sep 07 12:40:43.548899 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.548711 2579 manager.go:1196] Started watching for new ooms in manager Sep 07 12:40:43.549109 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.549095 2579 manager.go:349] Starting recovery of all containers Sep 07 12:40:43.553403 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.553375 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 07 12:40:43.553497 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.553445 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 07 12:40:43.553950 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.553925 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qkhpg" Sep 07 12:40:43.554740 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.553542 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-78.ec2.internal.18d30a567a9a908c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-78.ec2.internal,UID:ip-10-0-139-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-78.ec2.internal,},FirstTimestamp:2026-09-07 12:40:43.536633996 +0000 UTC m=+0.406377375,LastTimestamp:2026-09-07 12:40:43.536633996 +0000 UTC m=+0.406377375,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-78.ec2.internal,}" Sep 07 12:40:43.559514 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.559499 2579 manager.go:354] Recovery completed Sep 07 12:40:43.561442 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.561421 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qkhpg" Sep 07 12:40:43.564063 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.564052 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:40:43.565555 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.565543 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:40:43.565639 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.565567 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:40:43.565639 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.565598 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:40:43.566117 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.566104 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 07 12:40:43.566117 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.566115 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 07 12:40:43.566232 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.566125 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:40:43.566232 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.566132 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 07 12:40:43.566884 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.566861 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:40:43.566884 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.566885 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:40:43.566981 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.566899 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:40:43.567364 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.567242 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-78.ec2.internal.18d30a567c53dd36 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-78.ec2.internal,UID:ip-10-0-139-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-78.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-78.ec2.internal,},FirstTimestamp:2026-09-07 12:40:43.565554998 +0000 UTC m=+0.435298375,LastTimestamp:2026-09-07 12:40:43.565554998 +0000 UTC m=+0.435298375,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-78.ec2.internal,}" Sep 07 12:40:43.568183 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.568170 2579 policy_none.go:49] "None policy: Start" Sep 07 12:40:43.568318 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.568308 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 07 12:40:43.568422 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.568411 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 07 12:40:43.570717 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.570703 2579 policy_none.go:47] "Start" Sep 07 12:40:43.608135 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.608121 2579 manager.go:337] "Starting Device Plugin manager" Sep 07 12:40:43.632309 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.608155 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 07 12:40:43.632309 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.608165 2579 server.go:87] "Starting device plugin registration server" Sep 07 12:40:43.632309 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.608476 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 07 12:40:43.632309 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.608488 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 07 12:40:43.632309 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.608566 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 07 12:40:43.632309 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.608672 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 07 12:40:43.632309 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.608682 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 07 12:40:43.632309 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.609195 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 07 12:40:43.632309 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.609249 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-78.ec2.internal\" not found" Sep 07 12:40:43.652272 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.652252 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 07 12:40:43.653500 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.653484 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 07 12:40:43.653567 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.653533 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 07 12:40:43.653567 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.653557 2579 kubelet.go:2448] "Starting kubelet main sync loop" Sep 07 12:40:43.653657 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.653619 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 07 12:40:43.655689 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.655666 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:40:43.709496 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.709449 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:40:43.710501 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.710487 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:40:43.710559 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.710515 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:40:43.710559 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.710525 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:40:43.710559 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.710546 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-78.ec2.internal" Sep 07 12:40:43.720290 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.720274 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-78.ec2.internal" Sep 07 12:40:43.720344 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.720294 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-78.ec2.internal\": node \"ip-10-0-139-78.ec2.internal\" not found" Sep 07 12:40:43.748292 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.748273 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-78.ec2.internal\" not found" Sep 07 12:40:43.754484 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.754466 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-78.ec2.internal"] Sep 07 12:40:43.754545 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.754534 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:40:43.755830 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.755814 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:40:43.755882 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.755843 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:40:43.755882 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.755855 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:40:43.758131 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.758120 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:40:43.758233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.758218 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal" Sep 07 12:40:43.758277 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.758249 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:40:43.758791 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.758764 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:40:43.758791 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.758790 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:40:43.758936 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.758804 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:40:43.758936 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.758825 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:40:43.758936 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.758848 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:40:43.758936 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.758861 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:40:43.761108 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.761085 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-78.ec2.internal" Sep 07 12:40:43.761192 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.761114 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:40:43.762134 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.762095 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:40:43.762134 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.762119 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:40:43.762134 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.762134 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:40:43.785104 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.785081 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-78.ec2.internal\" not found" node="ip-10-0-139-78.ec2.internal" Sep 07 12:40:43.789483 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.789470 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-78.ec2.internal\" not found" node="ip-10-0-139-78.ec2.internal" Sep 07 12:40:43.848493 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.848472 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-78.ec2.internal\" not found" Sep 07 12:40:43.850671 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.850658 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ea6adedb9dcd115be4eba74ebae07fc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal\" (UID: \"3ea6adedb9dcd115be4eba74ebae07fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal" Sep 07 12:40:43.850727 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.850679 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ea6adedb9dcd115be4eba74ebae07fc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal\" (UID: \"3ea6adedb9dcd115be4eba74ebae07fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal" Sep 07 12:40:43.850727 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.850694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/354628df5e5c0356cd158ffc3ea8a19c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-78.ec2.internal\" (UID: \"354628df5e5c0356cd158ffc3ea8a19c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-78.ec2.internal" Sep 07 12:40:43.948892 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:43.948865 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-78.ec2.internal\" not found" Sep 07 12:40:43.951025 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.951009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ea6adedb9dcd115be4eba74ebae07fc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal\" (UID: \"3ea6adedb9dcd115be4eba74ebae07fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal" Sep 07 12:40:43.951066 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.951033 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ea6adedb9dcd115be4eba74ebae07fc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal\" (UID: \"3ea6adedb9dcd115be4eba74ebae07fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal" Sep 07 12:40:43.951066 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.951050 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/354628df5e5c0356cd158ffc3ea8a19c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-78.ec2.internal\" (UID: \"354628df5e5c0356cd158ffc3ea8a19c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-78.ec2.internal" Sep 07 12:40:43.951136 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.951098 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/354628df5e5c0356cd158ffc3ea8a19c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-78.ec2.internal\" (UID: \"354628df5e5c0356cd158ffc3ea8a19c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-78.ec2.internal" Sep 07 12:40:43.951136 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.951106 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ea6adedb9dcd115be4eba74ebae07fc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal\" (UID: \"3ea6adedb9dcd115be4eba74ebae07fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal" Sep 07 12:40:43.951136 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:43.951115 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ea6adedb9dcd115be4eba74ebae07fc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal\" (UID: \"3ea6adedb9dcd115be4eba74ebae07fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal" Sep 07 12:40:44.049632 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.049556 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-78.ec2.internal\" not found" Sep 07 12:40:44.087872 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.087850 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal" Sep 07 12:40:44.091603 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.091565 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-78.ec2.internal" Sep 07 12:40:44.150201 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.150173 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-78.ec2.internal\" not found" Sep 07 12:40:44.250692 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.250669 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-78.ec2.internal\" not found" Sep 07 12:40:44.351300 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.351230 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-78.ec2.internal\" not found" Sep 07 12:40:44.362360 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.362344 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:40:44.451533 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.451506 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-78.ec2.internal\" not found" Sep 07 12:40:44.475450 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.475435 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:40:44.480453 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.480440 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 07 12:40:44.480543 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.480528 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 12:40:44.480623 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.480550 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 12:40:44.480672 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.480616 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 12:40:44.524720 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.524699 2579 apiserver.go:52] "Watching apiserver" Sep 07 12:40:44.540786 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.540767 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 07 12:40:44.542211 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.541738 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-9mbh5","openshift-network-operator/iptables-alerter-nwvg8","kube-system/konnectivity-agent-8lhcw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f","openshift-dns/node-resolver-mjfzt","openshift-image-registry/node-ca-vppzn","openshift-multus/multus-cq2dj","openshift-network-diagnostics/network-check-target-tsptp","openshift-ovn-kubernetes/ovnkube-node-bjzqr","kube-system/global-pull-secret-syncer-pfgjt","openshift-cluster-node-tuning-operator/tuned-hc2g2","openshift-multus/multus-additional-cni-plugins-grn48"] Sep 07 12:40:44.544374 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.544357 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:44.544471 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.544449 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:40:44.546417 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.546401 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nwvg8" Sep 07 12:40:44.548418 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.548401 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 07 12:40:44.548538 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.548404 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal" Sep 07 12:40:44.548662 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.548643 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:40:44.548731 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.548687 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 07 12:40:44.548824 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.548783 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8lhcw" Sep 07 12:40:44.549066 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.549052 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8wjwg\"" Sep 07 12:40:44.549141 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.549074 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 07 12:40:44.550656 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.550641 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 07 12:40:44.550906 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.550884 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.551003 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.550957 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 07 12:40:44.551089 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.551072 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r7tcd\"" Sep 07 12:40:44.552853 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.552822 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 07 12:40:44.552853 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.552838 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 07 12:40:44.552989 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.552861 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jl8tj\"" Sep 07 12:40:44.553082 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.553069 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mjfzt" Sep 07 12:40:44.553326 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.553312 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 07 12:40:44.554395 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.554380 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/382b48ad-9f65-46b3-9403-fd3fae4b7325-host-slash\") pod \"iptables-alerter-nwvg8\" (UID: \"382b48ad-9f65-46b3-9403-fd3fae4b7325\") " pod="openshift-network-operator/iptables-alerter-nwvg8" Sep 07 12:40:44.554454 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.554403 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt4s4\" (UniqueName: \"kubernetes.io/projected/382b48ad-9f65-46b3-9403-fd3fae4b7325-kube-api-access-lt4s4\") pod \"iptables-alerter-nwvg8\" (UID: \"382b48ad-9f65-46b3-9403-fd3fae4b7325\") " pod="openshift-network-operator/iptables-alerter-nwvg8" Sep 07 12:40:44.554454 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.554421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c7c1678-7feb-48ce-8e2b-cf787e607364-konnectivity-ca\") pod \"konnectivity-agent-8lhcw\" (UID: \"8c7c1678-7feb-48ce-8e2b-cf787e607364\") " pod="kube-system/konnectivity-agent-8lhcw" Sep 07 12:40:44.554454 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.554437 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c7c1678-7feb-48ce-8e2b-cf787e607364-agent-certs\") pod \"konnectivity-agent-8lhcw\" (UID: \"8c7c1678-7feb-48ce-8e2b-cf787e607364\") " pod="kube-system/konnectivity-agent-8lhcw" Sep 07 12:40:44.554542 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.554484 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs\") pod \"network-metrics-daemon-9mbh5\" (UID: \"bce0dedd-2b68-4c5d-8504-150a18723edd\") " pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:44.554542 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.554505 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-php4m\" (UniqueName: \"kubernetes.io/projected/bce0dedd-2b68-4c5d-8504-150a18723edd-kube-api-access-php4m\") pod \"network-metrics-daemon-9mbh5\" (UID: \"bce0dedd-2b68-4c5d-8504-150a18723edd\") " pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:44.554542 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.554527 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/382b48ad-9f65-46b3-9403-fd3fae4b7325-iptables-alerter-script\") pod \"iptables-alerter-nwvg8\" (UID: \"382b48ad-9f65-46b3-9403-fd3fae4b7325\") " pod="openshift-network-operator/iptables-alerter-nwvg8" Sep 07 12:40:44.555154 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.555143 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vppzn" Sep 07 12:40:44.557025 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.557010 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 07 12:40:44.557160 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.557141 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 07 12:40:44.557267 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.557239 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 07 12:40:44.557378 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.557352 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.557444 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.557393 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qpbr7\"" Sep 07 12:40:44.557444 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.557401 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 07 12:40:44.557444 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.557424 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2gjrq\"" Sep 07 12:40:44.557621 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.557479 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 07 12:40:44.559546 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.559529 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:40:44.559653 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.559605 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:40:44.559820 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.559803 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 07 12:40:44.559905 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.559863 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 07 12:40:44.559905 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.559890 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 07 12:40:44.560159 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.560123 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9j8qp\"" Sep 07 12:40:44.560220 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.560200 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 07 12:40:44.560272 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.560231 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 12:40:44.562241 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.561923 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.564128 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.564095 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 12:35:43 +0000 UTC" deadline="2028-04-20 23:57:00.349513666 +0000 UTC" Sep 07 12:40:44.564128 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.564127 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14195h16m15.785388994s" Sep 07 12:40:44.564378 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.564365 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.564707 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.564692 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 07 12:40:44.564785 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.564710 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 07 12:40:44.564785 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.564709 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lvvkr\"" Sep 07 12:40:44.564785 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.564752 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 07 12:40:44.564785 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.564776 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 07 12:40:44.564785 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.564746 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 07 12:40:44.564976 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.564714 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 07 12:40:44.565047 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.565034 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 12:40:44.565121 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.565109 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-78.ec2.internal" Sep 07 12:40:44.566328 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.566315 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bghwx\"" Sep 07 12:40:44.566651 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.566639 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.566979 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.566965 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:40:44.567233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.567220 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 07 12:40:44.568873 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.568840 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal"] Sep 07 12:40:44.568967 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.568878 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 07 12:40:44.569022 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.568970 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 07 12:40:44.569179 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.569162 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:44.569262 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.569241 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:40:44.569389 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.569372 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cfsbg\"" Sep 07 12:40:44.573185 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.573162 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-78.ec2.internal"] Sep 07 12:40:44.573447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.573431 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 12:40:44.617636 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.617615 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ptzkq" Sep 07 12:40:44.624675 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.624658 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ptzkq" Sep 07 12:40:44.649777 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.649763 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 07 12:40:44.654664 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.654646 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3fefce99-6821-40e4-97e3-8348becf8079-ovnkube-config\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.654806 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.654675 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3fefce99-6821-40e4-97e3-8348becf8079-ovnkube-script-lib\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.654806 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.654732 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-kubernetes\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.654806 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.654769 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-hostroot\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.654963 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.654814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-registration-dir\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.654963 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.654860 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-var-lib-kubelet\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.654963 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.654886 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6vnr\" (UniqueName: \"kubernetes.io/projected/88c58f57-e0c6-4de1-bcc9-9a95451cc520-kube-api-access-s6vnr\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.654963 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.654910 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-node-log\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.654963 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.654935 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-run-ovn-kubernetes\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.654963 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.654959 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret\") pod \"global-pull-secret-syncer-pfgjt\" (UID: \"3fce5c0f-7c8a-4f83-be38-940c689527e8\") " pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:44.655240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.654981 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-sysctl-conf\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.655240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-var-lib-cni-multus\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.655240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72xds\" (UniqueName: \"kubernetes.io/projected/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-kube-api-access-72xds\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.655240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655049 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-sysconfig\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.655240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655071 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-cnibin\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.655240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-etc-kubernetes\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.655240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655139 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fce5c0f-7c8a-4f83-be38-940c689527e8-kubelet-config\") pod \"global-pull-secret-syncer-pfgjt\" (UID: \"3fce5c0f-7c8a-4f83-be38-940c689527e8\") " pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:44.655240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655162 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w5s9\" (UniqueName: \"kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9\") pod \"network-check-target-tsptp\" (UID: \"7365e1ad-5b47-499b-ad6e-3748efd38d65\") " pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:40:44.655240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655185 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-systemd-units\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.655240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655208 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.655674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655244 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-device-dir\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.655674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655284 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs\") pod \"network-metrics-daemon-9mbh5\" (UID: \"bce0dedd-2b68-4c5d-8504-150a18723edd\") " pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:44.655674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-lib-modules\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.655674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655381 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dedaea8c-e647-441e-a4ae-2e728bf38f3b-host\") pod \"node-ca-vppzn\" (UID: \"dedaea8c-e647-441e-a4ae-2e728bf38f3b\") " pod="openshift-image-registry/node-ca-vppzn" Sep 07 12:40:44.655674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655402 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-system-cni-dir\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.655674 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.655402 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:40:44.655674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655417 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-run-multus-certs\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.655674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655433 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-slash\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.655674 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.655466 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs podName:bce0dedd-2b68-4c5d-8504-150a18723edd nodeName:}" failed. No retries permitted until 2026-09-07 12:40:45.155446878 +0000 UTC m=+2.025190243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs") pod "network-metrics-daemon-9mbh5" (UID: "bce0dedd-2b68-4c5d-8504-150a18723edd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:40:44.655674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655452 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-log-socket\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.655674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-socket-dir\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.655674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c7c1678-7feb-48ce-8e2b-cf787e607364-agent-certs\") pod \"konnectivity-agent-8lhcw\" (UID: \"8c7c1678-7feb-48ce-8e2b-cf787e607364\") " pod="kube-system/konnectivity-agent-8lhcw" Sep 07 12:40:44.655674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d641371d-23bb-4111-b530-8fd27ccff558-system-cni-dir\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.655674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655543 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d641371d-23bb-4111-b530-8fd27ccff558-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.655674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655555 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-run-netns\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.655674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655606 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-run-openvswitch\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655738 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3fefce99-6821-40e4-97e3-8348becf8079-env-overrides\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655761 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-sys-fs\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655789 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-php4m\" (UniqueName: \"kubernetes.io/projected/bce0dedd-2b68-4c5d-8504-150a18723edd-kube-api-access-php4m\") pod \"network-metrics-daemon-9mbh5\" (UID: \"bce0dedd-2b68-4c5d-8504-150a18723edd\") " pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655812 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-host\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655831 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-run-systemd\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-run-ovn\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655874 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-systemd\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655924 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dedaea8c-e647-441e-a4ae-2e728bf38f3b-serviceca\") pod \"node-ca-vppzn\" (UID: \"dedaea8c-e647-441e-a4ae-2e728bf38f3b\") " pod="openshift-image-registry/node-ca-vppzn" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655923 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-multus-cni-dir\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655971 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-var-lib-openvswitch\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.655994 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-cni-bin\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4vzz\" (UniqueName: \"kubernetes.io/projected/3fefce99-6821-40e4-97e3-8348becf8079-kube-api-access-q4vzz\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656056 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fce5c0f-7c8a-4f83-be38-940c689527e8-dbus\") pod \"global-pull-secret-syncer-pfgjt\" (UID: \"3fce5c0f-7c8a-4f83-be38-940c689527e8\") " pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/382b48ad-9f65-46b3-9403-fd3fae4b7325-iptables-alerter-script\") pod \"iptables-alerter-nwvg8\" (UID: \"382b48ad-9f65-46b3-9403-fd3fae4b7325\") " pod="openshift-network-operator/iptables-alerter-nwvg8" Sep 07 12:40:44.656335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656108 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-run\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.657172 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656144 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88c58f57-e0c6-4de1-bcc9-9a95451cc520-cni-binary-copy\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.657172 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656162 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-multus-socket-dir-parent\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.657172 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656177 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-var-lib-cni-bin\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.657172 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656192 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-etc-selinux\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.657172 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656216 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkw7s\" (UniqueName: \"kubernetes.io/projected/8ca94cce-1b24-4320-8849-8472c850f841-kube-api-access-wkw7s\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.657172 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c201161-d05a-452a-806a-be74c902a26a-hosts-file\") pod \"node-resolver-mjfzt\" (UID: \"0c201161-d05a-452a-806a-be74c902a26a\") " pod="openshift-dns/node-resolver-mjfzt" Sep 07 12:40:44.657172 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656254 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c201161-d05a-452a-806a-be74c902a26a-tmp-dir\") pod \"node-resolver-mjfzt\" (UID: \"0c201161-d05a-452a-806a-be74c902a26a\") " pod="openshift-dns/node-resolver-mjfzt" Sep 07 12:40:44.657172 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656280 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfznz\" (UniqueName: \"kubernetes.io/projected/0c201161-d05a-452a-806a-be74c902a26a-kube-api-access-xfznz\") pod \"node-resolver-mjfzt\" (UID: \"0c201161-d05a-452a-806a-be74c902a26a\") " pod="openshift-dns/node-resolver-mjfzt" Sep 07 12:40:44.657172 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-modprobe-d\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.657172 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656327 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp8h4\" (UniqueName: \"kubernetes.io/projected/d641371d-23bb-4111-b530-8fd27ccff558-kube-api-access-cp8h4\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.657172 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-kubelet\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.657172 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656367 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-run-netns\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.657172 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656407 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/382b48ad-9f65-46b3-9403-fd3fae4b7325-host-slash\") pod \"iptables-alerter-nwvg8\" (UID: \"382b48ad-9f65-46b3-9403-fd3fae4b7325\") " pod="openshift-network-operator/iptables-alerter-nwvg8" Sep 07 12:40:44.657172 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c7c1678-7feb-48ce-8e2b-cf787e607364-konnectivity-ca\") pod \"konnectivity-agent-8lhcw\" (UID: \"8c7c1678-7feb-48ce-8e2b-cf787e607364\") " pod="kube-system/konnectivity-agent-8lhcw" Sep 07 12:40:44.657172 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d641371d-23bb-4111-b530-8fd27ccff558-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.657172 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656463 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3fefce99-6821-40e4-97e3-8348becf8079-ovn-node-metrics-cert\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.657827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvqtd\" (UniqueName: \"kubernetes.io/projected/dedaea8c-e647-441e-a4ae-2e728bf38f3b-kube-api-access-nvqtd\") pod \"node-ca-vppzn\" (UID: \"dedaea8c-e647-441e-a4ae-2e728bf38f3b\") " pod="openshift-image-registry/node-ca-vppzn" Sep 07 12:40:44.657827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656494 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d641371d-23bb-4111-b530-8fd27ccff558-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.657827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656513 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/88c58f57-e0c6-4de1-bcc9-9a95451cc520-multus-daemon-config\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.657827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656534 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ca94cce-1b24-4320-8849-8472c850f841-etc-tuned\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.657827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656537 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/382b48ad-9f65-46b3-9403-fd3fae4b7325-iptables-alerter-script\") pod \"iptables-alerter-nwvg8\" (UID: \"382b48ad-9f65-46b3-9403-fd3fae4b7325\") " pod="openshift-network-operator/iptables-alerter-nwvg8" Sep 07 12:40:44.657827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656555 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/382b48ad-9f65-46b3-9403-fd3fae4b7325-host-slash\") pod \"iptables-alerter-nwvg8\" (UID: \"382b48ad-9f65-46b3-9403-fd3fae4b7325\") " pod="openshift-network-operator/iptables-alerter-nwvg8" Sep 07 12:40:44.657827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ca94cce-1b24-4320-8849-8472c850f841-tmp\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.657827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656619 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-sysctl-d\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.657827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656655 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-sys\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.657827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-var-lib-kubelet\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.657827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656723 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-run-k8s-cni-cncf-io\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.657827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-multus-conf-dir\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.657827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt4s4\" (UniqueName: \"kubernetes.io/projected/382b48ad-9f65-46b3-9403-fd3fae4b7325-kube-api-access-lt4s4\") pod \"iptables-alerter-nwvg8\" (UID: \"382b48ad-9f65-46b3-9403-fd3fae4b7325\") " pod="openshift-network-operator/iptables-alerter-nwvg8" Sep 07 12:40:44.657827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656788 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d641371d-23bb-4111-b530-8fd27ccff558-cnibin\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.657827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656806 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d641371d-23bb-4111-b530-8fd27ccff558-cni-binary-copy\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.657827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656826 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-etc-openvswitch\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.658328 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656843 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-cni-netd\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.658328 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.656889 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8c7c1678-7feb-48ce-8e2b-cf787e607364-konnectivity-ca\") pod \"konnectivity-agent-8lhcw\" (UID: \"8c7c1678-7feb-48ce-8e2b-cf787e607364\") " pod="kube-system/konnectivity-agent-8lhcw" Sep 07 12:40:44.659344 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.659330 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8c7c1678-7feb-48ce-8e2b-cf787e607364-agent-certs\") pod \"konnectivity-agent-8lhcw\" (UID: \"8c7c1678-7feb-48ce-8e2b-cf787e607364\") " pod="kube-system/konnectivity-agent-8lhcw" Sep 07 12:40:44.662873 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.662853 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-php4m\" (UniqueName: \"kubernetes.io/projected/bce0dedd-2b68-4c5d-8504-150a18723edd-kube-api-access-php4m\") pod \"network-metrics-daemon-9mbh5\" (UID: \"bce0dedd-2b68-4c5d-8504-150a18723edd\") " pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:44.663419 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.663402 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt4s4\" (UniqueName: \"kubernetes.io/projected/382b48ad-9f65-46b3-9403-fd3fae4b7325-kube-api-access-lt4s4\") pod \"iptables-alerter-nwvg8\" (UID: \"382b48ad-9f65-46b3-9403-fd3fae4b7325\") " pod="openshift-network-operator/iptables-alerter-nwvg8" Sep 07 12:40:44.757597 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757558 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-systemd\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.757597 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757599 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dedaea8c-e647-441e-a4ae-2e728bf38f3b-serviceca\") pod \"node-ca-vppzn\" (UID: \"dedaea8c-e647-441e-a4ae-2e728bf38f3b\") " pod="openshift-image-registry/node-ca-vppzn" Sep 07 12:40:44.757807 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-multus-cni-dir\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.757807 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757629 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-var-lib-openvswitch\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.757807 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-cni-bin\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.757807 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757664 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4vzz\" (UniqueName: \"kubernetes.io/projected/3fefce99-6821-40e4-97e3-8348becf8079-kube-api-access-q4vzz\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.757807 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757686 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fce5c0f-7c8a-4f83-be38-940c689527e8-dbus\") pod \"global-pull-secret-syncer-pfgjt\" (UID: \"3fce5c0f-7c8a-4f83-be38-940c689527e8\") " pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:44.757807 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757701 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-systemd\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.757807 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-run\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.757807 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757733 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-multus-cni-dir\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.757807 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757734 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-cni-bin\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.757807 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88c58f57-e0c6-4de1-bcc9-9a95451cc520-cni-binary-copy\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.757807 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757744 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-run\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.757807 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757705 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-var-lib-openvswitch\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.757807 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757772 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-multus-socket-dir-parent\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.757807 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757796 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-var-lib-cni-bin\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-etc-selinux\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757842 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-multus-socket-dir-parent\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757819 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3fce5c0f-7c8a-4f83-be38-940c689527e8-dbus\") pod \"global-pull-secret-syncer-pfgjt\" (UID: \"3fce5c0f-7c8a-4f83-be38-940c689527e8\") " pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757844 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkw7s\" (UniqueName: \"kubernetes.io/projected/8ca94cce-1b24-4320-8849-8472c850f841-kube-api-access-wkw7s\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c201161-d05a-452a-806a-be74c902a26a-hosts-file\") pod \"node-resolver-mjfzt\" (UID: \"0c201161-d05a-452a-806a-be74c902a26a\") " pod="openshift-dns/node-resolver-mjfzt" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757914 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-etc-selinux\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757902 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-var-lib-cni-bin\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757937 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c201161-d05a-452a-806a-be74c902a26a-tmp-dir\") pod \"node-resolver-mjfzt\" (UID: \"0c201161-d05a-452a-806a-be74c902a26a\") " pod="openshift-dns/node-resolver-mjfzt" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757958 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfznz\" (UniqueName: \"kubernetes.io/projected/0c201161-d05a-452a-806a-be74c902a26a-kube-api-access-xfznz\") pod \"node-resolver-mjfzt\" (UID: \"0c201161-d05a-452a-806a-be74c902a26a\") " pod="openshift-dns/node-resolver-mjfzt" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-modprobe-d\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757990 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c201161-d05a-452a-806a-be74c902a26a-hosts-file\") pod \"node-resolver-mjfzt\" (UID: \"0c201161-d05a-452a-806a-be74c902a26a\") " pod="openshift-dns/node-resolver-mjfzt" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.757996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp8h4\" (UniqueName: \"kubernetes.io/projected/d641371d-23bb-4111-b530-8fd27ccff558-kube-api-access-cp8h4\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758044 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-kubelet\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758072 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-run-netns\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758077 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-modprobe-d\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d641371d-23bb-4111-b530-8fd27ccff558-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.758460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758119 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-kubelet\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3fefce99-6821-40e4-97e3-8348becf8079-ovn-node-metrics-cert\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvqtd\" (UniqueName: \"kubernetes.io/projected/dedaea8c-e647-441e-a4ae-2e728bf38f3b-kube-api-access-nvqtd\") pod \"node-ca-vppzn\" (UID: \"dedaea8c-e647-441e-a4ae-2e728bf38f3b\") " pod="openshift-image-registry/node-ca-vppzn" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758130 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-run-netns\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d641371d-23bb-4111-b530-8fd27ccff558-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758216 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/88c58f57-e0c6-4de1-bcc9-9a95451cc520-multus-daemon-config\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758241 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ca94cce-1b24-4320-8849-8472c850f841-etc-tuned\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758257 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88c58f57-e0c6-4de1-bcc9-9a95451cc520-cni-binary-copy\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758263 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ca94cce-1b24-4320-8849-8472c850f841-tmp\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758285 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-sysctl-d\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-sys\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-var-lib-kubelet\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-run-k8s-cni-cncf-io\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-multus-conf-dir\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758401 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d641371d-23bb-4111-b530-8fd27ccff558-cnibin\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758406 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-sys\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d641371d-23bb-4111-b530-8fd27ccff558-cni-binary-copy\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.759409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758449 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-etc-openvswitch\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758473 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-cni-netd\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758492 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-sysctl-d\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758497 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3fefce99-6821-40e4-97e3-8348becf8079-ovnkube-config\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758589 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-var-lib-kubelet\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758635 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-run-k8s-cni-cncf-io\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758674 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-multus-conf-dir\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758713 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-etc-openvswitch\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758717 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d641371d-23bb-4111-b530-8fd27ccff558-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758752 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-cni-netd\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3fefce99-6821-40e4-97e3-8348becf8079-ovnkube-script-lib\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758787 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-kubernetes\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758795 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d641371d-23bb-4111-b530-8fd27ccff558-cnibin\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758807 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-hostroot\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758823 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d641371d-23bb-4111-b530-8fd27ccff558-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758893 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-registration-dir\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758900 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-kubernetes\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.760202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-registration-dir\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758936 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-hostroot\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758959 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-var-lib-kubelet\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758972 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/88c58f57-e0c6-4de1-bcc9-9a95451cc520-multus-daemon-config\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.758982 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6vnr\" (UniqueName: \"kubernetes.io/projected/88c58f57-e0c6-4de1-bcc9-9a95451cc520-kube-api-access-s6vnr\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-node-log\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-run-ovn-kubernetes\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret\") pod \"global-pull-secret-syncer-pfgjt\" (UID: \"3fce5c0f-7c8a-4f83-be38-940c689527e8\") " pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-sysctl-conf\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759095 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-var-lib-cni-multus\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72xds\" (UniqueName: \"kubernetes.io/projected/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-kube-api-access-72xds\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759137 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c201161-d05a-452a-806a-be74c902a26a-tmp-dir\") pod \"node-resolver-mjfzt\" (UID: \"0c201161-d05a-452a-806a-be74c902a26a\") " pod="openshift-dns/node-resolver-mjfzt" Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759148 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-sysconfig\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759189 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d641371d-23bb-4111-b530-8fd27ccff558-cni-binary-copy\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.759274 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-cnibin\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759342 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dedaea8c-e647-441e-a4ae-2e728bf38f3b-serviceca\") pod \"node-ca-vppzn\" (UID: \"dedaea8c-e647-441e-a4ae-2e728bf38f3b\") " pod="openshift-image-registry/node-ca-vppzn" Sep 07 12:40:44.760910 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.759354 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret podName:3fce5c0f-7c8a-4f83-be38-940c689527e8 nodeName:}" failed. No retries permitted until 2026-09-07 12:40:45.259315345 +0000 UTC m=+2.129058725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret") pod "global-pull-secret-syncer-pfgjt" (UID: "3fce5c0f-7c8a-4f83-be38-940c689527e8") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759380 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-cnibin\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759426 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-var-lib-cni-multus\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759462 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-etc-kubernetes\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-etc-kubernetes\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759503 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fce5c0f-7c8a-4f83-be38-940c689527e8-kubelet-config\") pod \"global-pull-secret-syncer-pfgjt\" (UID: \"3fce5c0f-7c8a-4f83-be38-940c689527e8\") " pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759528 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5s9\" (UniqueName: \"kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9\") pod \"network-check-target-tsptp\" (UID: \"7365e1ad-5b47-499b-ad6e-3748efd38d65\") " pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759541 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-var-lib-kubelet\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759549 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3fefce99-6821-40e4-97e3-8348becf8079-ovnkube-config\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759554 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-systemd-units\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759621 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759635 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-sysconfig\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-device-dir\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759675 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-systemd-units\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759620 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3fefce99-6821-40e4-97e3-8348becf8079-ovnkube-script-lib\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759728 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3fce5c0f-7c8a-4f83-be38-940c689527e8-kubelet-config\") pod \"global-pull-secret-syncer-pfgjt\" (UID: \"3fce5c0f-7c8a-4f83-be38-940c689527e8\") " pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759743 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-device-dir\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-lib-modules\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.761528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759774 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-lib-modules\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dedaea8c-e647-441e-a4ae-2e728bf38f3b-host\") pod \"node-ca-vppzn\" (UID: \"dedaea8c-e647-441e-a4ae-2e728bf38f3b\") " pod="openshift-image-registry/node-ca-vppzn" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759783 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759804 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-run-ovn-kubernetes\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759816 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-system-cni-dir\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759829 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dedaea8c-e647-441e-a4ae-2e728bf38f3b-host\") pod \"node-ca-vppzn\" (UID: \"dedaea8c-e647-441e-a4ae-2e728bf38f3b\") " pod="openshift-image-registry/node-ca-vppzn" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759833 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-node-log\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759568 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-etc-sysctl-conf\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-run-multus-certs\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759882 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-system-cni-dir\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-slash\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759897 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-run-multus-certs\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759920 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-log-socket\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759944 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-socket-dir\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759965 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-slash\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759968 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d641371d-23bb-4111-b530-8fd27ccff558-system-cni-dir\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.759989 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-log-socket\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760006 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d641371d-23bb-4111-b530-8fd27ccff558-system-cni-dir\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.762039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d641371d-23bb-4111-b530-8fd27ccff558-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760046 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-run-netns\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760068 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-run-openvswitch\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760093 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88c58f57-e0c6-4de1-bcc9-9a95451cc520-host-run-netns\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760126 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760135 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3fefce99-6821-40e4-97e3-8348becf8079-env-overrides\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760172 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-run-openvswitch\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760191 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d641371d-23bb-4111-b530-8fd27ccff558-tuning-conf-dir\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760196 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-sys-fs\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760224 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-socket-dir\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760227 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-host\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-run-systemd\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760236 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-sys-fs\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760287 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-run-ovn\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760304 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-run-systemd\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760265 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ca94cce-1b24-4320-8849-8472c850f841-host\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.762536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.760356 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3fefce99-6821-40e4-97e3-8348becf8079-run-ovn\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.763029 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.761206 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3fefce99-6821-40e4-97e3-8348becf8079-ovn-node-metrics-cert\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.763029 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.761211 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3fefce99-6821-40e4-97e3-8348becf8079-env-overrides\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.763029 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.761359 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ca94cce-1b24-4320-8849-8472c850f841-tmp\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.763029 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.761700 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ca94cce-1b24-4320-8849-8472c850f841-etc-tuned\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.765854 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.765837 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:40:44.765967 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.765858 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:40:44.765967 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.765870 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4w5s9 for pod openshift-network-diagnostics/network-check-target-tsptp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:40:44.765967 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.765920 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9 podName:7365e1ad-5b47-499b-ad6e-3748efd38d65 nodeName:}" failed. No retries permitted until 2026-09-07 12:40:45.265904289 +0000 UTC m=+2.135647662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4w5s9" (UniqueName: "kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9") pod "network-check-target-tsptp" (UID: "7365e1ad-5b47-499b-ad6e-3748efd38d65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:40:44.766792 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.766769 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4vzz\" (UniqueName: \"kubernetes.io/projected/3fefce99-6821-40e4-97e3-8348becf8079-kube-api-access-q4vzz\") pod \"ovnkube-node-bjzqr\" (UID: \"3fefce99-6821-40e4-97e3-8348becf8079\") " pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.766792 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.766783 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfznz\" (UniqueName: \"kubernetes.io/projected/0c201161-d05a-452a-806a-be74c902a26a-kube-api-access-xfznz\") pod \"node-resolver-mjfzt\" (UID: \"0c201161-d05a-452a-806a-be74c902a26a\") " pod="openshift-dns/node-resolver-mjfzt" Sep 07 12:40:44.766959 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.766785 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp8h4\" (UniqueName: \"kubernetes.io/projected/d641371d-23bb-4111-b530-8fd27ccff558-kube-api-access-cp8h4\") pod \"multus-additional-cni-plugins-grn48\" (UID: \"d641371d-23bb-4111-b530-8fd27ccff558\") " pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.766959 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.766903 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvqtd\" (UniqueName: \"kubernetes.io/projected/dedaea8c-e647-441e-a4ae-2e728bf38f3b-kube-api-access-nvqtd\") pod \"node-ca-vppzn\" (UID: \"dedaea8c-e647-441e-a4ae-2e728bf38f3b\") " pod="openshift-image-registry/node-ca-vppzn" Sep 07 12:40:44.767354 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.767334 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkw7s\" (UniqueName: \"kubernetes.io/projected/8ca94cce-1b24-4320-8849-8472c850f841-kube-api-access-wkw7s\") pod \"tuned-hc2g2\" (UID: \"8ca94cce-1b24-4320-8849-8472c850f841\") " pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.767643 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.767622 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72xds\" (UniqueName: \"kubernetes.io/projected/30deb2a3-d9b5-475c-9d2a-2e7043493dfa-kube-api-access-72xds\") pod \"aws-ebs-csi-driver-node-ltn5f\" (UID: \"30deb2a3-d9b5-475c-9d2a-2e7043493dfa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.768277 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.768259 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6vnr\" (UniqueName: \"kubernetes.io/projected/88c58f57-e0c6-4de1-bcc9-9a95451cc520-kube-api-access-s6vnr\") pod \"multus-cq2dj\" (UID: \"88c58f57-e0c6-4de1-bcc9-9a95451cc520\") " pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.784489 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.784327 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:40:44.791790 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:44.791766 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea6adedb9dcd115be4eba74ebae07fc.slice/crio-a2f6e72264a9bd511d631f8dcea2f00ea6a5993468b6e2c1386649b32d189765 WatchSource:0}: Error finding container a2f6e72264a9bd511d631f8dcea2f00ea6a5993468b6e2c1386649b32d189765: Status 404 returned error can't find the container with id a2f6e72264a9bd511d631f8dcea2f00ea6a5993468b6e2c1386649b32d189765 Sep 07 12:40:44.792418 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:44.792401 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354628df5e5c0356cd158ffc3ea8a19c.slice/crio-68956fa2cb449d3f9f43697dc24f6d27afcfca1cdb81364c493e7c010d8b285e WatchSource:0}: Error finding container 68956fa2cb449d3f9f43697dc24f6d27afcfca1cdb81364c493e7c010d8b285e: Status 404 returned error can't find the container with id 68956fa2cb449d3f9f43697dc24f6d27afcfca1cdb81364c493e7c010d8b285e Sep 07 12:40:44.797897 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.797881 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 12:40:44.874219 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.874134 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nwvg8" Sep 07 12:40:44.883352 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:44.883331 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382b48ad_9f65_46b3_9403_fd3fae4b7325.slice/crio-bce74a8045cfdeca826abf6a084c0180ea7beb6cfaebb0c5e5d5197f8065be41 WatchSource:0}: Error finding container bce74a8045cfdeca826abf6a084c0180ea7beb6cfaebb0c5e5d5197f8065be41: Status 404 returned error can't find the container with id bce74a8045cfdeca826abf6a084c0180ea7beb6cfaebb0c5e5d5197f8065be41 Sep 07 12:40:44.887600 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.887585 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8lhcw" Sep 07 12:40:44.895245 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.895226 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" Sep 07 12:40:44.895416 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:44.895397 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7c1678_7feb_48ce_8e2b_cf787e607364.slice/crio-402e167c9b60e02ca51a29f727fae08446deeb5769085dfe46239b27b76cbef4 WatchSource:0}: Error finding container 402e167c9b60e02ca51a29f727fae08446deeb5769085dfe46239b27b76cbef4: Status 404 returned error can't find the container with id 402e167c9b60e02ca51a29f727fae08446deeb5769085dfe46239b27b76cbef4 Sep 07 12:40:44.903167 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:44.903144 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30deb2a3_d9b5_475c_9d2a_2e7043493dfa.slice/crio-df59272136f3ecb23cf4649108896afcee20dba5cf189209641103c42b2a6d30 WatchSource:0}: Error finding container df59272136f3ecb23cf4649108896afcee20dba5cf189209641103c42b2a6d30: Status 404 returned error can't find the container with id df59272136f3ecb23cf4649108896afcee20dba5cf189209641103c42b2a6d30 Sep 07 12:40:44.914353 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.914336 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mjfzt" Sep 07 12:40:44.921786 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:44.921768 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c201161_d05a_452a_806a_be74c902a26a.slice/crio-2990c4a03ee720b828f9906dc6ae55228ca116e2ccc7de32b8637510647ca969 WatchSource:0}: Error finding container 2990c4a03ee720b828f9906dc6ae55228ca116e2ccc7de32b8637510647ca969: Status 404 returned error can't find the container with id 2990c4a03ee720b828f9906dc6ae55228ca116e2ccc7de32b8637510647ca969 Sep 07 12:40:44.927780 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.927768 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vppzn" Sep 07 12:40:44.934775 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:44.934757 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddedaea8c_e647_441e_a4ae_2e728bf38f3b.slice/crio-f46d453facf6b049d1c4a68d97515e81bdf09f05bc159522e6ab1ae6c682be31 WatchSource:0}: Error finding container f46d453facf6b049d1c4a68d97515e81bdf09f05bc159522e6ab1ae6c682be31: Status 404 returned error can't find the container with id f46d453facf6b049d1c4a68d97515e81bdf09f05bc159522e6ab1ae6c682be31 Sep 07 12:40:44.945002 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.944985 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cq2dj" Sep 07 12:40:44.949703 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.949679 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:40:44.951907 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:44.951890 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c58f57_e0c6_4de1_bcc9_9a95451cc520.slice/crio-0749ce85e47760e8f1d4d1956eebe90d57b57691e10c6704a45216e11d46ec20 WatchSource:0}: Error finding container 0749ce85e47760e8f1d4d1956eebe90d57b57691e10c6704a45216e11d46ec20: Status 404 returned error can't find the container with id 0749ce85e47760e8f1d4d1956eebe90d57b57691e10c6704a45216e11d46ec20 Sep 07 12:40:44.953927 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.953913 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" Sep 07 12:40:44.957763 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:44.957747 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fefce99_6821_40e4_97e3_8348becf8079.slice/crio-a7bbbe3de4fc0e5c7b150c9715caca5fbf3e17a55596147787d191d248258ea4 WatchSource:0}: Error finding container a7bbbe3de4fc0e5c7b150c9715caca5fbf3e17a55596147787d191d248258ea4: Status 404 returned error can't find the container with id a7bbbe3de4fc0e5c7b150c9715caca5fbf3e17a55596147787d191d248258ea4 Sep 07 12:40:44.963387 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:44.963370 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca94cce_1b24_4320_8849_8472c850f841.slice/crio-35ead4e668c116e403efe56d214b1ab9ee87384af5c7f2e862f338344ba462ae WatchSource:0}: Error finding container 35ead4e668c116e403efe56d214b1ab9ee87384af5c7f2e862f338344ba462ae: Status 404 returned error can't find the container with id 35ead4e668c116e403efe56d214b1ab9ee87384af5c7f2e862f338344ba462ae Sep 07 12:40:44.976413 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:44.976397 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-grn48" Sep 07 12:40:44.984621 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:40:44.984606 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd641371d_23bb_4111_b530_8fd27ccff558.slice/crio-d2d880b0fdfdb0ad651d434a0839ebc9fb9005e44d000daece5dae02d2900be5 WatchSource:0}: Error finding container d2d880b0fdfdb0ad651d434a0839ebc9fb9005e44d000daece5dae02d2900be5: Status 404 returned error can't find the container with id d2d880b0fdfdb0ad651d434a0839ebc9fb9005e44d000daece5dae02d2900be5 Sep 07 12:40:44.985895 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.985873 2579 kuberuntime_manager.go:1459] "Unhandled Error" err="init container egress-router-binary-copy start failed in pod multus-additional-cni-plugins-grn48_openshift-multus(d641371d-23bb-4111-b530-8fd27ccff558): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Sep 07 12:40:44.985944 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:44.985904 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"egress-router-binary-copy\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-multus/multus-additional-cni-plugins-grn48" podUID="d641371d-23bb-4111-b530-8fd27ccff558" Sep 07 12:40:45.162124 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.162034 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs\") pod \"network-metrics-daemon-9mbh5\" (UID: \"bce0dedd-2b68-4c5d-8504-150a18723edd\") " pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:45.162268 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:45.162190 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:40:45.162268 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:45.162253 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs podName:bce0dedd-2b68-4c5d-8504-150a18723edd nodeName:}" failed. No retries permitted until 2026-09-07 12:40:46.162235911 +0000 UTC m=+3.031979279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs") pod "network-metrics-daemon-9mbh5" (UID: "bce0dedd-2b68-4c5d-8504-150a18723edd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:40:45.262801 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.262739 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret\") pod \"global-pull-secret-syncer-pfgjt\" (UID: \"3fce5c0f-7c8a-4f83-be38-940c689527e8\") " pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:45.262961 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:45.262894 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:40:45.262961 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:45.262942 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret podName:3fce5c0f-7c8a-4f83-be38-940c689527e8 nodeName:}" failed. No retries permitted until 2026-09-07 12:40:46.262931644 +0000 UTC m=+3.132675019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret") pod "global-pull-secret-syncer-pfgjt" (UID: "3fce5c0f-7c8a-4f83-be38-940c689527e8") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:40:45.369589 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.363507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5s9\" (UniqueName: \"kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9\") pod \"network-check-target-tsptp\" (UID: \"7365e1ad-5b47-499b-ad6e-3748efd38d65\") " pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:40:45.370626 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:45.370134 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:40:45.370626 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:45.370159 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:40:45.370626 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:45.370170 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4w5s9 for pod openshift-network-diagnostics/network-check-target-tsptp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:40:45.370626 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:45.370215 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9 podName:7365e1ad-5b47-499b-ad6e-3748efd38d65 nodeName:}" failed. No retries permitted until 2026-09-07 12:40:46.370202201 +0000 UTC m=+3.239945565 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4w5s9" (UniqueName: "kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9") pod "network-check-target-tsptp" (UID: "7365e1ad-5b47-499b-ad6e-3748efd38d65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:40:45.585082 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.585014 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:40:45.627827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.627773 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 12:35:44 +0000 UTC" deadline="2028-02-24 04:06:46.71531936 +0000 UTC" Sep 07 12:40:45.627827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.627825 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12831h26m1.087498156s" Sep 07 12:40:45.660558 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.659889 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:45.660558 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:45.660006 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:40:45.660558 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.660427 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:45.660558 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:45.660521 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:40:45.664249 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.664201 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal" event={"ID":"3ea6adedb9dcd115be4eba74ebae07fc","Type":"ContainerStarted","Data":"a2f6e72264a9bd511d631f8dcea2f00ea6a5993468b6e2c1386649b32d189765"} Sep 07 12:40:45.667641 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.667620 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" event={"ID":"3fefce99-6821-40e4-97e3-8348becf8079","Type":"ContainerStarted","Data":"a7bbbe3de4fc0e5c7b150c9715caca5fbf3e17a55596147787d191d248258ea4"} Sep 07 12:40:45.669975 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.669953 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cq2dj" event={"ID":"88c58f57-e0c6-4de1-bcc9-9a95451cc520","Type":"ContainerStarted","Data":"0749ce85e47760e8f1d4d1956eebe90d57b57691e10c6704a45216e11d46ec20"} Sep 07 12:40:45.671431 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.671410 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vppzn" event={"ID":"dedaea8c-e647-441e-a4ae-2e728bf38f3b","Type":"ContainerStarted","Data":"f46d453facf6b049d1c4a68d97515e81bdf09f05bc159522e6ab1ae6c682be31"} Sep 07 12:40:45.674809 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.674786 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grn48" event={"ID":"d641371d-23bb-4111-b530-8fd27ccff558","Type":"ContainerStarted","Data":"d2d880b0fdfdb0ad651d434a0839ebc9fb9005e44d000daece5dae02d2900be5"} Sep 07 12:40:45.679591 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:45.679545 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"egress-router-binary-copy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d2fae617617ccbdef514e3068eb3db7ed6f5869fe748bbfc9d66eb536d3e26f\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-multus/multus-additional-cni-plugins-grn48" podUID="d641371d-23bb-4111-b530-8fd27ccff558" Sep 07 12:40:45.681406 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.681386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" event={"ID":"8ca94cce-1b24-4320-8849-8472c850f841","Type":"ContainerStarted","Data":"35ead4e668c116e403efe56d214b1ab9ee87384af5c7f2e862f338344ba462ae"} Sep 07 12:40:45.687157 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.687135 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mjfzt" event={"ID":"0c201161-d05a-452a-806a-be74c902a26a","Type":"ContainerStarted","Data":"2990c4a03ee720b828f9906dc6ae55228ca116e2ccc7de32b8637510647ca969"} Sep 07 12:40:45.688723 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.688703 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" event={"ID":"30deb2a3-d9b5-475c-9d2a-2e7043493dfa","Type":"ContainerStarted","Data":"df59272136f3ecb23cf4649108896afcee20dba5cf189209641103c42b2a6d30"} Sep 07 12:40:45.692780 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.692741 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8lhcw" event={"ID":"8c7c1678-7feb-48ce-8e2b-cf787e607364","Type":"ContainerStarted","Data":"402e167c9b60e02ca51a29f727fae08446deeb5769085dfe46239b27b76cbef4"} Sep 07 12:40:45.695936 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.695915 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nwvg8" event={"ID":"382b48ad-9f65-46b3-9403-fd3fae4b7325","Type":"ContainerStarted","Data":"bce74a8045cfdeca826abf6a084c0180ea7beb6cfaebb0c5e5d5197f8065be41"} Sep 07 12:40:45.702509 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:45.702411 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-78.ec2.internal" event={"ID":"354628df5e5c0356cd158ffc3ea8a19c","Type":"ContainerStarted","Data":"68956fa2cb449d3f9f43697dc24f6d27afcfca1cdb81364c493e7c010d8b285e"} Sep 07 12:40:46.169097 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:46.169057 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs\") pod \"network-metrics-daemon-9mbh5\" (UID: \"bce0dedd-2b68-4c5d-8504-150a18723edd\") " pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:46.169256 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:46.169236 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:40:46.169320 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:46.169296 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs podName:bce0dedd-2b68-4c5d-8504-150a18723edd nodeName:}" failed. No retries permitted until 2026-09-07 12:40:48.169278719 +0000 UTC m=+5.039022098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs") pod "network-metrics-daemon-9mbh5" (UID: "bce0dedd-2b68-4c5d-8504-150a18723edd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:40:46.270083 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:46.270047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret\") pod \"global-pull-secret-syncer-pfgjt\" (UID: \"3fce5c0f-7c8a-4f83-be38-940c689527e8\") " pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:46.270248 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:46.270185 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:40:46.270248 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:46.270243 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret podName:3fce5c0f-7c8a-4f83-be38-940c689527e8 nodeName:}" failed. No retries permitted until 2026-09-07 12:40:48.270226145 +0000 UTC m=+5.139969531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret") pod "global-pull-secret-syncer-pfgjt" (UID: "3fce5c0f-7c8a-4f83-be38-940c689527e8") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:40:46.370842 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:46.370810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5s9\" (UniqueName: \"kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9\") pod \"network-check-target-tsptp\" (UID: \"7365e1ad-5b47-499b-ad6e-3748efd38d65\") " pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:40:46.370982 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:46.370968 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:40:46.371021 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:46.370994 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:40:46.371021 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:46.371007 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4w5s9 for pod openshift-network-diagnostics/network-check-target-tsptp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:40:46.371176 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:46.371057 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9 podName:7365e1ad-5b47-499b-ad6e-3748efd38d65 nodeName:}" failed. No retries permitted until 2026-09-07 12:40:48.371041122 +0000 UTC m=+5.240784499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4w5s9" (UniqueName: "kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9") pod "network-check-target-tsptp" (UID: "7365e1ad-5b47-499b-ad6e-3748efd38d65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:40:46.439259 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:46.439192 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:40:46.628069 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:46.628022 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 12:35:44 +0000 UTC" deadline="2028-06-01 16:05:56.018773288 +0000 UTC" Sep 07 12:40:46.628069 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:46.628067 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15195h25m9.390711281s" Sep 07 12:40:46.654797 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:46.654765 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:40:46.654961 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:46.654918 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:40:47.654607 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:47.654554 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:47.655133 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:47.654715 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:40:47.655133 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:47.655089 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:47.655238 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:47.655190 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:40:47.657549 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:47.657320 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:40:48.186850 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:48.186816 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs\") pod \"network-metrics-daemon-9mbh5\" (UID: \"bce0dedd-2b68-4c5d-8504-150a18723edd\") " pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:48.187074 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:48.187040 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:40:48.187143 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:48.187101 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs podName:bce0dedd-2b68-4c5d-8504-150a18723edd nodeName:}" failed. No retries permitted until 2026-09-07 12:40:52.187083093 +0000 UTC m=+9.056826464 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs") pod "network-metrics-daemon-9mbh5" (UID: "bce0dedd-2b68-4c5d-8504-150a18723edd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:40:48.287508 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:48.287472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret\") pod \"global-pull-secret-syncer-pfgjt\" (UID: \"3fce5c0f-7c8a-4f83-be38-940c689527e8\") " pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:48.287745 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:48.287657 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:40:48.287812 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:48.287793 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret podName:3fce5c0f-7c8a-4f83-be38-940c689527e8 nodeName:}" failed. No retries permitted until 2026-09-07 12:40:52.287771899 +0000 UTC m=+9.157515282 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret") pod "global-pull-secret-syncer-pfgjt" (UID: "3fce5c0f-7c8a-4f83-be38-940c689527e8") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:40:48.388527 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:48.388489 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5s9\" (UniqueName: \"kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9\") pod \"network-check-target-tsptp\" (UID: \"7365e1ad-5b47-499b-ad6e-3748efd38d65\") " pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:40:48.388713 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:48.388692 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:40:48.388713 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:48.388709 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:40:48.388787 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:48.388718 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4w5s9 for pod openshift-network-diagnostics/network-check-target-tsptp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:40:48.388787 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:48.388764 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9 podName:7365e1ad-5b47-499b-ad6e-3748efd38d65 nodeName:}" failed. No retries permitted until 2026-09-07 12:40:52.388750092 +0000 UTC m=+9.258493471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4w5s9" (UniqueName: "kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9") pod "network-check-target-tsptp" (UID: "7365e1ad-5b47-499b-ad6e-3748efd38d65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:40:48.653975 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:48.653902 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:40:48.654124 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:48.654022 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:40:49.654750 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:49.654711 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:49.655294 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:49.654843 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:40:49.655294 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:49.654922 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:49.655294 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:49.654988 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:40:50.653996 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:50.653965 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:40:50.654175 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:50.654097 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:40:51.655116 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:51.654632 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:51.655116 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:51.654763 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:40:51.655116 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:51.655019 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:51.655538 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:51.655135 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:40:52.221383 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:52.220834 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs\") pod \"network-metrics-daemon-9mbh5\" (UID: \"bce0dedd-2b68-4c5d-8504-150a18723edd\") " pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:52.221383 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:52.220988 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:40:52.221383 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:52.221050 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs podName:bce0dedd-2b68-4c5d-8504-150a18723edd nodeName:}" failed. No retries permitted until 2026-09-07 12:41:00.221031277 +0000 UTC m=+17.090774657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs") pod "network-metrics-daemon-9mbh5" (UID: "bce0dedd-2b68-4c5d-8504-150a18723edd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:40:52.322123 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:52.322039 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret\") pod \"global-pull-secret-syncer-pfgjt\" (UID: \"3fce5c0f-7c8a-4f83-be38-940c689527e8\") " pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:52.322282 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:52.322195 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:40:52.322282 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:52.322246 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret podName:3fce5c0f-7c8a-4f83-be38-940c689527e8 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:00.322232593 +0000 UTC m=+17.191975972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret") pod "global-pull-secret-syncer-pfgjt" (UID: "3fce5c0f-7c8a-4f83-be38-940c689527e8") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:40:52.423242 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:52.423201 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5s9\" (UniqueName: \"kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9\") pod \"network-check-target-tsptp\" (UID: \"7365e1ad-5b47-499b-ad6e-3748efd38d65\") " pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:40:52.423402 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:52.423347 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:40:52.423402 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:52.423362 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:40:52.423402 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:52.423371 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4w5s9 for pod openshift-network-diagnostics/network-check-target-tsptp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:40:52.423562 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:52.423415 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9 podName:7365e1ad-5b47-499b-ad6e-3748efd38d65 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:00.423402822 +0000 UTC m=+17.293146201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4w5s9" (UniqueName: "kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9") pod "network-check-target-tsptp" (UID: "7365e1ad-5b47-499b-ad6e-3748efd38d65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:40:52.654832 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:52.654331 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:40:52.654832 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:52.654445 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:40:53.655060 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:53.655024 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:53.655509 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:53.655132 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:40:53.655509 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:53.655165 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:53.655509 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:53.655268 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:40:54.654712 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:54.654682 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:40:54.654857 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:54.654791 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:40:55.653924 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:55.653847 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:55.653924 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:55.653868 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:55.654393 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:55.653973 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:40:55.654393 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:55.654110 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:40:56.654435 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:56.654399 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:40:56.655059 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:56.654512 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:40:57.654197 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:57.654165 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:57.654371 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:57.654165 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:57.654371 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:57.654318 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:40:57.654503 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:57.654380 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:40:58.654666 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:58.654633 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:40:58.655069 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:58.654736 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:40:59.655151 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:59.654503 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:40:59.655151 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:40:59.654512 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:40:59.655151 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:59.654652 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:40:59.655151 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:40:59.654710 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:41:00.279921 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:00.279877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs\") pod \"network-metrics-daemon-9mbh5\" (UID: \"bce0dedd-2b68-4c5d-8504-150a18723edd\") " pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:41:00.280151 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:00.280061 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:41:00.280151 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:00.280138 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs podName:bce0dedd-2b68-4c5d-8504-150a18723edd nodeName:}" failed. No retries permitted until 2026-09-07 12:41:16.280121695 +0000 UTC m=+33.149865060 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs") pod "network-metrics-daemon-9mbh5" (UID: "bce0dedd-2b68-4c5d-8504-150a18723edd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:41:00.380734 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:00.380699 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret\") pod \"global-pull-secret-syncer-pfgjt\" (UID: \"3fce5c0f-7c8a-4f83-be38-940c689527e8\") " pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:41:00.380921 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:00.380858 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:41:00.380972 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:00.380929 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret podName:3fce5c0f-7c8a-4f83-be38-940c689527e8 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:16.38090944 +0000 UTC m=+33.250652809 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret") pod "global-pull-secret-syncer-pfgjt" (UID: "3fce5c0f-7c8a-4f83-be38-940c689527e8") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:41:00.481256 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:00.481229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5s9\" (UniqueName: \"kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9\") pod \"network-check-target-tsptp\" (UID: \"7365e1ad-5b47-499b-ad6e-3748efd38d65\") " pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:00.481402 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:00.481356 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:41:00.481402 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:00.481368 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:41:00.481402 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:00.481378 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4w5s9 for pod openshift-network-diagnostics/network-check-target-tsptp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:41:00.481529 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:00.481429 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9 podName:7365e1ad-5b47-499b-ad6e-3748efd38d65 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:16.481413478 +0000 UTC m=+33.351156846 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4w5s9" (UniqueName: "kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9") pod "network-check-target-tsptp" (UID: "7365e1ad-5b47-499b-ad6e-3748efd38d65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:41:00.654131 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:00.654050 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:00.654279 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:00.654170 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:41:01.654374 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:01.654338 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:41:01.654920 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:01.654339 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:41:01.654920 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:01.654462 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:41:01.654920 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:01.654591 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:41:02.653993 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:02.653961 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:02.654172 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:02.654074 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:41:03.654308 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:03.654277 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:41:03.654869 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:03.654390 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:41:03.654869 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:03.654435 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:41:03.654869 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:03.654523 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:41:03.739158 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:03.739104 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-78.ec2.internal" event={"ID":"354628df5e5c0356cd158ffc3ea8a19c","Type":"ContainerStarted","Data":"f303c340e4236fcde4b8da16d28034663ddd498b4fda734ee4849a57b31d93de"} Sep 07 12:41:03.752786 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:03.752735 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-78.ec2.internal" podStartSLOduration=19.752719785 podStartE2EDuration="19.752719785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:03.751864536 +0000 UTC m=+20.621607924" watchObservedRunningTime="2026-09-07 12:41:03.752719785 +0000 UTC m=+20.622463173" Sep 07 12:41:04.654732 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.654565 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:04.655208 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:04.654801 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:41:04.743770 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.743689 2579 generic.go:356] "Generic (PLEG): container finished" podID="3ea6adedb9dcd115be4eba74ebae07fc" containerID="451984ba0219c560a5cfae7be7f9e6b51992ba0460728f540fcdc811d002a815" exitCode=0 Sep 07 12:41:04.743912 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.743777 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal" event={"ID":"3ea6adedb9dcd115be4eba74ebae07fc","Type":"ContainerDied","Data":"451984ba0219c560a5cfae7be7f9e6b51992ba0460728f540fcdc811d002a815"} Sep 07 12:41:04.747154 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.747131 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" event={"ID":"3fefce99-6821-40e4-97e3-8348becf8079","Type":"ContainerStarted","Data":"5b8bb8c5a42047e99278d55edb2a211d42f57fa3f40f5a236f1b0d211093a520"} Sep 07 12:41:04.747256 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.747188 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" event={"ID":"3fefce99-6821-40e4-97e3-8348becf8079","Type":"ContainerStarted","Data":"9ab2c5a9ae6c1898c303e2376dab2f353e711ca28e23daaca28de6a16b33289c"} Sep 07 12:41:04.747256 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.747218 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" event={"ID":"3fefce99-6821-40e4-97e3-8348becf8079","Type":"ContainerStarted","Data":"b0fd18b6529a5fcdcebf7f55eaadcedc8b1da71366d9aab962b584b33e57fe62"} Sep 07 12:41:04.747256 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.747244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" event={"ID":"3fefce99-6821-40e4-97e3-8348becf8079","Type":"ContainerStarted","Data":"f91071c4b693661ae343b657d628eec598d3fd85d5f04a6a5d2eba6ee39ca0ac"} Sep 07 12:41:04.747367 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.747274 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" event={"ID":"3fefce99-6821-40e4-97e3-8348becf8079","Type":"ContainerStarted","Data":"115c08547eee4d7668ff93cb329cd6087236d5636b98dbccf008cfc8c8dd870c"} Sep 07 12:41:04.749084 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.749045 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cq2dj" event={"ID":"88c58f57-e0c6-4de1-bcc9-9a95451cc520","Type":"ContainerStarted","Data":"dc698ebb9cba25f799b7a6dab787a4e207a8d53aaf16c56234f69c7d53ed1456"} Sep 07 12:41:04.751218 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.751196 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vppzn" event={"ID":"dedaea8c-e647-441e-a4ae-2e728bf38f3b","Type":"ContainerStarted","Data":"ae6a783c209d9e3aed03f2131536ac6e28e85ea595e0b006fcbdb5e270596566"} Sep 07 12:41:04.753119 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.753096 2579 generic.go:356] "Generic (PLEG): container finished" podID="d641371d-23bb-4111-b530-8fd27ccff558" containerID="dbf2b320b056a0fc06ec464a32339507f77774ea55359ff7f442b57a0a9154b0" exitCode=0 Sep 07 12:41:04.753219 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.753167 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grn48" event={"ID":"d641371d-23bb-4111-b530-8fd27ccff558","Type":"ContainerDied","Data":"dbf2b320b056a0fc06ec464a32339507f77774ea55359ff7f442b57a0a9154b0"} Sep 07 12:41:04.757348 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.756368 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" event={"ID":"8ca94cce-1b24-4320-8849-8472c850f841","Type":"ContainerStarted","Data":"0e20d68d9c6f1740d869e6228e8c950dd4547e3aa104deaa8e9060dab044ac1a"} Sep 07 12:41:04.759924 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.759897 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mjfzt" event={"ID":"0c201161-d05a-452a-806a-be74c902a26a","Type":"ContainerStarted","Data":"13919ad03ed4a8b19ede7b16bc9bb4e5c96673e7d9274d931b45627d4a4da829"} Sep 07 12:41:04.761739 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.761618 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" event={"ID":"30deb2a3-d9b5-475c-9d2a-2e7043493dfa","Type":"ContainerStarted","Data":"0bd579f57dfab76ad3bd3aff59d0fbe2de5af97e864ca5a372bd1c730f14e589"} Sep 07 12:41:04.763340 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.763309 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8lhcw" event={"ID":"8c7c1678-7feb-48ce-8e2b-cf787e607364","Type":"ContainerStarted","Data":"6010017e97a7897628a808769166e6f37e07ff5cb2a6d7a34b82d08ecb38a4a5"} Sep 07 12:41:04.773079 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.773035 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vppzn" podStartSLOduration=3.962694138 podStartE2EDuration="21.773020218s" totalImagesPullingTime="17.81032608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:04.772958518 +0000 UTC m=+21.642701906" watchObservedRunningTime="2026-09-07 12:41:04.773020218 +0000 UTC m=+21.642763607" Sep 07 12:41:04.804334 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.804302 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cq2dj" podStartSLOduration=3.091979051 podStartE2EDuration="21.80429149s" totalImagesPullingTime="18.712312439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:04.789062207 +0000 UTC m=+21.658805584" watchObservedRunningTime="2026-09-07 12:41:04.80429149 +0000 UTC m=+21.674034876" Sep 07 12:41:04.820625 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.820594 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hc2g2" podStartSLOduration=4.038848674 podStartE2EDuration="21.820561089s" totalImagesPullingTime="17.781712415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:04.804025775 +0000 UTC m=+21.673769164" watchObservedRunningTime="2026-09-07 12:41:04.820561089 +0000 UTC m=+21.690304479" Sep 07 12:41:04.836495 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.836460 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8lhcw" podStartSLOduration=3.9521959239999997 podStartE2EDuration="21.836451008s" totalImagesPullingTime="17.884255084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:04.83627433 +0000 UTC m=+21.706017717" watchObservedRunningTime="2026-09-07 12:41:04.836451008 +0000 UTC m=+21.706194397" Sep 07 12:41:04.853939 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.853910 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mjfzt" podStartSLOduration=4.03145534 podStartE2EDuration="21.853896257s" totalImagesPullingTime="17.822440917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:04.853742468 +0000 UTC m=+21.723485856" watchObservedRunningTime="2026-09-07 12:41:04.853896257 +0000 UTC m=+21.723639647" Sep 07 12:41:04.993249 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:04.993231 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 07 12:41:05.624522 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:05.624415 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T12:41:04.993245788Z","UUID":"c5a2839d-f575-4d6f-a4c4-b0517c01c04a","Handler":null,"Name":"","Endpoint":""} Sep 07 12:41:05.626227 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:05.626202 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 07 12:41:05.626343 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:05.626239 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 07 12:41:05.653816 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:05.653792 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:41:05.653959 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:05.653906 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:41:05.654032 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:05.654010 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:41:05.654154 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:05.654134 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:41:05.771465 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:05.771427 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" event={"ID":"30deb2a3-d9b5-475c-9d2a-2e7043493dfa","Type":"ContainerStarted","Data":"8b6a694b270a6c90b2beb7439d4ba8a76dcd486dcda528c104c6c6e2276b75f7"} Sep 07 12:41:05.773560 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:05.773525 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nwvg8" event={"ID":"382b48ad-9f65-46b3-9403-fd3fae4b7325","Type":"ContainerStarted","Data":"78d00fc5c6bbe0ca7e49ccd616af8e54da19b5a93fedb151ae3569943cfe73c1"} Sep 07 12:41:05.776612 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:05.776093 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal" event={"ID":"3ea6adedb9dcd115be4eba74ebae07fc","Type":"ContainerStarted","Data":"e13026b0853009c6870b3e42e2b718f1174f95edccd9fc52a696c76fa2f7481c"} Sep 07 12:41:05.781378 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:05.780899 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" event={"ID":"3fefce99-6821-40e4-97e3-8348becf8079","Type":"ContainerStarted","Data":"58e2025f32b583dbc336d28c157ef3b13c43493ca08c36e4299836df07bca935"} Sep 07 12:41:05.788446 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:05.788399 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nwvg8" podStartSLOduration=4.893536704 podStartE2EDuration="22.78838248s" totalImagesPullingTime="17.894845776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:05.787846647 +0000 UTC m=+22.657590036" watchObservedRunningTime="2026-09-07 12:41:05.78838248 +0000 UTC m=+22.658125868" Sep 07 12:41:05.801223 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:05.801178 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-78.ec2.internal" podStartSLOduration=21.801167997 podStartE2EDuration="21.801167997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:05.800734806 +0000 UTC m=+22.670478195" watchObservedRunningTime="2026-09-07 12:41:05.801167997 +0000 UTC m=+22.670911385" Sep 07 12:41:06.156202 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:06.156024 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8lhcw" Sep 07 12:41:06.357067 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:06.357029 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8lhcw" Sep 07 12:41:06.358010 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:06.357985 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8lhcw" Sep 07 12:41:06.654767 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:06.654741 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:06.654944 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:06.654842 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:41:06.786059 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:06.786004 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" event={"ID":"30deb2a3-d9b5-475c-9d2a-2e7043493dfa","Type":"ContainerStarted","Data":"a55fa073b48c12300e7726edaedc8411c95cc411026bf90d102cbac58145cb97"} Sep 07 12:41:06.786810 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:06.786788 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8lhcw" Sep 07 12:41:06.814638 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:06.814590 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltn5f" podStartSLOduration=3.944111488 podStartE2EDuration="23.814555178s" totalImagesPullingTime="19.87044369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:40:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:06.81393495 +0000 UTC m=+23.683678338" watchObservedRunningTime="2026-09-07 12:41:06.814555178 +0000 UTC m=+23.684298565" Sep 07 12:41:07.654616 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:07.654588 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:41:07.654616 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:07.654601 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:41:07.654861 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:07.654718 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:41:07.654929 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:07.654858 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:41:07.796348 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:07.796315 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" event={"ID":"3fefce99-6821-40e4-97e3-8348becf8079","Type":"ContainerStarted","Data":"baf78e384f0b3efea11683218e26657cb5f9907be88bf3a228367784d98db74c"} Sep 07 12:41:08.653963 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:08.653936 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:08.654110 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:08.654035 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:41:09.657074 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:09.656904 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:41:09.657475 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:09.656940 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:41:09.657475 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:09.657158 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:41:09.657475 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:09.657201 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:41:09.802391 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:09.802367 2579 generic.go:356] "Generic (PLEG): container finished" podID="d641371d-23bb-4111-b530-8fd27ccff558" containerID="b67c49679823c6413c7c3a59e86dd3e6b4b094a05c2221ee851eb27d77290db6" exitCode=0 Sep 07 12:41:09.802555 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:09.802457 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grn48" event={"ID":"d641371d-23bb-4111-b530-8fd27ccff558","Type":"ContainerDied","Data":"b67c49679823c6413c7c3a59e86dd3e6b4b094a05c2221ee851eb27d77290db6"} Sep 07 12:41:09.806298 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:09.806276 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" event={"ID":"3fefce99-6821-40e4-97e3-8348becf8079","Type":"ContainerStarted","Data":"fcc6442fa2e4eb7c8e24f5f42fe4ab44849d6a2b32f5bc48e4a1de3ff95b166c"} Sep 07 12:41:09.806558 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:09.806539 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:41:09.806670 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:09.806611 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:41:09.806670 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:09.806658 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:41:09.821869 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:09.821849 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:41:09.822026 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:09.822011 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:41:09.850468 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:09.850432 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" podStartSLOduration=7.7396406429999995 podStartE2EDuration="26.850420935s" totalImagesPullingTime="19.110780292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:09.850075545 +0000 UTC m=+26.719818933" watchObservedRunningTime="2026-09-07 12:41:09.850420935 +0000 UTC m=+26.720164322" Sep 07 12:41:10.654551 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:10.654517 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:10.654756 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:10.654659 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:41:10.969992 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:10.969926 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pfgjt"] Sep 07 12:41:10.970649 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:10.970027 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:41:10.970649 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:10.970137 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:41:10.972768 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:10.972732 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9mbh5"] Sep 07 12:41:10.972859 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:10.972837 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:41:10.972956 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:10.972918 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:41:10.984465 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:10.984439 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tsptp"] Sep 07 12:41:10.984560 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:10.984509 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:10.984652 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:10.984615 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:41:11.813010 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:11.812983 2579 generic.go:356] "Generic (PLEG): container finished" podID="d641371d-23bb-4111-b530-8fd27ccff558" containerID="3c8cb67df87498327742fb6c6ef080cb08cd3b1da827716c8eca009d374b571e" exitCode=0 Sep 07 12:41:11.813313 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:11.813054 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grn48" event={"ID":"d641371d-23bb-4111-b530-8fd27ccff558","Type":"ContainerDied","Data":"3c8cb67df87498327742fb6c6ef080cb08cd3b1da827716c8eca009d374b571e"} Sep 07 12:41:12.654523 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:12.654491 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:12.654523 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:12.654518 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:41:12.655059 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:12.654632 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:41:12.655059 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:12.654651 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:41:12.655059 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:12.654792 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:41:12.655059 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:12.654905 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:41:13.825964 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:13.825734 2579 generic.go:356] "Generic (PLEG): container finished" podID="d641371d-23bb-4111-b530-8fd27ccff558" containerID="21d965eed7ac15eb090969f20b4747c4ab3dba358eec1dbf3844c3346185ece7" exitCode=0 Sep 07 12:41:13.826410 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:13.825811 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grn48" event={"ID":"d641371d-23bb-4111-b530-8fd27ccff558","Type":"ContainerDied","Data":"21d965eed7ac15eb090969f20b4747c4ab3dba358eec1dbf3844c3346185ece7"} Sep 07 12:41:14.654253 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:14.654228 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:41:14.654443 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:14.654225 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:14.654443 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:14.654344 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:41:14.654443 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:14.654225 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:41:14.654443 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:14.654405 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:41:14.654682 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:14.654512 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:41:16.300695 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:16.300661 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs\") pod \"network-metrics-daemon-9mbh5\" (UID: \"bce0dedd-2b68-4c5d-8504-150a18723edd\") " pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:41:16.301077 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:16.300835 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:41:16.301077 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:16.300915 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs podName:bce0dedd-2b68-4c5d-8504-150a18723edd nodeName:}" failed. No retries permitted until 2026-09-07 12:41:48.300893171 +0000 UTC m=+65.170636542 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs") pod "network-metrics-daemon-9mbh5" (UID: "bce0dedd-2b68-4c5d-8504-150a18723edd") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:41:16.401717 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:16.401666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret\") pod \"global-pull-secret-syncer-pfgjt\" (UID: \"3fce5c0f-7c8a-4f83-be38-940c689527e8\") " pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:41:16.401889 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:16.401791 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:41:16.401889 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:16.401850 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret podName:3fce5c0f-7c8a-4f83-be38-940c689527e8 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:48.401831335 +0000 UTC m=+65.271574700 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret") pod "global-pull-secret-syncer-pfgjt" (UID: "3fce5c0f-7c8a-4f83-be38-940c689527e8") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:41:16.502588 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:16.502534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5s9\" (UniqueName: \"kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9\") pod \"network-check-target-tsptp\" (UID: \"7365e1ad-5b47-499b-ad6e-3748efd38d65\") " pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:16.502775 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:16.502742 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:41:16.502775 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:16.502768 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:41:16.502895 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:16.502782 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4w5s9 for pod openshift-network-diagnostics/network-check-target-tsptp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:41:16.502895 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:16.502846 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9 podName:7365e1ad-5b47-499b-ad6e-3748efd38d65 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:48.502826678 +0000 UTC m=+65.372570061 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4w5s9" (UniqueName: "kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9") pod "network-check-target-tsptp" (UID: "7365e1ad-5b47-499b-ad6e-3748efd38d65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:41:16.654110 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:16.654027 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:16.654110 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:16.654064 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:41:16.654353 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:16.654027 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:41:16.654353 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:16.654145 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsptp" podUID="7365e1ad-5b47-499b-ad6e-3748efd38d65" Sep 07 12:41:16.654353 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:16.654261 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9mbh5" podUID="bce0dedd-2b68-4c5d-8504-150a18723edd" Sep 07 12:41:16.654492 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:16.654354 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pfgjt" podUID="3fce5c0f-7c8a-4f83-be38-940c689527e8" Sep 07 12:41:17.388521 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.388456 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-78.ec2.internal" event="NodeReady" Sep 07 12:41:17.389005 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.388615 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 07 12:41:17.422020 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.421986 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-764bd57775-s4bs8"] Sep 07 12:41:17.443199 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.443172 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q5khs"] Sep 07 12:41:17.443347 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.443308 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.445813 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.445729 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 07 12:41:17.446170 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.446152 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 07 12:41:17.446294 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.446245 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bzkhd\"" Sep 07 12:41:17.446294 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.446290 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 07 12:41:17.451734 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.451712 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 07 12:41:17.455192 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.455169 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vwcsk"] Sep 07 12:41:17.455306 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.455206 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:17.457392 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.457376 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hgxzh\"" Sep 07 12:41:17.457645 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.457625 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 07 12:41:17.457737 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.457634 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 07 12:41:17.473156 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.473132 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-764bd57775-s4bs8"] Sep 07 12:41:17.473258 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.473170 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q5khs"] Sep 07 12:41:17.473258 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.473194 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vwcsk"] Sep 07 12:41:17.473258 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.473251 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vwcsk" Sep 07 12:41:17.475558 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.475531 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 07 12:41:17.475670 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.475604 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b7m2w\"" Sep 07 12:41:17.475670 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.475539 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 07 12:41:17.475780 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.475532 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 07 12:41:17.511388 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.511360 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93347c79-cfca-4053-946a-1d356b5d45e9-registry-certificates\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.511528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.511423 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93347c79-cfca-4053-946a-1d356b5d45e9-ca-trust-extracted\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.511528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.511459 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93347c79-cfca-4053-946a-1d356b5d45e9-trusted-ca\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.511528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.511487 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-bound-sa-token\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.511528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.511521 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp6bj\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-kube-api-access-bp6bj\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.511759 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.511565 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93347c79-cfca-4053-946a-1d356b5d45e9-installation-pull-secrets\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.511759 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.511644 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93347c79-cfca-4053-946a-1d356b5d45e9-image-registry-private-configuration\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.511759 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.511661 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.612897 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.612860 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8hnj\" (UniqueName: \"kubernetes.io/projected/94474ca3-efb2-4757-ac88-a1687b8d459c-kube-api-access-t8hnj\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:17.613091 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.612927 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp6bj\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-kube-api-access-bp6bj\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.613091 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.612992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5998t\" (UniqueName: \"kubernetes.io/projected/19e142d3-1db3-4755-aef6-26dcad6265b4-kube-api-access-5998t\") pod \"ingress-canary-vwcsk\" (UID: \"19e142d3-1db3-4755-aef6-26dcad6265b4\") " pod="openshift-ingress-canary/ingress-canary-vwcsk" Sep 07 12:41:17.613091 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.613044 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93347c79-cfca-4053-946a-1d356b5d45e9-installation-pull-secrets\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.613208 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.613092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93347c79-cfca-4053-946a-1d356b5d45e9-image-registry-private-configuration\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.613208 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.613114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.613208 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.613137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93347c79-cfca-4053-946a-1d356b5d45e9-registry-certificates\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.613208 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.613160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94474ca3-efb2-4757-ac88-a1687b8d459c-tmp-dir\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:17.613208 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.613200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:17.613414 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.613219 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19e142d3-1db3-4755-aef6-26dcad6265b4-cert\") pod \"ingress-canary-vwcsk\" (UID: \"19e142d3-1db3-4755-aef6-26dcad6265b4\") " pod="openshift-ingress-canary/ingress-canary-vwcsk" Sep 07 12:41:17.613414 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.613261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93347c79-cfca-4053-946a-1d356b5d45e9-ca-trust-extracted\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.613414 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.613285 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93347c79-cfca-4053-946a-1d356b5d45e9-trusted-ca\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.613414 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:17.613320 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:41:17.613414 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:17.613334 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764bd57775-s4bs8: secret "image-registry-tls" not found Sep 07 12:41:17.613414 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.613329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94474ca3-efb2-4757-ac88-a1687b8d459c-config-volume\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:17.613414 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:17.613385 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls podName:93347c79-cfca-4053-946a-1d356b5d45e9 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:18.11336703 +0000 UTC m=+34.983110400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls") pod "image-registry-764bd57775-s4bs8" (UID: "93347c79-cfca-4053-946a-1d356b5d45e9") : secret "image-registry-tls" not found Sep 07 12:41:17.613414 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.613403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-bound-sa-token\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.613848 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.613827 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93347c79-cfca-4053-946a-1d356b5d45e9-ca-trust-extracted\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.613943 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.613913 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93347c79-cfca-4053-946a-1d356b5d45e9-registry-certificates\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.614276 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.614256 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93347c79-cfca-4053-946a-1d356b5d45e9-trusted-ca\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.617756 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.617732 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93347c79-cfca-4053-946a-1d356b5d45e9-image-registry-private-configuration\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.617878 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.617772 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93347c79-cfca-4053-946a-1d356b5d45e9-installation-pull-secrets\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.621620 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.621531 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-bound-sa-token\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.622753 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.622734 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp6bj\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-kube-api-access-bp6bj\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:17.714742 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.714636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5998t\" (UniqueName: \"kubernetes.io/projected/19e142d3-1db3-4755-aef6-26dcad6265b4-kube-api-access-5998t\") pod \"ingress-canary-vwcsk\" (UID: \"19e142d3-1db3-4755-aef6-26dcad6265b4\") " pod="openshift-ingress-canary/ingress-canary-vwcsk" Sep 07 12:41:17.714887 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.714780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94474ca3-efb2-4757-ac88-a1687b8d459c-tmp-dir\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:17.714887 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.714827 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:17.714887 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.714849 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19e142d3-1db3-4755-aef6-26dcad6265b4-cert\") pod \"ingress-canary-vwcsk\" (UID: \"19e142d3-1db3-4755-aef6-26dcad6265b4\") " pod="openshift-ingress-canary/ingress-canary-vwcsk" Sep 07 12:41:17.714887 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.714879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94474ca3-efb2-4757-ac88-a1687b8d459c-config-volume\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:17.715082 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.714933 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8hnj\" (UniqueName: \"kubernetes.io/projected/94474ca3-efb2-4757-ac88-a1687b8d459c-kube-api-access-t8hnj\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:17.715141 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:17.715123 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:41:17.715230 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:17.715217 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls podName:94474ca3-efb2-4757-ac88-a1687b8d459c nodeName:}" failed. No retries permitted until 2026-09-07 12:41:18.215199006 +0000 UTC m=+35.084942385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls") pod "dns-default-q5khs" (UID: "94474ca3-efb2-4757-ac88-a1687b8d459c") : secret "dns-default-metrics-tls" not found Sep 07 12:41:17.715741 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.715712 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94474ca3-efb2-4757-ac88-a1687b8d459c-tmp-dir\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:17.715940 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.715921 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94474ca3-efb2-4757-ac88-a1687b8d459c-config-volume\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:17.717776 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.717755 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19e142d3-1db3-4755-aef6-26dcad6265b4-cert\") pod \"ingress-canary-vwcsk\" (UID: \"19e142d3-1db3-4755-aef6-26dcad6265b4\") " pod="openshift-ingress-canary/ingress-canary-vwcsk" Sep 07 12:41:17.725837 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.725813 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8hnj\" (UniqueName: \"kubernetes.io/projected/94474ca3-efb2-4757-ac88-a1687b8d459c-kube-api-access-t8hnj\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:17.725933 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.725922 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5998t\" (UniqueName: \"kubernetes.io/projected/19e142d3-1db3-4755-aef6-26dcad6265b4-kube-api-access-5998t\") pod \"ingress-canary-vwcsk\" (UID: \"19e142d3-1db3-4755-aef6-26dcad6265b4\") " pod="openshift-ingress-canary/ingress-canary-vwcsk" Sep 07 12:41:17.783125 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.783088 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vwcsk" Sep 07 12:41:17.894377 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.894351 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:17.988982 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:17.988883 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:18.117794 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:18.117768 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:18.117893 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:18.117880 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:41:18.117893 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:18.117891 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764bd57775-s4bs8: secret "image-registry-tls" not found Sep 07 12:41:18.117979 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:18.117934 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls podName:93347c79-cfca-4053-946a-1d356b5d45e9 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:19.117921903 +0000 UTC m=+35.987665268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls") pod "image-registry-764bd57775-s4bs8" (UID: "93347c79-cfca-4053-946a-1d356b5d45e9") : secret "image-registry-tls" not found Sep 07 12:41:18.156648 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:18.156627 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vwcsk"] Sep 07 12:41:18.160111 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:41:18.160089 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e142d3_1db3_4755_aef6_26dcad6265b4.slice/crio-87041ee53cc04458f1c02314e60ae905307b8cc89c6094bdae9eafa892c9e1c6 WatchSource:0}: Error finding container 87041ee53cc04458f1c02314e60ae905307b8cc89c6094bdae9eafa892c9e1c6: Status 404 returned error can't find the container with id 87041ee53cc04458f1c02314e60ae905307b8cc89c6094bdae9eafa892c9e1c6 Sep 07 12:41:18.218443 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:18.218415 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:18.218548 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:18.218525 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:41:18.218676 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:18.218611 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls podName:94474ca3-efb2-4757-ac88-a1687b8d459c nodeName:}" failed. No retries permitted until 2026-09-07 12:41:19.218592155 +0000 UTC m=+36.088335540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls") pod "dns-default-q5khs" (UID: "94474ca3-efb2-4757-ac88-a1687b8d459c") : secret "dns-default-metrics-tls" not found Sep 07 12:41:18.654226 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:18.654171 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:41:18.654608 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:18.654171 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:18.654608 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:18.654179 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:41:18.656877 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:18.656856 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 12:41:18.656964 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:18.656928 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2p7wt\"" Sep 07 12:41:18.656964 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:18.656943 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 12:41:18.656964 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:18.656951 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 12:41:18.656964 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:18.656957 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 12:41:18.657155 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:18.657002 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-49m4z\"" Sep 07 12:41:18.839839 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:18.839793 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vwcsk" event={"ID":"19e142d3-1db3-4755-aef6-26dcad6265b4","Type":"ContainerStarted","Data":"87041ee53cc04458f1c02314e60ae905307b8cc89c6094bdae9eafa892c9e1c6"} Sep 07 12:41:18.843046 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:18.843019 2579 generic.go:356] "Generic (PLEG): container finished" podID="d641371d-23bb-4111-b530-8fd27ccff558" containerID="f9ad5ef451bd0727e4871f23f11b61943bb39f97e1d89b744321ed293f349808" exitCode=0 Sep 07 12:41:18.843166 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:18.843060 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grn48" event={"ID":"d641371d-23bb-4111-b530-8fd27ccff558","Type":"ContainerDied","Data":"f9ad5ef451bd0727e4871f23f11b61943bb39f97e1d89b744321ed293f349808"} Sep 07 12:41:19.125862 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:19.125828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:19.126005 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:19.125967 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:41:19.126005 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:19.125981 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764bd57775-s4bs8: secret "image-registry-tls" not found Sep 07 12:41:19.126087 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:19.126036 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls podName:93347c79-cfca-4053-946a-1d356b5d45e9 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:21.126021258 +0000 UTC m=+37.995764624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls") pod "image-registry-764bd57775-s4bs8" (UID: "93347c79-cfca-4053-946a-1d356b5d45e9") : secret "image-registry-tls" not found Sep 07 12:41:19.226646 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:19.226545 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:19.226768 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:19.226702 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:41:19.226805 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:19.226773 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls podName:94474ca3-efb2-4757-ac88-a1687b8d459c nodeName:}" failed. No retries permitted until 2026-09-07 12:41:21.22675197 +0000 UTC m=+38.096495349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls") pod "dns-default-q5khs" (UID: "94474ca3-efb2-4757-ac88-a1687b8d459c") : secret "dns-default-metrics-tls" not found Sep 07 12:41:19.849411 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:19.849382 2579 generic.go:356] "Generic (PLEG): container finished" podID="d641371d-23bb-4111-b530-8fd27ccff558" containerID="689c9cd105529efbb520c469209047541e450303aa3b99783b011b939b073a18" exitCode=0 Sep 07 12:41:19.849853 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:19.849442 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grn48" event={"ID":"d641371d-23bb-4111-b530-8fd27ccff558","Type":"ContainerDied","Data":"689c9cd105529efbb520c469209047541e450303aa3b99783b011b939b073a18"} Sep 07 12:41:20.854390 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:20.854362 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-grn48" event={"ID":"d641371d-23bb-4111-b530-8fd27ccff558","Type":"ContainerStarted","Data":"8bee3562f02d511cb9f3d7934c88011ac2fc43f7e4ad7d306584bee2d7c4a2a0"} Sep 07 12:41:20.856436 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:20.856401 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:20.877030 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:20.876992 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-grn48" podStartSLOduration=4.705817033 podStartE2EDuration="37.876978936s" totalImagesPullingTime="33.171161903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:40:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=1 observedRunningTime="2026-09-07 12:41:20.875890121 +0000 UTC m=+37.745633510" watchObservedRunningTime="2026-09-07 12:41:20.876978936 +0000 UTC m=+37.746722319" Sep 07 12:41:20.956045 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:20.956019 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:21.057153 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:21.057066 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:21.117702 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:21.117676 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:21.142160 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:21.142140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:21.142296 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:21.142279 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:41:21.142325 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:21.142298 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764bd57775-s4bs8: secret "image-registry-tls" not found Sep 07 12:41:21.142360 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:21.142347 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls podName:93347c79-cfca-4053-946a-1d356b5d45e9 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:25.142332864 +0000 UTC m=+42.012076229 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls") pod "image-registry-764bd57775-s4bs8" (UID: "93347c79-cfca-4053-946a-1d356b5d45e9") : secret "image-registry-tls" not found Sep 07 12:41:21.243334 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:21.243305 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:21.243452 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:21.243399 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:41:21.243493 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:21.243453 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls podName:94474ca3-efb2-4757-ac88-a1687b8d459c nodeName:}" failed. No retries permitted until 2026-09-07 12:41:25.24344123 +0000 UTC m=+42.113184600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls") pod "dns-default-q5khs" (UID: "94474ca3-efb2-4757-ac88-a1687b8d459c") : secret "dns-default-metrics-tls" not found Sep 07 12:41:21.471892 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:21.471863 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:21.572534 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:21.572503 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:21.857719 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:21.857636 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vwcsk" event={"ID":"19e142d3-1db3-4755-aef6-26dcad6265b4","Type":"ContainerStarted","Data":"55f5619e0a192fa7db0cc0fff6a3109556e84e6e96ddb78ed30c163e26e55828"} Sep 07 12:41:24.267113 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:24.267080 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:24.357880 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:24.357855 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:24.954435 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:24.954407 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:25.054936 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:25.054910 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:25.169627 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:25.169600 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:25.169770 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:25.169712 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:41:25.169770 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:25.169724 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764bd57775-s4bs8: secret "image-registry-tls" not found Sep 07 12:41:25.169848 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:25.169785 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls podName:93347c79-cfca-4053-946a-1d356b5d45e9 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:33.16977079 +0000 UTC m=+50.039514160 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls") pod "image-registry-764bd57775-s4bs8" (UID: "93347c79-cfca-4053-946a-1d356b5d45e9") : secret "image-registry-tls" not found Sep 07 12:41:25.270164 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:25.270105 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:25.270468 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:25.270197 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:41:25.270468 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:25.270244 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls podName:94474ca3-efb2-4757-ac88-a1687b8d459c nodeName:}" failed. No retries permitted until 2026-09-07 12:41:33.270231319 +0000 UTC m=+50.139974689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls") pod "dns-default-q5khs" (UID: "94474ca3-efb2-4757-ac88-a1687b8d459c") : secret "dns-default-metrics-tls" not found Sep 07 12:41:27.668231 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:27.668204 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:27.763065 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:27.763036 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:27.861822 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:27.861796 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:28.723948 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:28.723906 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:28.823246 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:28.823215 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:32.344450 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:32.344414 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:32.442284 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:32.442239 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:33.219224 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:33.219187 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:33.219391 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:33.219293 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:41:33.219391 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:33.219306 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764bd57775-s4bs8: secret "image-registry-tls" not found Sep 07 12:41:33.219391 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:33.219364 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls podName:93347c79-cfca-4053-946a-1d356b5d45e9 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:49.219350587 +0000 UTC m=+66.089093952 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls") pod "image-registry-764bd57775-s4bs8" (UID: "93347c79-cfca-4053-946a-1d356b5d45e9") : secret "image-registry-tls" not found Sep 07 12:41:33.319858 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:33.319831 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:33.319985 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:33.319932 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:41:33.320027 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:33.320009 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls podName:94474ca3-efb2-4757-ac88-a1687b8d459c nodeName:}" failed. No retries permitted until 2026-09-07 12:41:49.319993522 +0000 UTC m=+66.189736888 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls") pod "dns-default-q5khs" (UID: "94474ca3-efb2-4757-ac88-a1687b8d459c") : secret "dns-default-metrics-tls" not found Sep 07 12:41:36.512404 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:36.512372 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:40.014810 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:40.014778 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:40.115750 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:40.115725 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:41.797113 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:41.797081 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:41.823863 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:41.823843 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bjzqr" Sep 07 12:41:41.859280 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:41.859229 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vwcsk" podStartSLOduration=22.211218945 podStartE2EDuration="24.859212859s" totalImagesPullingTime="2.647993914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:21.871929033 +0000 UTC m=+38.741672434" watchObservedRunningTime="2026-09-07 12:41:41.859212859 +0000 UTC m=+58.728956248" Sep 07 12:41:41.894513 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:41.894475 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:41.995005 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:41.994972 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:42.095070 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.095001 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:42.888995 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.888960 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st"] Sep 07 12:41:42.891739 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.891718 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-jn4hz"] Sep 07 12:41:42.891869 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.891848 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:41:42.893587 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.893554 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:42.894028 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.894011 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 07 12:41:42.895186 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.895160 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 07 12:41:42.895186 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.895181 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 07 12:41:42.895336 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.895213 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5f5nl\"" Sep 07 12:41:42.895446 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.895434 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 07 12:41:42.896297 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.896282 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 07 12:41:42.896352 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.896292 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bmx82\"" Sep 07 12:41:42.896431 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.896339 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 07 12:41:42.896630 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.896615 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 07 12:41:42.896757 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.896744 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 07 12:41:42.907996 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.907980 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 07 12:41:42.912668 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.912650 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st"] Sep 07 12:41:42.913229 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.913213 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-jn4hz"] Sep 07 12:41:42.977446 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.977420 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr"] Sep 07 12:41:42.979502 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.979487 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" Sep 07 12:41:42.981926 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.981907 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jtzk8\"" Sep 07 12:41:42.982020 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.981933 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 07 12:41:42.982020 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.981996 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 07 12:41:42.982135 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.982047 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:41:42.992309 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.992290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swf9f\" (UniqueName: \"kubernetes.io/projected/070684d2-bd22-4f70-93a2-9dff87ad479d-kube-api-access-swf9f\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:42.992397 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.992327 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6g9st\" (UID: \"810685be-a0c1-4a32-8f4c-d28e0ddd149d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:41:42.992397 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.992344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v2ns\" (UniqueName: \"kubernetes.io/projected/810685be-a0c1-4a32-8f4c-d28e0ddd149d-kube-api-access-2v2ns\") pod \"cluster-monitoring-operator-6cdcc96965-6g9st\" (UID: \"810685be-a0c1-4a32-8f4c-d28e0ddd149d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:41:42.992397 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.992366 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/070684d2-bd22-4f70-93a2-9dff87ad479d-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:42.992397 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.992389 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/070684d2-bd22-4f70-93a2-9dff87ad479d-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:42.992586 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.992466 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/810685be-a0c1-4a32-8f4c-d28e0ddd149d-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-6g9st\" (UID: \"810685be-a0c1-4a32-8f4c-d28e0ddd149d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:41:42.992586 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.992534 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/070684d2-bd22-4f70-93a2-9dff87ad479d-tmp\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:42.992586 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.992548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/070684d2-bd22-4f70-93a2-9dff87ad479d-serving-cert\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:42.992586 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.992564 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/070684d2-bd22-4f70-93a2-9dff87ad479d-snapshots\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:42.998053 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:42.998033 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr"] Sep 07 12:41:43.032184 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.032162 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:43.093728 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.093707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/070684d2-bd22-4f70-93a2-9dff87ad479d-tmp\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:43.093800 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.093733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/070684d2-bd22-4f70-93a2-9dff87ad479d-serving-cert\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:43.093800 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.093758 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-dckhr\" (UID: \"3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" Sep 07 12:41:43.093800 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.093785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/070684d2-bd22-4f70-93a2-9dff87ad479d-snapshots\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:43.093916 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.093821 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swf9f\" (UniqueName: \"kubernetes.io/projected/070684d2-bd22-4f70-93a2-9dff87ad479d-kube-api-access-swf9f\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:43.093916 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.093858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6g9st\" (UID: \"810685be-a0c1-4a32-8f4c-d28e0ddd149d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:41:43.093916 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.093880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v2ns\" (UniqueName: \"kubernetes.io/projected/810685be-a0c1-4a32-8f4c-d28e0ddd149d-kube-api-access-2v2ns\") pod \"cluster-monitoring-operator-6cdcc96965-6g9st\" (UID: \"810685be-a0c1-4a32-8f4c-d28e0ddd149d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:41:43.093916 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.093905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/070684d2-bd22-4f70-93a2-9dff87ad479d-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:43.094165 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:43.093978 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:41:43.094165 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:43.094053 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls podName:810685be-a0c1-4a32-8f4c-d28e0ddd149d nodeName:}" failed. No retries permitted until 2026-09-07 12:41:43.594032823 +0000 UTC m=+60.463776202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-6g9st" (UID: "810685be-a0c1-4a32-8f4c-d28e0ddd149d") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:41:43.094165 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.094107 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/070684d2-bd22-4f70-93a2-9dff87ad479d-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:43.094165 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.094138 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/070684d2-bd22-4f70-93a2-9dff87ad479d-tmp\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:43.094364 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.094152 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6bdj\" (UniqueName: \"kubernetes.io/projected/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-kube-api-access-b6bdj\") pod \"cluster-samples-operator-7cdcfcf76c-dckhr\" (UID: \"3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" Sep 07 12:41:43.094364 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.094228 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/810685be-a0c1-4a32-8f4c-d28e0ddd149d-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-6g9st\" (UID: \"810685be-a0c1-4a32-8f4c-d28e0ddd149d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:41:43.094461 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.094381 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/070684d2-bd22-4f70-93a2-9dff87ad479d-snapshots\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:43.094722 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.094702 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/070684d2-bd22-4f70-93a2-9dff87ad479d-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:43.094801 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.094787 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/070684d2-bd22-4f70-93a2-9dff87ad479d-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:43.094842 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.094817 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/810685be-a0c1-4a32-8f4c-d28e0ddd149d-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-6g9st\" (UID: \"810685be-a0c1-4a32-8f4c-d28e0ddd149d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:41:43.097175 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.097161 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/070684d2-bd22-4f70-93a2-9dff87ad479d-serving-cert\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:43.104781 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.104762 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v2ns\" (UniqueName: \"kubernetes.io/projected/810685be-a0c1-4a32-8f4c-d28e0ddd149d-kube-api-access-2v2ns\") pod \"cluster-monitoring-operator-6cdcc96965-6g9st\" (UID: \"810685be-a0c1-4a32-8f4c-d28e0ddd149d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:41:43.104781 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.104779 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swf9f\" (UniqueName: \"kubernetes.io/projected/070684d2-bd22-4f70-93a2-9dff87ad479d-kube-api-access-swf9f\") pod \"insights-operator-76bcd6ccf5-jn4hz\" (UID: \"070684d2-bd22-4f70-93a2-9dff87ad479d\") " pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:43.132947 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.132922 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:43.195024 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.194987 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-dckhr\" (UID: \"3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" Sep 07 12:41:43.195207 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.195073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6bdj\" (UniqueName: \"kubernetes.io/projected/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-kube-api-access-b6bdj\") pod \"cluster-samples-operator-7cdcfcf76c-dckhr\" (UID: \"3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" Sep 07 12:41:43.195207 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:43.195114 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 12:41:43.195207 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:43.195176 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls podName:3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:43.695161956 +0000 UTC m=+60.564905325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-dckhr" (UID: "3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8") : secret "samples-operator-tls" not found Sep 07 12:41:43.207447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.207425 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" Sep 07 12:41:43.209646 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.209626 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6bdj\" (UniqueName: \"kubernetes.io/projected/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-kube-api-access-b6bdj\") pod \"cluster-samples-operator-7cdcfcf76c-dckhr\" (UID: \"3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" Sep 07 12:41:43.471588 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.471495 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-jn4hz"] Sep 07 12:41:43.474780 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:41:43.474756 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070684d2_bd22_4f70_93a2_9dff87ad479d.slice/crio-9c8d0ed6ffb16939e186df282abd9718fab7ba6793bd062c77aea85fd1523115 WatchSource:0}: Error finding container 9c8d0ed6ffb16939e186df282abd9718fab7ba6793bd062c77aea85fd1523115: Status 404 returned error can't find the container with id 9c8d0ed6ffb16939e186df282abd9718fab7ba6793bd062c77aea85fd1523115 Sep 07 12:41:43.603333 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.603292 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6g9st\" (UID: \"810685be-a0c1-4a32-8f4c-d28e0ddd149d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:41:43.603473 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:43.603400 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:41:43.603473 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:43.603444 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls podName:810685be-a0c1-4a32-8f4c-d28e0ddd149d nodeName:}" failed. No retries permitted until 2026-09-07 12:41:44.60343105 +0000 UTC m=+61.473174416 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-6g9st" (UID: "810685be-a0c1-4a32-8f4c-d28e0ddd149d") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:41:43.703580 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.703546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-dckhr\" (UID: \"3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" Sep 07 12:41:43.703702 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:43.703673 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 12:41:43.703742 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:43.703725 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls podName:3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:44.70371001 +0000 UTC m=+61.573453377 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-dckhr" (UID: "3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8") : secret "samples-operator-tls" not found Sep 07 12:41:43.910323 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:43.910290 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" event={"ID":"070684d2-bd22-4f70-93a2-9dff87ad479d","Type":"ContainerStarted","Data":"9c8d0ed6ffb16939e186df282abd9718fab7ba6793bd062c77aea85fd1523115"} Sep 07 12:41:44.610707 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:44.610666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6g9st\" (UID: \"810685be-a0c1-4a32-8f4c-d28e0ddd149d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:41:44.610868 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:44.610844 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:41:44.610957 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:44.610944 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls podName:810685be-a0c1-4a32-8f4c-d28e0ddd149d nodeName:}" failed. No retries permitted until 2026-09-07 12:41:46.610906959 +0000 UTC m=+63.480650326 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-6g9st" (UID: "810685be-a0c1-4a32-8f4c-d28e0ddd149d") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:41:44.711704 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:44.711671 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-dckhr\" (UID: \"3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" Sep 07 12:41:44.711875 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:44.711815 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 12:41:44.711875 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:44.711874 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls podName:3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:46.711855645 +0000 UTC m=+63.581599013 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-dckhr" (UID: "3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8") : secret "samples-operator-tls" not found Sep 07 12:41:45.069651 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:45.069606 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:45.170532 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:45.170493 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:45.270862 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:45.270832 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:45.371970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:45.371888 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:45.916090 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:45.916060 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" event={"ID":"070684d2-bd22-4f70-93a2-9dff87ad479d","Type":"ContainerStarted","Data":"5efe8b2aff7ff39d650c208bf525e39107302577a804337d9a88ef5a0cf04b74"} Sep 07 12:41:45.934505 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:45.934481 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:46.032438 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:46.032415 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:46.199454 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:46.199374 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:46.600640 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:46.600540 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:46.625751 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:46.625723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6g9st\" (UID: \"810685be-a0c1-4a32-8f4c-d28e0ddd149d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:41:46.625854 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:46.625841 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:41:46.625903 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:46.625895 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls podName:810685be-a0c1-4a32-8f4c-d28e0ddd149d nodeName:}" failed. No retries permitted until 2026-09-07 12:41:50.625881419 +0000 UTC m=+67.495624785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-6g9st" (UID: "810685be-a0c1-4a32-8f4c-d28e0ddd149d") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:41:46.692289 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:46.692245 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:46.726451 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:46.726417 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-dckhr\" (UID: \"3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" Sep 07 12:41:46.726624 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:46.726555 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 12:41:46.726684 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:46.726629 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls podName:3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:50.72661283 +0000 UTC m=+67.596356199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-dckhr" (UID: "3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8") : secret "samples-operator-tls" not found Sep 07 12:41:46.959566 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:46.959502 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" podStartSLOduration=2.847276954 podStartE2EDuration="4.959484253s" totalImagesPullingTime="2.112207299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:41:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:45.932564578 +0000 UTC m=+62.802307966" watchObservedRunningTime="2026-09-07 12:41:46.959484253 +0000 UTC m=+63.829227637" Sep 07 12:41:46.960711 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:46.960676 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ttdqj"] Sep 07 12:41:46.962631 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:46.962616 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:46.965226 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:46.965199 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 07 12:41:46.965316 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:46.965233 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 07 12:41:46.965316 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:46.965237 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vqxnm\"" Sep 07 12:41:46.971909 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:46.971881 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ttdqj"] Sep 07 12:41:46.977388 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:46.977365 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:47.029003 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.028975 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b14549b7-cb78-444b-a944-d9d90a1e8eed-crio-socket\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:47.029102 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.029022 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b14549b7-cb78-444b-a944-d9d90a1e8eed-data-volume\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:47.029102 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.029059 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:47.029102 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.029100 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4rn4\" (UniqueName: \"kubernetes.io/projected/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-api-access-c4rn4\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:47.029281 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.029259 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:47.051544 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.051524 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:47.130010 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.129983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b14549b7-cb78-444b-a944-d9d90a1e8eed-crio-socket\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:47.130115 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.130040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b14549b7-cb78-444b-a944-d9d90a1e8eed-data-volume\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:47.130115 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.130063 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b14549b7-cb78-444b-a944-d9d90a1e8eed-crio-socket\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:47.130115 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.130106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:47.130255 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.130148 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4rn4\" (UniqueName: \"kubernetes.io/projected/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-api-access-c4rn4\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:47.130255 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:47.130187 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:41:47.130255 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.130200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:47.130366 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:47.130268 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm podName:b14549b7-cb78-444b-a944-d9d90a1e8eed nodeName:}" failed. No retries permitted until 2026-09-07 12:41:47.630248317 +0000 UTC m=+64.499991706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ttdqj" (UID: "b14549b7-cb78-444b-a944-d9d90a1e8eed") : configmap "kube-rbac-proxy" not found Sep 07 12:41:47.130366 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:47.130307 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:41:47.130430 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:47.130370 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls podName:b14549b7-cb78-444b-a944-d9d90a1e8eed nodeName:}" failed. No retries permitted until 2026-09-07 12:41:47.630355889 +0000 UTC m=+64.500099269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ttdqj" (UID: "b14549b7-cb78-444b-a944-d9d90a1e8eed") : secret "insights-runtime-extractor-tls" not found Sep 07 12:41:47.130430 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.130367 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b14549b7-cb78-444b-a944-d9d90a1e8eed-data-volume\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:47.138484 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.138463 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4rn4\" (UniqueName: \"kubernetes.io/projected/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-api-access-c4rn4\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:47.335527 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.335444 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:47.433789 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.433754 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:47.633001 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.632919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:47.633001 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:47.632994 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:47.633174 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:47.633053 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:41:47.633174 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:47.633143 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:41:47.633237 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:47.633151 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm podName:b14549b7-cb78-444b-a944-d9d90a1e8eed nodeName:}" failed. No retries permitted until 2026-09-07 12:41:48.633132462 +0000 UTC m=+65.502875847 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ttdqj" (UID: "b14549b7-cb78-444b-a944-d9d90a1e8eed") : configmap "kube-rbac-proxy" not found Sep 07 12:41:47.633237 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:47.633202 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls podName:b14549b7-cb78-444b-a944-d9d90a1e8eed nodeName:}" failed. No retries permitted until 2026-09-07 12:41:48.633189124 +0000 UTC m=+65.502932490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ttdqj" (UID: "b14549b7-cb78-444b-a944-d9d90a1e8eed") : secret "insights-runtime-extractor-tls" not found Sep 07 12:41:48.085565 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.085533 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:48.312744 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.312711 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:48.339107 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.339040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs\") pod \"network-metrics-daemon-9mbh5\" (UID: \"bce0dedd-2b68-4c5d-8504-150a18723edd\") " pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:41:48.341061 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.341042 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 12:41:48.349796 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:48.349776 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 12:41:48.349896 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:48.349851 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs podName:bce0dedd-2b68-4c5d-8504-150a18723edd nodeName:}" failed. No retries permitted until 2026-09-07 12:42:52.349831 +0000 UTC m=+129.219574380 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs") pod "network-metrics-daemon-9mbh5" (UID: "bce0dedd-2b68-4c5d-8504-150a18723edd") : secret "metrics-daemon-secret" not found Sep 07 12:41:48.430738 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.430711 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-j9mft"] Sep 07 12:41:48.432681 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.432667 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-j9mft" Sep 07 12:41:48.435356 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.435336 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 07 12:41:48.435689 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.435674 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4twxz\"" Sep 07 12:41:48.435743 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.435715 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 07 12:41:48.440476 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.440455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret\") pod \"global-pull-secret-syncer-pfgjt\" (UID: \"3fce5c0f-7c8a-4f83-be38-940c689527e8\") " pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:41:48.442731 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.442712 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 12:41:48.443650 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.443632 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-j9mft"] Sep 07 12:41:48.453149 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.453127 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3fce5c0f-7c8a-4f83-be38-940c689527e8-original-pull-secret\") pod \"global-pull-secret-syncer-pfgjt\" (UID: \"3fce5c0f-7c8a-4f83-be38-940c689527e8\") " pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:41:48.466797 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.466774 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:48.540831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.540806 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn4wm\" (UniqueName: \"kubernetes.io/projected/d7213d2f-5a49-45c7-b695-c9219bff3ae9-kube-api-access-bn4wm\") pod \"migrator-fdbb8fdff-j9mft\" (UID: \"d7213d2f-5a49-45c7-b695-c9219bff3ae9\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-j9mft" Sep 07 12:41:48.540924 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.540836 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5s9\" (UniqueName: \"kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9\") pod \"network-check-target-tsptp\" (UID: \"7365e1ad-5b47-499b-ad6e-3748efd38d65\") " pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:48.542935 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.542920 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 12:41:48.553538 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.553523 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 12:41:48.564554 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.564530 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w5s9\" (UniqueName: \"kubernetes.io/projected/7365e1ad-5b47-499b-ad6e-3748efd38d65-kube-api-access-4w5s9\") pod \"network-check-target-tsptp\" (UID: \"7365e1ad-5b47-499b-ad6e-3748efd38d65\") " pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:48.565246 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.565227 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:48.641317 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.641298 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:48.641400 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.641385 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:48.641449 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.641422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn4wm\" (UniqueName: \"kubernetes.io/projected/d7213d2f-5a49-45c7-b695-c9219bff3ae9-kube-api-access-bn4wm\") pod \"migrator-fdbb8fdff-j9mft\" (UID: \"d7213d2f-5a49-45c7-b695-c9219bff3ae9\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-j9mft" Sep 07 12:41:48.641449 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:48.641444 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:41:48.641529 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:48.641492 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:41:48.641529 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:48.641502 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls podName:b14549b7-cb78-444b-a944-d9d90a1e8eed nodeName:}" failed. No retries permitted until 2026-09-07 12:41:50.641485501 +0000 UTC m=+67.511228884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ttdqj" (UID: "b14549b7-cb78-444b-a944-d9d90a1e8eed") : secret "insights-runtime-extractor-tls" not found Sep 07 12:41:48.641640 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:48.641535 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm podName:b14549b7-cb78-444b-a944-d9d90a1e8eed nodeName:}" failed. No retries permitted until 2026-09-07 12:41:50.641521609 +0000 UTC m=+67.511264974 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ttdqj" (UID: "b14549b7-cb78-444b-a944-d9d90a1e8eed") : configmap "kube-rbac-proxy" not found Sep 07 12:41:48.649668 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.649648 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn4wm\" (UniqueName: \"kubernetes.io/projected/d7213d2f-5a49-45c7-b695-c9219bff3ae9-kube-api-access-bn4wm\") pod \"migrator-fdbb8fdff-j9mft\" (UID: \"d7213d2f-5a49-45c7-b695-c9219bff3ae9\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-j9mft" Sep 07 12:41:48.670735 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.670718 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-49m4z\"" Sep 07 12:41:48.673418 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.673403 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pfgjt" Sep 07 12:41:48.679304 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.679290 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:48.741747 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.741493 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-j9mft" Sep 07 12:41:48.794731 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.794699 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:48.898536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.898479 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:48.943007 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.942985 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pfgjt"] Sep 07 12:41:48.946316 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:41:48.946292 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fce5c0f_7c8a_4f83_be38_940c689527e8.slice/crio-7448998c123190ca9e06a8d43382f8b0382f4e4e67035550ad621db4cc27462e WatchSource:0}: Error finding container 7448998c123190ca9e06a8d43382f8b0382f4e4e67035550ad621db4cc27462e: Status 404 returned error can't find the container with id 7448998c123190ca9e06a8d43382f8b0382f4e4e67035550ad621db4cc27462e Sep 07 12:41:48.946413 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:48.946356 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tsptp"] Sep 07 12:41:48.950042 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:41:48.950017 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7365e1ad_5b47_499b_ad6e_3748efd38d65.slice/crio-d67934adc76cff0a26c6f7ba3db396563ca1ca1228ef4202fd0baf1e75bea4a0 WatchSource:0}: Error finding container d67934adc76cff0a26c6f7ba3db396563ca1ca1228ef4202fd0baf1e75bea4a0: Status 404 returned error can't find the container with id d67934adc76cff0a26c6f7ba3db396563ca1ca1228ef4202fd0baf1e75bea4a0 Sep 07 12:41:49.005077 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:49.005049 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-j9mft"] Sep 07 12:41:49.010173 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:41:49.010151 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7213d2f_5a49_45c7_b695_c9219bff3ae9.slice/crio-5dcf48f00cb6d1c07755173dcc8421b9c8ea6c1d3368d0da4e60e04bdbc1fee0 WatchSource:0}: Error finding container 5dcf48f00cb6d1c07755173dcc8421b9c8ea6c1d3368d0da4e60e04bdbc1fee0: Status 404 returned error can't find the container with id 5dcf48f00cb6d1c07755173dcc8421b9c8ea6c1d3368d0da4e60e04bdbc1fee0 Sep 07 12:41:49.120644 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:49.120619 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mjfzt_0c201161-d05a-452a-806a-be74c902a26a/dns-node-resolver/0.log" Sep 07 12:41:49.244375 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:49.244308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:41:49.244474 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:49.244457 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:41:49.244514 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:49.244473 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764bd57775-s4bs8: secret "image-registry-tls" not found Sep 07 12:41:49.244546 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:49.244527 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls podName:93347c79-cfca-4053-946a-1d356b5d45e9 nodeName:}" failed. No retries permitted until 2026-09-07 12:42:21.244512007 +0000 UTC m=+98.114255373 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls") pod "image-registry-764bd57775-s4bs8" (UID: "93347c79-cfca-4053-946a-1d356b5d45e9") : secret "image-registry-tls" not found Sep 07 12:41:49.345567 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:49.345536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:41:49.345933 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:49.345671 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:41:49.345933 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:49.345736 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls podName:94474ca3-efb2-4757-ac88-a1687b8d459c nodeName:}" failed. No retries permitted until 2026-09-07 12:42:21.345722392 +0000 UTC m=+98.215465757 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls") pod "dns-default-q5khs" (UID: "94474ca3-efb2-4757-ac88-a1687b8d459c") : secret "dns-default-metrics-tls" not found Sep 07 12:41:49.928025 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:49.927936 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pfgjt" event={"ID":"3fce5c0f-7c8a-4f83-be38-940c689527e8","Type":"ContainerStarted","Data":"7448998c123190ca9e06a8d43382f8b0382f4e4e67035550ad621db4cc27462e"} Sep 07 12:41:49.929393 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:49.929366 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tsptp" event={"ID":"7365e1ad-5b47-499b-ad6e-3748efd38d65","Type":"ContainerStarted","Data":"d67934adc76cff0a26c6f7ba3db396563ca1ca1228ef4202fd0baf1e75bea4a0"} Sep 07 12:41:49.931125 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:49.931104 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-j9mft" event={"ID":"d7213d2f-5a49-45c7-b695-c9219bff3ae9","Type":"ContainerStarted","Data":"5dcf48f00cb6d1c07755173dcc8421b9c8ea6c1d3368d0da4e60e04bdbc1fee0"} Sep 07 12:41:50.121107 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:50.121078 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vppzn_dedaea8c-e647-441e-a4ae-2e728bf38f3b/node-ca/0.log" Sep 07 12:41:50.498547 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:50.498475 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:50.598829 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:50.598795 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:50.657300 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:50.657270 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:50.657467 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:50.657364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:50.657467 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:50.657399 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:41:50.657467 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:50.657410 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6g9st\" (UID: \"810685be-a0c1-4a32-8f4c-d28e0ddd149d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:41:50.657648 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:50.657469 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm podName:b14549b7-cb78-444b-a944-d9d90a1e8eed nodeName:}" failed. No retries permitted until 2026-09-07 12:41:54.657450775 +0000 UTC m=+71.527194158 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ttdqj" (UID: "b14549b7-cb78-444b-a944-d9d90a1e8eed") : configmap "kube-rbac-proxy" not found Sep 07 12:41:50.657648 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:50.657529 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:41:50.657648 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:50.657531 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:41:50.657648 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:50.657601 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls podName:810685be-a0c1-4a32-8f4c-d28e0ddd149d nodeName:}" failed. No retries permitted until 2026-09-07 12:41:58.657564296 +0000 UTC m=+75.527307678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-6g9st" (UID: "810685be-a0c1-4a32-8f4c-d28e0ddd149d") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:41:50.657648 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:50.657620 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls podName:b14549b7-cb78-444b-a944-d9d90a1e8eed nodeName:}" failed. No retries permitted until 2026-09-07 12:41:54.657609354 +0000 UTC m=+71.527352719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ttdqj" (UID: "b14549b7-cb78-444b-a944-d9d90a1e8eed") : secret "insights-runtime-extractor-tls" not found Sep 07 12:41:50.757955 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:50.757802 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-dckhr\" (UID: \"3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" Sep 07 12:41:50.758096 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:50.757955 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 12:41:50.758096 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:50.758032 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls podName:3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8 nodeName:}" failed. No retries permitted until 2026-09-07 12:41:58.758010471 +0000 UTC m=+75.627753849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-dckhr" (UID: "3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8") : secret "samples-operator-tls" not found Sep 07 12:41:50.920907 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:50.920882 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vwcsk_19e142d3-1db3-4755-aef6-26dcad6265b4/serve-healthcheck-canary/0.log" Sep 07 12:41:50.937070 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:50.936623 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-j9mft" event={"ID":"d7213d2f-5a49-45c7-b695-c9219bff3ae9","Type":"ContainerStarted","Data":"893d22265a72d1d2f61018e4c59b9ff95408d2f80080ea2b8e0c0c6e0d5c651c"} Sep 07 12:41:50.937070 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:50.936684 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-j9mft" event={"ID":"d7213d2f-5a49-45c7-b695-c9219bff3ae9","Type":"ContainerStarted","Data":"6e9c8161f925333d3c894d29373c9071d9a9b805a81adb73de7fe7cfbb3bfb47"} Sep 07 12:41:50.951261 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:50.951182 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-j9mft" podStartSLOduration=1.828377402 podStartE2EDuration="2.951165759s" totalImagesPullingTime="1.122788357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:50.950142481 +0000 UTC m=+67.819885868" watchObservedRunningTime="2026-09-07 12:41:50.951165759 +0000 UTC m=+67.820909149" Sep 07 12:41:51.024632 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:51.024539 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:51.109875 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:51.109838 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:51.614274 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:51.614243 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:53.945887 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:53.945851 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pfgjt" event={"ID":"3fce5c0f-7c8a-4f83-be38-940c689527e8","Type":"ContainerStarted","Data":"d28b430c23a0afaaf27289459c08a8c428d563973dc40a04913d2a24d4d553ec"} Sep 07 12:41:53.947489 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:53.947465 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tsptp" event={"ID":"7365e1ad-5b47-499b-ad6e-3748efd38d65","Type":"ContainerStarted","Data":"9c6ab7915ba335a9182dd5d7bc6b4515a0abdddf5f0d877615a63dd679a733d4"} Sep 07 12:41:53.947613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:53.947529 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:41:53.960007 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:53.959934 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pfgjt" podStartSLOduration=65.205273849 podStartE2EDuration="1m9.9599215s" totalImagesPullingTime="4.754647651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:53.959142139 +0000 UTC m=+70.828885526" watchObservedRunningTime="2026-09-07 12:41:53.9599215 +0000 UTC m=+70.829664888" Sep 07 12:41:53.975376 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:53.975341 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tsptp" podStartSLOduration=66.226077002 podStartE2EDuration="1m10.975330402s" totalImagesPullingTime="4.7492534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:53.974700832 +0000 UTC m=+70.844444219" watchObservedRunningTime="2026-09-07 12:41:53.975330402 +0000 UTC m=+70.845073789" Sep 07 12:41:54.304834 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:54.304760 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:54.693048 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:54.693020 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:54.693204 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:54.693073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:41:54.693204 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:54.693148 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:41:54.693204 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:54.693162 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:41:54.693305 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:54.693212 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm podName:b14549b7-cb78-444b-a944-d9d90a1e8eed nodeName:}" failed. No retries permitted until 2026-09-07 12:42:02.69319608 +0000 UTC m=+79.562939450 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ttdqj" (UID: "b14549b7-cb78-444b-a944-d9d90a1e8eed") : configmap "kube-rbac-proxy" not found Sep 07 12:41:54.693305 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:54.693227 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls podName:b14549b7-cb78-444b-a944-d9d90a1e8eed nodeName:}" failed. No retries permitted until 2026-09-07 12:42:02.693221322 +0000 UTC m=+79.562964687 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ttdqj" (UID: "b14549b7-cb78-444b-a944-d9d90a1e8eed") : secret "insights-runtime-extractor-tls" not found Sep 07 12:41:55.344635 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:55.344603 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:55.461545 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:55.461516 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:55.594150 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:55.594124 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:55.695289 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:55.695268 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:55.827949 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:55.827922 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:56.028505 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:56.028441 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:56.819196 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:56.819165 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:57.219157 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:57.219121 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:57.626528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:57.626451 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:58.021067 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:58.021038 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:58.299549 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:58.299479 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:58.427487 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:58.427455 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:58.624599 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:58.624507 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:58.723133 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:58.723104 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6g9st\" (UID: \"810685be-a0c1-4a32-8f4c-d28e0ddd149d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:41:58.723287 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:58.723256 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:41:58.723359 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:41:58.723338 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls podName:810685be-a0c1-4a32-8f4c-d28e0ddd149d nodeName:}" failed. No retries permitted until 2026-09-07 12:42:14.723317046 +0000 UTC m=+91.593060434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-6g9st" (UID: "810685be-a0c1-4a32-8f4c-d28e0ddd149d") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:41:58.823854 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:58.823824 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-dckhr\" (UID: \"3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" Sep 07 12:41:58.826356 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:58.826333 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-dckhr\" (UID: \"3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" Sep 07 12:41:58.889698 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:58.889635 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jtzk8\"" Sep 07 12:41:58.897696 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:58.897675 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" Sep 07 12:41:59.040811 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:59.040781 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:59.141859 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:59.141827 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:59.160855 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:59.160822 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr"] Sep 07 12:41:59.242752 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:59.242731 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:59.818423 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:59.818389 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:41:59.968102 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:41:59.968059 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" event={"ID":"3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8","Type":"ContainerStarted","Data":"dcf513c3b24ce2901e46c3e69f1b8d6fb2c8c9168dd3870e56e110e995c53785"} Sep 07 12:42:00.030750 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:00.030719 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:00.089821 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:00.089745 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:00.170900 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:00.170865 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:00.418036 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:00.417987 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:00.653551 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:00.653530 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:00.972920 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:00.972841 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" event={"ID":"3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8","Type":"ContainerStarted","Data":"f4631d9eab46c121c00305b7f479448a689602cf9807db0a0442722379ade8be"} Sep 07 12:42:00.972920 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:00.972895 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" event={"ID":"3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8","Type":"ContainerStarted","Data":"169d2099aa85eb60f7605e47d27146df9af8790ad00bb6f08337aa6959c30b25"} Sep 07 12:42:00.988695 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:00.988654 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dckhr" podStartSLOduration=17.556729739 podStartE2EDuration="18.988641101s" totalImagesPullingTime="1.431911362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:41:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:00.988494006 +0000 UTC m=+77.858237394" watchObservedRunningTime="2026-09-07 12:42:00.988641101 +0000 UTC m=+77.858384487" Sep 07 12:42:01.033613 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:01.033585 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:01.612174 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:01.612144 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:01.828188 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:01.828155 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:02.023405 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:02.023373 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:02.338040 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:02.337960 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:02.437255 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:02.437207 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:02.502368 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:02.502336 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:02.629807 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:02.629724 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:02.763024 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:02.759937 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:42:02.763024 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:02.760116 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:42:02.763024 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:42:02.760625 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:42:02.763024 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:42:02.760714 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls podName:b14549b7-cb78-444b-a944-d9d90a1e8eed nodeName:}" failed. No retries permitted until 2026-09-07 12:42:18.76068837 +0000 UTC m=+95.630431755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ttdqj" (UID: "b14549b7-cb78-444b-a944-d9d90a1e8eed") : secret "insights-runtime-extractor-tls" not found Sep 07 12:42:02.763024 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:02.760883 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b14549b7-cb78-444b-a944-d9d90a1e8eed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:42:03.022035 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:03.022001 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:03.617232 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:03.617201 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:04.023910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:04.023879 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:04.413663 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:04.413628 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:04.617279 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:04.617187 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:05.216398 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:05.216369 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:05.621611 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:05.621516 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:05.819055 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:05.819019 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:06.056831 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:06.056797 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:07.789335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:07.789302 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:07.890016 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:07.889984 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:07.965419 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:07.965391 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:08.099895 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:08.099810 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:08.830286 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:08.830251 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:08.931086 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:08.931052 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:09.073089 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:09.073060 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:09.139447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:09.139374 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:09.475860 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:09.475827 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:09.675179 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:09.675136 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:09.774913 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:09.774839 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:10.557970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:10.557938 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:10.654742 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:10.654706 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:13.243708 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:13.243673 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:13.328636 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:13.328591 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:14.746293 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:14.746245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6g9st\" (UID: \"810685be-a0c1-4a32-8f4c-d28e0ddd149d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:42:14.748779 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:14.748753 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/810685be-a0c1-4a32-8f4c-d28e0ddd149d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6g9st\" (UID: \"810685be-a0c1-4a32-8f4c-d28e0ddd149d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:42:14.873595 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:14.873544 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:14.940390 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:14.940354 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:15.004464 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:15.004382 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5f5nl\"" Sep 07 12:42:15.012760 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:15.012740 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" Sep 07 12:42:15.281927 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:15.281851 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st"] Sep 07 12:42:15.284608 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:42:15.284554 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod810685be_a0c1_4a32_8f4c_d28e0ddd149d.slice/crio-731a9123d13d58d0052bb6057a4fa061eb7ebe570f9a648521e9f116710acba6 WatchSource:0}: Error finding container 731a9123d13d58d0052bb6057a4fa061eb7ebe570f9a648521e9f116710acba6: Status 404 returned error can't find the container with id 731a9123d13d58d0052bb6057a4fa061eb7ebe570f9a648521e9f116710acba6 Sep 07 12:42:16.017835 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:16.017800 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" event={"ID":"810685be-a0c1-4a32-8f4c-d28e0ddd149d","Type":"ContainerStarted","Data":"731a9123d13d58d0052bb6057a4fa061eb7ebe570f9a648521e9f116710acba6"} Sep 07 12:42:17.022032 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.021999 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" event={"ID":"810685be-a0c1-4a32-8f4c-d28e0ddd149d","Type":"ContainerStarted","Data":"f79877589c5c9b44164aa4852737705854fef09d5dfe1803743edecf5d1c5f83"} Sep 07 12:42:17.038952 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.038906 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6g9st" podStartSLOduration=33.480980133 podStartE2EDuration="35.038891832s" totalImagesPullingTime="1.557911699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:41:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:17.038543528 +0000 UTC m=+93.908286927" watchObservedRunningTime="2026-09-07 12:42:17.038891832 +0000 UTC m=+93.908635218" Sep 07 12:42:17.130903 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.130830 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9848d959f-smqv6"] Sep 07 12:42:17.133827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.133806 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.136343 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.136265 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 07 12:42:17.136343 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.136311 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r79rq\"" Sep 07 12:42:17.136525 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.136365 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 07 12:42:17.136525 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.136271 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 07 12:42:17.136674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.136525 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 07 12:42:17.136674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.136631 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 07 12:42:17.136747 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.136735 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 07 12:42:17.136942 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.136930 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 07 12:42:17.145352 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.145331 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9848d959f-smqv6"] Sep 07 12:42:17.167562 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.167526 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:17.264415 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.264388 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:17.268470 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.268446 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-oauth-serving-cert\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.268630 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.268477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp57p\" (UniqueName: \"kubernetes.io/projected/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-kube-api-access-hp57p\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.268630 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.268508 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-config\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.268630 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.268536 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-service-ca\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.268630 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.268591 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-serving-cert\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.268828 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.268637 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-oauth-config\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.369168 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.369139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp57p\" (UniqueName: \"kubernetes.io/projected/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-kube-api-access-hp57p\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.369319 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.369184 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-config\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.369420 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.369393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-service-ca\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.369473 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.369430 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-serving-cert\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.369473 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.369464 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-oauth-config\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.369587 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.369560 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-oauth-serving-cert\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.369980 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.369955 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-config\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.370083 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.370070 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-service-ca\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.370295 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.370178 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-oauth-serving-cert\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.371935 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.371909 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-oauth-config\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.372037 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.371999 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-serving-cert\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.377072 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.377046 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:17.380133 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.380111 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp57p\" (UniqueName: \"kubernetes.io/projected/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-kube-api-access-hp57p\") pod \"console-9848d959f-smqv6\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.412870 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.412844 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j5tfp"] Sep 07 12:42:17.416865 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.416850 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j5tfp" Sep 07 12:42:17.419470 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.419453 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gff8w\"" Sep 07 12:42:17.419718 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.419704 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 07 12:42:17.427321 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.427302 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j5tfp"] Sep 07 12:42:17.444691 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.444670 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:17.470124 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.470096 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cee705bc-786d-4d8b-9fe2-479bca2f2097-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-j5tfp\" (UID: \"cee705bc-786d-4d8b-9fe2-479bca2f2097\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j5tfp" Sep 07 12:42:17.570652 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.570624 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cee705bc-786d-4d8b-9fe2-479bca2f2097-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-j5tfp\" (UID: \"cee705bc-786d-4d8b-9fe2-479bca2f2097\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j5tfp" Sep 07 12:42:17.570824 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:42:17.570801 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 07 12:42:17.570899 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:42:17.570887 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cee705bc-786d-4d8b-9fe2-479bca2f2097-tls-certificates podName:cee705bc-786d-4d8b-9fe2-479bca2f2097 nodeName:}" failed. No retries permitted until 2026-09-07 12:42:18.070867 +0000 UTC m=+94.940610382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/cee705bc-786d-4d8b-9fe2-479bca2f2097-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-j5tfp" (UID: "cee705bc-786d-4d8b-9fe2-479bca2f2097") : secret "prometheus-operator-admission-webhook-tls" not found Sep 07 12:42:17.710490 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.710421 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:17.721030 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:17.721010 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9848d959f-smqv6"] Sep 07 12:42:17.723358 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:42:17.723337 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb21cdb4_dcfa_4f40_9fe0_1903d68fcedb.slice/crio-759fd03ff32ffa5292f55366c0ebf725328562418a01c2ad964c18b99a9de9b8 WatchSource:0}: Error finding container 759fd03ff32ffa5292f55366c0ebf725328562418a01c2ad964c18b99a9de9b8: Status 404 returned error can't find the container with id 759fd03ff32ffa5292f55366c0ebf725328562418a01c2ad964c18b99a9de9b8 Sep 07 12:42:18.026052 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:18.025975 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9848d959f-smqv6" event={"ID":"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb","Type":"ContainerStarted","Data":"759fd03ff32ffa5292f55366c0ebf725328562418a01c2ad964c18b99a9de9b8"} Sep 07 12:42:18.074822 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:18.074798 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cee705bc-786d-4d8b-9fe2-479bca2f2097-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-j5tfp\" (UID: \"cee705bc-786d-4d8b-9fe2-479bca2f2097\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j5tfp" Sep 07 12:42:18.077288 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:18.077268 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cee705bc-786d-4d8b-9fe2-479bca2f2097-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-j5tfp\" (UID: \"cee705bc-786d-4d8b-9fe2-479bca2f2097\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j5tfp" Sep 07 12:42:18.325390 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:18.325312 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j5tfp" Sep 07 12:42:18.589951 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:18.589883 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j5tfp"] Sep 07 12:42:18.593491 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:42:18.593465 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcee705bc_786d_4d8b_9fe2_479bca2f2097.slice/crio-8077b802086bb29f8e2812d14213dd0c6299e2a040eed5f500da57f47aa17ffc WatchSource:0}: Error finding container 8077b802086bb29f8e2812d14213dd0c6299e2a040eed5f500da57f47aa17ffc: Status 404 returned error can't find the container with id 8077b802086bb29f8e2812d14213dd0c6299e2a040eed5f500da57f47aa17ffc Sep 07 12:42:18.781480 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:18.781445 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:42:18.783816 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:18.783797 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b14549b7-cb78-444b-a944-d9d90a1e8eed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttdqj\" (UID: \"b14549b7-cb78-444b-a944-d9d90a1e8eed\") " pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:42:19.030585 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:19.030545 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j5tfp" event={"ID":"cee705bc-786d-4d8b-9fe2-479bca2f2097","Type":"ContainerStarted","Data":"8077b802086bb29f8e2812d14213dd0c6299e2a040eed5f500da57f47aa17ffc"} Sep 07 12:42:19.071852 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:19.071821 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ttdqj" Sep 07 12:42:19.347035 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:19.346891 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ttdqj"] Sep 07 12:42:19.350924 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:42:19.350896 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14549b7_cb78_444b_a944_d9d90a1e8eed.slice/crio-f0b70281293755ce262a42572401c9a23684c784aae6c442aafc97b1ad41d82b WatchSource:0}: Error finding container f0b70281293755ce262a42572401c9a23684c784aae6c442aafc97b1ad41d82b: Status 404 returned error can't find the container with id f0b70281293755ce262a42572401c9a23684c784aae6c442aafc97b1ad41d82b Sep 07 12:42:20.037459 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:20.036931 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttdqj" event={"ID":"b14549b7-cb78-444b-a944-d9d90a1e8eed","Type":"ContainerStarted","Data":"54bd7b34cfab1ecf4ec67dc75771c8ad5deb209203bf2c56554df3312b9b3d1d"} Sep 07 12:42:20.037459 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:20.036996 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttdqj" event={"ID":"b14549b7-cb78-444b-a944-d9d90a1e8eed","Type":"ContainerStarted","Data":"f0b70281293755ce262a42572401c9a23684c784aae6c442aafc97b1ad41d82b"} Sep 07 12:42:20.038782 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:20.038752 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j5tfp" event={"ID":"cee705bc-786d-4d8b-9fe2-479bca2f2097","Type":"ContainerStarted","Data":"7814f5f34e8edaa6aea12210e6b712aa8775632e46c599576fe4e3b3622fb079"} Sep 07 12:42:20.040137 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:20.039717 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j5tfp" Sep 07 12:42:20.045731 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:20.045707 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j5tfp" Sep 07 12:42:20.054732 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:20.054680 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-j5tfp" podStartSLOduration=1.9014898900000001 podStartE2EDuration="3.054660876s" totalImagesPullingTime="1.153170986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:42:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:20.053960411 +0000 UTC m=+96.923703798" watchObservedRunningTime="2026-09-07 12:42:20.054660876 +0000 UTC m=+96.924404264" Sep 07 12:42:20.418466 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:20.418433 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:20.486429 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:20.486395 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:21.186802 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:21.186774 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:21.301984 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:21.301958 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:42:21.304535 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:21.304507 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls\") pod \"image-registry-764bd57775-s4bs8\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:42:21.359514 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:21.359489 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bzkhd\"" Sep 07 12:42:21.367692 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:21.367655 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:42:21.402989 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:21.402954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:42:21.405301 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:21.405273 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94474ca3-efb2-4757-ac88-a1687b8d459c-metrics-tls\") pod \"dns-default-q5khs\" (UID: \"94474ca3-efb2-4757-ac88-a1687b8d459c\") " pod="openshift-dns/dns-default-q5khs" Sep 07 12:42:21.642948 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:21.642820 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-764bd57775-s4bs8"] Sep 07 12:42:21.645270 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:42:21.645246 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93347c79_cfca_4053_946a_1d356b5d45e9.slice/crio-b71a9ca65d130a6cf08974be1144c5d52104ab0f11d9d03803535f618dfbcf50 WatchSource:0}: Error finding container b71a9ca65d130a6cf08974be1144c5d52104ab0f11d9d03803535f618dfbcf50: Status 404 returned error can't find the container with id b71a9ca65d130a6cf08974be1144c5d52104ab0f11d9d03803535f618dfbcf50 Sep 07 12:42:21.667760 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:21.667739 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hgxzh\"" Sep 07 12:42:21.676155 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:21.676135 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q5khs" Sep 07 12:42:21.945166 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:21.945094 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q5khs"] Sep 07 12:42:21.948271 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:42:21.948226 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94474ca3_efb2_4757_ac88_a1687b8d459c.slice/crio-1074c839574169b5b2cc6472668e9562c89c4da6a735f53517dfa95718ec3a37 WatchSource:0}: Error finding container 1074c839574169b5b2cc6472668e9562c89c4da6a735f53517dfa95718ec3a37: Status 404 returned error can't find the container with id 1074c839574169b5b2cc6472668e9562c89c4da6a735f53517dfa95718ec3a37 Sep 07 12:42:22.047525 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:22.047485 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9848d959f-smqv6" event={"ID":"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb","Type":"ContainerStarted","Data":"001b5a675e6e2d335477f93642f3b6dafef3031191291c220cfd4fdd06305c15"} Sep 07 12:42:22.049196 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:22.049171 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764bd57775-s4bs8" event={"ID":"93347c79-cfca-4053-946a-1d356b5d45e9","Type":"ContainerStarted","Data":"7871f83445ffd9c26b24c09f7a39fbed97c13284dd5e10d957285c5fc7b30448"} Sep 07 12:42:22.049326 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:22.049208 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764bd57775-s4bs8" event={"ID":"93347c79-cfca-4053-946a-1d356b5d45e9","Type":"ContainerStarted","Data":"b71a9ca65d130a6cf08974be1144c5d52104ab0f11d9d03803535f618dfbcf50"} Sep 07 12:42:22.049326 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:22.049254 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:42:22.051370 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:22.051346 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttdqj" event={"ID":"b14549b7-cb78-444b-a944-d9d90a1e8eed","Type":"ContainerStarted","Data":"b230a4e684b15d612a6a38903e4aa0a762dfb33d900112f5aff162bf18152c3f"} Sep 07 12:42:22.052718 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:22.052697 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q5khs" event={"ID":"94474ca3-efb2-4757-ac88-a1687b8d459c","Type":"ContainerStarted","Data":"1074c839574169b5b2cc6472668e9562c89c4da6a735f53517dfa95718ec3a37"} Sep 07 12:42:22.064381 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:22.064332 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9848d959f-smqv6" podStartSLOduration=1.527704885 podStartE2EDuration="5.064315002s" totalImagesPullingTime="3.536610117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:42:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:22.063868569 +0000 UTC m=+98.933611959" watchObservedRunningTime="2026-09-07 12:42:22.064315002 +0000 UTC m=+98.934058394" Sep 07 12:42:22.083515 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:22.083479 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-764bd57775-s4bs8" podStartSLOduration=98.083466879 podStartE2EDuration="1m38.083466879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:22.082317824 +0000 UTC m=+98.952061212" watchObservedRunningTime="2026-09-07 12:42:22.083466879 +0000 UTC m=+98.953210266" Sep 07 12:42:22.691363 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:22.691329 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:22.910780 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:22.910747 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:22.982273 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:22.982198 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:24.062015 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:24.061936 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttdqj" event={"ID":"b14549b7-cb78-444b-a944-d9d90a1e8eed","Type":"ContainerStarted","Data":"ef43b582c28d1318f77fa33763762797c7f3990051e82adbe8cbe210534f870f"} Sep 07 12:42:24.063777 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:24.063752 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q5khs" event={"ID":"94474ca3-efb2-4757-ac88-a1687b8d459c","Type":"ContainerStarted","Data":"62687898787ef6d297cd9dfecb09841a59504bb3cc0c8a98c61b432fac86a232"} Sep 07 12:42:24.063904 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:24.063799 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q5khs" event={"ID":"94474ca3-efb2-4757-ac88-a1687b8d459c","Type":"ContainerStarted","Data":"3cc1932f510f84de17bc1a2b0dd23be8a79c29b3301bb4f6bc9a9e96e119b688"} Sep 07 12:42:24.063904 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:24.063827 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q5khs" Sep 07 12:42:24.081897 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:24.081850 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ttdqj" podStartSLOduration=33.825630296 podStartE2EDuration="38.081837358s" totalImagesPullingTime="4.256207062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:41:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:24.080329866 +0000 UTC m=+100.950073268" watchObservedRunningTime="2026-09-07 12:42:24.081837358 +0000 UTC m=+100.951580744" Sep 07 12:42:24.099415 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:24.099364 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-q5khs" podStartSLOduration=65.301950664 podStartE2EDuration="1m7.099350534s" totalImagesPullingTime="1.79739987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:24.098508125 +0000 UTC m=+100.968251511" watchObservedRunningTime="2026-09-07 12:42:24.099350534 +0000 UTC m=+100.969093924" Sep 07 12:42:24.953181 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:24.953156 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tsptp" Sep 07 12:42:25.688176 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.688144 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66c784cbfb-dxh9k"] Sep 07 12:42:25.715352 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.715319 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c784cbfb-dxh9k"] Sep 07 12:42:25.715517 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.715435 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.722827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.722587 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 07 12:42:25.833531 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.833503 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-service-ca\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.833674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.833531 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-config\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.833674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.833563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm6s9\" (UniqueName: \"kubernetes.io/projected/ec291469-f6d7-4a40-b27d-e65f693f6da3-kube-api-access-tm6s9\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.833758 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.833666 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-oauth-serving-cert\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.833758 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.833719 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-serving-cert\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.833817 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.833758 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-trusted-ca-bundle\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.833817 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.833802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-oauth-config\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.935103 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.935072 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-oauth-serving-cert\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.935103 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.935108 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-serving-cert\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.935306 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.935136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-trusted-ca-bundle\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.935306 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.935154 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-oauth-config\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.935306 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.935279 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-service-ca\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.935458 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.935323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-config\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.935458 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.935365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm6s9\" (UniqueName: \"kubernetes.io/projected/ec291469-f6d7-4a40-b27d-e65f693f6da3-kube-api-access-tm6s9\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.936020 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.935994 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-service-ca\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.936125 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.936041 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-trusted-ca-bundle\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.936125 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.936041 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-config\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.936125 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.936070 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-oauth-serving-cert\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.937755 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.937726 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-oauth-config\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.937895 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.937876 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-serving-cert\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:25.944007 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:25.943963 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm6s9\" (UniqueName: \"kubernetes.io/projected/ec291469-f6d7-4a40-b27d-e65f693f6da3-kube-api-access-tm6s9\") pod \"console-66c784cbfb-dxh9k\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:26.025305 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:26.025270 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:26.315293 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:26.315222 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c784cbfb-dxh9k"] Sep 07 12:42:26.318146 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:42:26.318117 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec291469_f6d7_4a40_b27d_e65f693f6da3.slice/crio-ad294a56d8072d436b2a6acc1e12443998d7cf54f06e1fc06f82b4b0eb7f55ee WatchSource:0}: Error finding container ad294a56d8072d436b2a6acc1e12443998d7cf54f06e1fc06f82b4b0eb7f55ee: Status 404 returned error can't find the container with id ad294a56d8072d436b2a6acc1e12443998d7cf54f06e1fc06f82b4b0eb7f55ee Sep 07 12:42:27.075512 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:27.075474 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c784cbfb-dxh9k" event={"ID":"ec291469-f6d7-4a40-b27d-e65f693f6da3","Type":"ContainerStarted","Data":"d6406bd1b589e0092ed2f9d19f288e3ab3355415fb71f213b6714acdbc37d53c"} Sep 07 12:42:27.076001 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:27.075521 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c784cbfb-dxh9k" event={"ID":"ec291469-f6d7-4a40-b27d-e65f693f6da3","Type":"ContainerStarted","Data":"ad294a56d8072d436b2a6acc1e12443998d7cf54f06e1fc06f82b4b0eb7f55ee"} Sep 07 12:42:27.090556 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:27.090511 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66c784cbfb-dxh9k" podStartSLOduration=2.090496623 podStartE2EDuration="2.090496623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:42:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:27.090188427 +0000 UTC m=+103.959931813" watchObservedRunningTime="2026-09-07 12:42:27.090496623 +0000 UTC m=+103.960240009" Sep 07 12:42:27.445351 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:27.445321 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:27.445522 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:27.445390 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:27.449934 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:27.449915 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:27.642890 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:27.642858 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:27.744058 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:27.743985 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:28.083620 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:28.083532 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:42:31.090037 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:31.090005 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:32.307858 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.307825 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:32.373377 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.373351 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:32.539082 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.539049 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:32.756744 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.756712 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:32.773238 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.773209 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j"] Sep 07 12:42:32.776050 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.776034 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" Sep 07 12:42:32.779279 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.778723 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pvrnv\"" Sep 07 12:42:32.779279 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.779247 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 07 12:42:32.779634 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.779609 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 07 12:42:32.779835 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.779674 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 07 12:42:32.784328 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.784280 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-j89jq"] Sep 07 12:42:32.786720 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.786701 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.786817 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.786797 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j"] Sep 07 12:42:32.789270 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.789228 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 07 12:42:32.789402 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.789289 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 07 12:42:32.789480 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.789347 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7zfbc\"" Sep 07 12:42:32.790310 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.790291 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 07 12:42:32.797207 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.797190 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6td8w"] Sep 07 12:42:32.799083 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.799062 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.801366 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.801349 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 07 12:42:32.801458 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.801365 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 07 12:42:32.801458 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.801401 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 07 12:42:32.801540 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.801482 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fbhvv\"" Sep 07 12:42:32.805360 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.805301 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-j89jq"] Sep 07 12:42:32.844855 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.844829 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:32.890920 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.890892 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.891070 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.890927 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/191a899e-a6d0-4f17-9cf3-9012d3792fc7-sys\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.891070 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.890948 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.891070 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.891005 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.891070 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.891036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a4b6b73-53a5-4e26-aa50-ab91d78563f7-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-nx58j\" (UID: \"6a4b6b73-53a5-4e26-aa50-ab91d78563f7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" Sep 07 12:42:32.891070 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.891057 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/191a899e-a6d0-4f17-9cf3-9012d3792fc7-metrics-client-ca\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.891240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.891086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-tls\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.891240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.891113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q2cs\" (UniqueName: \"kubernetes.io/projected/6a4b6b73-53a5-4e26-aa50-ab91d78563f7-kube-api-access-9q2cs\") pod \"openshift-state-metrics-657fd6c54-nx58j\" (UID: \"6a4b6b73-53a5-4e26-aa50-ab91d78563f7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" Sep 07 12:42:32.891240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.891130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-textfile\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.891240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.891174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-wtmp\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.891240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.891211 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cklf6\" (UniqueName: \"kubernetes.io/projected/191a899e-a6d0-4f17-9cf3-9012d3792fc7-kube-api-access-cklf6\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.891240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.891233 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a4b6b73-53a5-4e26-aa50-ab91d78563f7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-nx58j\" (UID: \"6a4b6b73-53a5-4e26-aa50-ab91d78563f7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" Sep 07 12:42:32.891414 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.891250 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgdm9\" (UniqueName: \"kubernetes.io/projected/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-api-access-tgdm9\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.891414 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.891266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-accelerators-collector-config\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.891414 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.891294 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/191a899e-a6d0-4f17-9cf3-9012d3792fc7-root\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.891414 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.891310 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.891414 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.891329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a4b6b73-53a5-4e26-aa50-ab91d78563f7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-nx58j\" (UID: \"6a4b6b73-53a5-4e26-aa50-ab91d78563f7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" Sep 07 12:42:32.891414 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.891374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.891414 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.891393 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.918770 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.918734 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:32.992170 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992141 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-wtmp\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.992298 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992173 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cklf6\" (UniqueName: \"kubernetes.io/projected/191a899e-a6d0-4f17-9cf3-9012d3792fc7-kube-api-access-cklf6\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.992298 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992191 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a4b6b73-53a5-4e26-aa50-ab91d78563f7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-nx58j\" (UID: \"6a4b6b73-53a5-4e26-aa50-ab91d78563f7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" Sep 07 12:42:32.992298 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992208 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgdm9\" (UniqueName: \"kubernetes.io/projected/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-api-access-tgdm9\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.992298 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-accelerators-collector-config\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.992497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992324 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-wtmp\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.992497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/191a899e-a6d0-4f17-9cf3-9012d3792fc7-root\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.992497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992367 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/191a899e-a6d0-4f17-9cf3-9012d3792fc7-root\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.992497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992368 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.992497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a4b6b73-53a5-4e26-aa50-ab91d78563f7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-nx58j\" (UID: \"6a4b6b73-53a5-4e26-aa50-ab91d78563f7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" Sep 07 12:42:32.992497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.992833 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:42:32.992540 2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 07 12:42:32.992833 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:42:32.992598 2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 07 12:42:32.992833 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:42:32.992618 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-state-metrics-tls podName:b612243e-76eb-4408-8a3a-81fe9dfdf5d7 nodeName:}" failed. No retries permitted until 2026-09-07 12:42:33.492598873 +0000 UTC m=+110.362342242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-j89jq" (UID: "b612243e-76eb-4408-8a3a-81fe9dfdf5d7") : secret "kube-state-metrics-tls" not found Sep 07 12:42:32.992833 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992635 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.992833 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:42:32.992661 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a4b6b73-53a5-4e26-aa50-ab91d78563f7-openshift-state-metrics-tls podName:6a4b6b73-53a5-4e26-aa50-ab91d78563f7 nodeName:}" failed. No retries permitted until 2026-09-07 12:42:33.492647598 +0000 UTC m=+110.362390970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6a4b6b73-53a5-4e26-aa50-ab91d78563f7-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-nx58j" (UID: "6a4b6b73-53a5-4e26-aa50-ab91d78563f7") : secret "openshift-state-metrics-tls" not found Sep 07 12:42:32.992833 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.992833 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/191a899e-a6d0-4f17-9cf3-9012d3792fc7-sys\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.992833 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992786 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.992833 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992805 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.992833 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992834 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a4b6b73-53a5-4e26-aa50-ab91d78563f7-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-nx58j\" (UID: \"6a4b6b73-53a5-4e26-aa50-ab91d78563f7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" Sep 07 12:42:32.993373 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992859 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/191a899e-a6d0-4f17-9cf3-9012d3792fc7-sys\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.993373 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/191a899e-a6d0-4f17-9cf3-9012d3792fc7-metrics-client-ca\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.993373 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992920 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-tls\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.993373 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992921 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-accelerators-collector-config\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.993373 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.992954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q2cs\" (UniqueName: \"kubernetes.io/projected/6a4b6b73-53a5-4e26-aa50-ab91d78563f7-kube-api-access-9q2cs\") pod \"openshift-state-metrics-657fd6c54-nx58j\" (UID: \"6a4b6b73-53a5-4e26-aa50-ab91d78563f7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" Sep 07 12:42:32.993373 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.993102 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.993373 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.993125 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.993373 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.993170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-textfile\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.993373 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:42:32.993208 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 07 12:42:32.993373 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:42:32.993262 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-tls podName:191a899e-a6d0-4f17-9cf3-9012d3792fc7 nodeName:}" failed. No retries permitted until 2026-09-07 12:42:33.493247622 +0000 UTC m=+110.362991002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-tls") pod "node-exporter-6td8w" (UID: "191a899e-a6d0-4f17-9cf3-9012d3792fc7") : secret "node-exporter-tls" not found Sep 07 12:42:32.993808 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.993373 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/191a899e-a6d0-4f17-9cf3-9012d3792fc7-metrics-client-ca\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.993808 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.993449 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-textfile\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:32.993872 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.993818 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a4b6b73-53a5-4e26-aa50-ab91d78563f7-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-nx58j\" (UID: \"6a4b6b73-53a5-4e26-aa50-ab91d78563f7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" Sep 07 12:42:32.994026 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.994006 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.995173 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.995151 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a4b6b73-53a5-4e26-aa50-ab91d78563f7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-nx58j\" (UID: \"6a4b6b73-53a5-4e26-aa50-ab91d78563f7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" Sep 07 12:42:32.995531 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.995514 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:32.995684 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:32.995665 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:33.005764 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.005732 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgdm9\" (UniqueName: \"kubernetes.io/projected/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-api-access-tgdm9\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:33.005961 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.005933 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cklf6\" (UniqueName: \"kubernetes.io/projected/191a899e-a6d0-4f17-9cf3-9012d3792fc7-kube-api-access-cklf6\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:33.006896 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.006851 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q2cs\" (UniqueName: \"kubernetes.io/projected/6a4b6b73-53a5-4e26-aa50-ab91d78563f7-kube-api-access-9q2cs\") pod \"openshift-state-metrics-657fd6c54-nx58j\" (UID: \"6a4b6b73-53a5-4e26-aa50-ab91d78563f7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" Sep 07 12:42:33.497194 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.497159 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a4b6b73-53a5-4e26-aa50-ab91d78563f7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-nx58j\" (UID: \"6a4b6b73-53a5-4e26-aa50-ab91d78563f7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" Sep 07 12:42:33.497630 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.497203 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:33.497630 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.497245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-tls\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:33.497630 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:42:33.497337 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 07 12:42:33.497630 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:42:33.497378 2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 07 12:42:33.497630 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:42:33.497386 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-tls podName:191a899e-a6d0-4f17-9cf3-9012d3792fc7 nodeName:}" failed. No retries permitted until 2026-09-07 12:42:34.497373893 +0000 UTC m=+111.367117258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-tls") pod "node-exporter-6td8w" (UID: "191a899e-a6d0-4f17-9cf3-9012d3792fc7") : secret "node-exporter-tls" not found Sep 07 12:42:33.497630 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:42:33.497450 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-state-metrics-tls podName:b612243e-76eb-4408-8a3a-81fe9dfdf5d7 nodeName:}" failed. No retries permitted until 2026-09-07 12:42:34.497431267 +0000 UTC m=+111.367174635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-j89jq" (UID: "b612243e-76eb-4408-8a3a-81fe9dfdf5d7") : secret "kube-state-metrics-tls" not found Sep 07 12:42:33.499639 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.499622 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a4b6b73-53a5-4e26-aa50-ab91d78563f7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-nx58j\" (UID: \"6a4b6b73-53a5-4e26-aa50-ab91d78563f7\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" Sep 07 12:42:33.688668 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.688634 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" Sep 07 12:42:33.729091 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.729024 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:33.829941 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.829870 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:33.835952 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.835928 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:42:33.839100 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.839083 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:33.841541 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.841445 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 07 12:42:33.841541 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.841513 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 07 12:42:33.841541 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.841526 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 07 12:42:33.841541 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.841513 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 07 12:42:33.841840 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.841750 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 07 12:42:33.841840 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.841768 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 07 12:42:33.842007 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.841993 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 07 12:42:33.842007 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.842002 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 07 12:42:33.842096 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.841996 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 07 12:42:33.842280 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.842262 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bwwnm\"" Sep 07 12:42:33.858035 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.858013 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:42:33.929111 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.929087 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:33.961369 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:33.961316 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j"] Sep 07 12:42:33.963658 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:42:33.963638 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a4b6b73_53a5_4e26_aa50_ab91d78563f7.slice/crio-4c94c664ef98381fa152dafbce8a812503a370362235c95f96aa6d0c69ddda89 WatchSource:0}: Error finding container 4c94c664ef98381fa152dafbce8a812503a370362235c95f96aa6d0c69ddda89: Status 404 returned error can't find the container with id 4c94c664ef98381fa152dafbce8a812503a370362235c95f96aa6d0c69ddda89 Sep 07 12:42:34.001542 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.001521 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.001646 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.001552 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.001646 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.001567 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be343c94-049c-482e-b3c1-dbf1f6ce0eef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.001760 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.001677 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.001760 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.001715 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.001760 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.001742 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be343c94-049c-482e-b3c1-dbf1f6ce0eef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.001902 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.001795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-config-volume\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.001902 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.001815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-web-config\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.001902 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.001835 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpz9p\" (UniqueName: \"kubernetes.io/projected/be343c94-049c-482e-b3c1-dbf1f6ce0eef-kube-api-access-zpz9p\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.001902 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.001880 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.002089 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.001908 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be343c94-049c-482e-b3c1-dbf1f6ce0eef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.002089 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.001938 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be343c94-049c-482e-b3c1-dbf1f6ce0eef-config-out\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.002089 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.001980 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/be343c94-049c-482e-b3c1-dbf1f6ce0eef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.070313 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.070285 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q5khs" Sep 07 12:42:34.102453 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.102405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/be343c94-049c-482e-b3c1-dbf1f6ce0eef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.102609 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.102484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.102609 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.102539 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.102734 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.102562 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be343c94-049c-482e-b3c1-dbf1f6ce0eef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.102734 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.102679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.102734 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.102708 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.102874 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.102731 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be343c94-049c-482e-b3c1-dbf1f6ce0eef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.102874 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.102788 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-config-volume\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.102874 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.102813 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-web-config\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.102874 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.102836 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpz9p\" (UniqueName: \"kubernetes.io/projected/be343c94-049c-482e-b3c1-dbf1f6ce0eef-kube-api-access-zpz9p\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.103068 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.102874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.103068 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.102899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be343c94-049c-482e-b3c1-dbf1f6ce0eef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.103068 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.102941 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be343c94-049c-482e-b3c1-dbf1f6ce0eef-config-out\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.103464 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:42:34.103443 2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 07 12:42:34.103550 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:42:34.103509 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-main-tls podName:be343c94-049c-482e-b3c1-dbf1f6ce0eef nodeName:}" failed. No retries permitted until 2026-09-07 12:42:34.603489081 +0000 UTC m=+111.473232453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "be343c94-049c-482e-b3c1-dbf1f6ce0eef") : secret "alertmanager-main-tls" not found Sep 07 12:42:34.104947 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.104918 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be343c94-049c-482e-b3c1-dbf1f6ce0eef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.105820 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.105791 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/be343c94-049c-482e-b3c1-dbf1f6ce0eef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.105907 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.105820 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be343c94-049c-482e-b3c1-dbf1f6ce0eef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.111272 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.110780 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.111272 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.110800 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-config-volume\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.111272 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.111230 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-web-config\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.111841 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.111556 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be343c94-049c-482e-b3c1-dbf1f6ce0eef-config-out\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.111841 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.111753 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.112057 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.112032 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.112278 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.112052 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.112278 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.112186 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" event={"ID":"6a4b6b73-53a5-4e26-aa50-ab91d78563f7","Type":"ContainerStarted","Data":"02cba1ebd5222ac2eb3cf622957e1b1d39defeca7359dc6096ca6feea27c7e80"} Sep 07 12:42:34.112278 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.112274 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" event={"ID":"6a4b6b73-53a5-4e26-aa50-ab91d78563f7","Type":"ContainerStarted","Data":"c0314e09f352ef8600a77126c3ec4a51a2e9c6ee2feff3c35150b76187696917"} Sep 07 12:42:34.112436 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.112300 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" event={"ID":"6a4b6b73-53a5-4e26-aa50-ab91d78563f7","Type":"ContainerStarted","Data":"4c94c664ef98381fa152dafbce8a812503a370362235c95f96aa6d0c69ddda89"} Sep 07 12:42:34.113846 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.113825 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be343c94-049c-482e-b3c1-dbf1f6ce0eef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.118233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.118192 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpz9p\" (UniqueName: \"kubernetes.io/projected/be343c94-049c-482e-b3c1-dbf1f6ce0eef-kube-api-access-zpz9p\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.253019 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.252983 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:34.317709 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.317651 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:34.505462 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.505437 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-tls\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:34.505915 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.505523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:34.507856 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.507836 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/191a899e-a6d0-4f17-9cf3-9012d3792fc7-node-exporter-tls\") pod \"node-exporter-6td8w\" (UID: \"191a899e-a6d0-4f17-9cf3-9012d3792fc7\") " pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:34.508119 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.508088 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b612243e-76eb-4408-8a3a-81fe9dfdf5d7-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-j89jq\" (UID: \"b612243e-76eb-4408-8a3a-81fe9dfdf5d7\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:34.595957 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.595934 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" Sep 07 12:42:34.606485 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.606460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.608587 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.608552 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6td8w" Sep 07 12:42:34.608814 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.608798 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.619286 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:42:34.619265 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod191a899e_a6d0_4f17_9cf3_9012d3792fc7.slice/crio-ca586262ebbffe0d2719d164f141e1e00ab2845bd75341b3f5e53a150c51adeb WatchSource:0}: Error finding container ca586262ebbffe0d2719d164f141e1e00ab2845bd75341b3f5e53a150c51adeb: Status 404 returned error can't find the container with id ca586262ebbffe0d2719d164f141e1e00ab2845bd75341b3f5e53a150c51adeb Sep 07 12:42:34.749474 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.749441 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:42:34.869361 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:34.869330 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-j89jq"] Sep 07 12:42:34.871955 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:42:34.871921 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb612243e_76eb_4408_8a3a_81fe9dfdf5d7.slice/crio-b07644a301041381400274d7b86ee06c4b31ecdeef246d3c5d75e8f3745f83ce WatchSource:0}: Error finding container b07644a301041381400274d7b86ee06c4b31ecdeef246d3c5d75e8f3745f83ce: Status 404 returned error can't find the container with id b07644a301041381400274d7b86ee06c4b31ecdeef246d3c5d75e8f3745f83ce Sep 07 12:42:35.029007 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:35.028982 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:42:35.030896 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:42:35.030872 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe343c94_049c_482e_b3c1_dbf1f6ce0eef.slice/crio-308aac9ffd82902ccfcb2d467bd95b055ccb9cbc8a4175779e8f7b1d1ff8462e WatchSource:0}: Error finding container 308aac9ffd82902ccfcb2d467bd95b055ccb9cbc8a4175779e8f7b1d1ff8462e: Status 404 returned error can't find the container with id 308aac9ffd82902ccfcb2d467bd95b055ccb9cbc8a4175779e8f7b1d1ff8462e Sep 07 12:42:35.116452 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:35.116419 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be343c94-049c-482e-b3c1-dbf1f6ce0eef","Type":"ContainerStarted","Data":"308aac9ffd82902ccfcb2d467bd95b055ccb9cbc8a4175779e8f7b1d1ff8462e"} Sep 07 12:42:35.117637 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:35.117619 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6td8w" event={"ID":"191a899e-a6d0-4f17-9cf3-9012d3792fc7","Type":"ContainerStarted","Data":"ca586262ebbffe0d2719d164f141e1e00ab2845bd75341b3f5e53a150c51adeb"} Sep 07 12:42:35.118717 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:35.118701 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" event={"ID":"b612243e-76eb-4408-8a3a-81fe9dfdf5d7","Type":"ContainerStarted","Data":"b07644a301041381400274d7b86ee06c4b31ecdeef246d3c5d75e8f3745f83ce"} Sep 07 12:42:35.704693 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:35.704661 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:35.765415 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:35.765383 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:35.827343 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:35.827305 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:36.026048 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:36.025749 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:36.026048 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:36.025804 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:36.032588 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:36.032513 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:36.127555 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:36.127526 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:42:36.174949 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:36.174919 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9848d959f-smqv6"] Sep 07 12:42:36.285194 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:36.285119 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:36.350380 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:36.350342 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-764bd57775-s4bs8"] Sep 07 12:42:36.355289 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:36.355264 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:42:36.362889 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:36.362863 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:36.437651 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:36.437623 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:36.541032 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:36.540947 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:36.639195 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:36.639169 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:37.080816 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.080720 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-fbdd49684-gwjsc"] Sep 07 12:42:37.083924 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.083906 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.086379 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.086337 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 07 12:42:37.086497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.086362 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 07 12:42:37.086497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.086422 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ev5vsvhm1g338\"" Sep 07 12:42:37.086497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.086431 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 07 12:42:37.086497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.086472 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 07 12:42:37.086497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.086363 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hwl6k\"" Sep 07 12:42:37.093177 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.093156 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-fbdd49684-gwjsc"] Sep 07 12:42:37.128689 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.128661 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" event={"ID":"6a4b6b73-53a5-4e26-aa50-ab91d78563f7","Type":"ContainerStarted","Data":"694e234893824579d0f79719d164480755739cba8adea462ee197dfc79bef7bf"} Sep 07 12:42:37.130095 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.130075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3585dd-16b6-4777-ab30-4f9997c785ea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.130181 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.130106 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9e3585dd-16b6-4777-ab30-4f9997c785ea-audit-log\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.130181 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.130104 2579 generic.go:356] "Generic (PLEG): container finished" podID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerID="3616ad77d9669ec2465874f97e82258ae9b83a06f7a59b58918d111de1b7fb25" exitCode=0 Sep 07 12:42:37.130181 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.130123 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be343c94-049c-482e-b3c1-dbf1f6ce0eef","Type":"ContainerDied","Data":"3616ad77d9669ec2465874f97e82258ae9b83a06f7a59b58918d111de1b7fb25"} Sep 07 12:42:37.130181 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.130161 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9e3585dd-16b6-4777-ab30-4f9997c785ea-secret-metrics-server-tls\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.130362 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.130212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9e3585dd-16b6-4777-ab30-4f9997c785ea-secret-metrics-server-client-certs\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.130362 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.130244 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e3585dd-16b6-4777-ab30-4f9997c785ea-client-ca-bundle\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.130461 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.130379 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlzc2\" (UniqueName: \"kubernetes.io/projected/9e3585dd-16b6-4777-ab30-4f9997c785ea-kube-api-access-vlzc2\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.130461 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.130439 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9e3585dd-16b6-4777-ab30-4f9997c785ea-metrics-server-audit-profiles\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.131953 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.131928 2579 generic.go:356] "Generic (PLEG): container finished" podID="191a899e-a6d0-4f17-9cf3-9012d3792fc7" containerID="4287b34deab8c6f7865d731b0be7475d643b5bcb5135ed1f85e6257a80e2e5f2" exitCode=0 Sep 07 12:42:37.132059 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.131955 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6td8w" event={"ID":"191a899e-a6d0-4f17-9cf3-9012d3792fc7","Type":"ContainerDied","Data":"4287b34deab8c6f7865d731b0be7475d643b5bcb5135ed1f85e6257a80e2e5f2"} Sep 07 12:42:37.134544 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.134524 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" event={"ID":"b612243e-76eb-4408-8a3a-81fe9dfdf5d7","Type":"ContainerStarted","Data":"8911843ab1675d8d97f2cfe1b1d5c0e2e73e7f53cb14a559c032297c7d7d4ddc"} Sep 07 12:42:37.134637 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.134564 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" event={"ID":"b612243e-76eb-4408-8a3a-81fe9dfdf5d7","Type":"ContainerStarted","Data":"33cfaec6a880a842dd3c6cd91fc7f0262333aa3a7035a66f9709dfad51e3479e"} Sep 07 12:42:37.134637 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.134603 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" event={"ID":"b612243e-76eb-4408-8a3a-81fe9dfdf5d7","Type":"ContainerStarted","Data":"2f4aa18918e77c09d154164c6628e1baa12500ed0abf0be2c86dd8bc0257ab90"} Sep 07 12:42:37.145409 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.145376 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-nx58j" podStartSLOduration=2.652857659 podStartE2EDuration="5.145364251s" totalImagesPullingTime="2.492506592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:37.144908818 +0000 UTC m=+114.014652205" watchObservedRunningTime="2026-09-07 12:42:37.145364251 +0000 UTC m=+114.015107637" Sep 07 12:42:37.161979 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.161930 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-j89jq" podStartSLOduration=3.448445974 podStartE2EDuration="5.161917578s" totalImagesPullingTime="1.713471604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:37.16079836 +0000 UTC m=+114.030541747" watchObservedRunningTime="2026-09-07 12:42:37.161917578 +0000 UTC m=+114.031660964" Sep 07 12:42:37.165567 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.165547 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:37.229135 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.229113 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:37.232332 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.232294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9e3585dd-16b6-4777-ab30-4f9997c785ea-secret-metrics-server-client-certs\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.232435 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.232332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e3585dd-16b6-4777-ab30-4f9997c785ea-client-ca-bundle\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.233281 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.232506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlzc2\" (UniqueName: \"kubernetes.io/projected/9e3585dd-16b6-4777-ab30-4f9997c785ea-kube-api-access-vlzc2\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.233281 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.232706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9e3585dd-16b6-4777-ab30-4f9997c785ea-metrics-server-audit-profiles\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.233281 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.232853 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3585dd-16b6-4777-ab30-4f9997c785ea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.233281 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.232892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9e3585dd-16b6-4777-ab30-4f9997c785ea-audit-log\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.233281 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.232974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9e3585dd-16b6-4777-ab30-4f9997c785ea-secret-metrics-server-tls\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.234254 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.233977 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e3585dd-16b6-4777-ab30-4f9997c785ea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.234254 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.234048 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9e3585dd-16b6-4777-ab30-4f9997c785ea-metrics-server-audit-profiles\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.234421 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.234260 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9e3585dd-16b6-4777-ab30-4f9997c785ea-audit-log\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.235886 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.235867 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9e3585dd-16b6-4777-ab30-4f9997c785ea-secret-metrics-server-client-certs\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.236000 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.235893 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e3585dd-16b6-4777-ab30-4f9997c785ea-client-ca-bundle\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.236056 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.236008 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9e3585dd-16b6-4777-ab30-4f9997c785ea-secret-metrics-server-tls\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.241270 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.241251 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlzc2\" (UniqueName: \"kubernetes.io/projected/9e3585dd-16b6-4777-ab30-4f9997c785ea-kube-api-access-vlzc2\") pod \"metrics-server-fbdd49684-gwjsc\" (UID: \"9e3585dd-16b6-4777-ab30-4f9997c785ea\") " pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.394049 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.394022 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:37.572568 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.572529 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-x9c6z"] Sep 07 12:42:37.576795 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.576775 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x9c6z" Sep 07 12:42:37.579255 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.579234 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6k6bf\"" Sep 07 12:42:37.579255 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.579248 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 07 12:42:37.583493 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.583355 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-x9c6z"] Sep 07 12:42:37.590009 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.589990 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:37.635681 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.635656 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd97d\" (UniqueName: \"kubernetes.io/projected/1420798a-15bd-40c3-aa08-155002a3c8a9-kube-api-access-zd97d\") pod \"monitoring-plugin-85bbbbbf4-x9c6z\" (UID: \"1420798a-15bd-40c3-aa08-155002a3c8a9\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x9c6z" Sep 07 12:42:37.635771 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.635746 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1420798a-15bd-40c3-aa08-155002a3c8a9-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-x9c6z\" (UID: \"1420798a-15bd-40c3-aa08-155002a3c8a9\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x9c6z" Sep 07 12:42:37.662358 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.662248 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-fbdd49684-gwjsc"] Sep 07 12:42:37.664935 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:42:37.664912 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e3585dd_16b6_4777_ab30_4f9997c785ea.slice/crio-fa24d442edb148c0962ddf4d94b7053f915db54033d89e693d4d73e2ec51cffb WatchSource:0}: Error finding container fa24d442edb148c0962ddf4d94b7053f915db54033d89e693d4d73e2ec51cffb: Status 404 returned error can't find the container with id fa24d442edb148c0962ddf4d94b7053f915db54033d89e693d4d73e2ec51cffb Sep 07 12:42:37.665339 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.665322 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:37.736781 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.736747 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd97d\" (UniqueName: \"kubernetes.io/projected/1420798a-15bd-40c3-aa08-155002a3c8a9-kube-api-access-zd97d\") pod \"monitoring-plugin-85bbbbbf4-x9c6z\" (UID: \"1420798a-15bd-40c3-aa08-155002a3c8a9\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x9c6z" Sep 07 12:42:37.737040 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.737011 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1420798a-15bd-40c3-aa08-155002a3c8a9-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-x9c6z\" (UID: \"1420798a-15bd-40c3-aa08-155002a3c8a9\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x9c6z" Sep 07 12:42:37.739363 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.739341 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1420798a-15bd-40c3-aa08-155002a3c8a9-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-x9c6z\" (UID: \"1420798a-15bd-40c3-aa08-155002a3c8a9\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x9c6z" Sep 07 12:42:37.745157 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.745137 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd97d\" (UniqueName: \"kubernetes.io/projected/1420798a-15bd-40c3-aa08-155002a3c8a9-kube-api-access-zd97d\") pod \"monitoring-plugin-85bbbbbf4-x9c6z\" (UID: \"1420798a-15bd-40c3-aa08-155002a3c8a9\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x9c6z" Sep 07 12:42:37.885943 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:37.885912 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x9c6z" Sep 07 12:42:38.142752 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.142717 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6td8w" event={"ID":"191a899e-a6d0-4f17-9cf3-9012d3792fc7","Type":"ContainerStarted","Data":"9255b24fdd9d188ca10ac1d2c3d5b0d4a7167b5329d14d3e0a30c6affd18b495"} Sep 07 12:42:38.143173 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.142782 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6td8w" event={"ID":"191a899e-a6d0-4f17-9cf3-9012d3792fc7","Type":"ContainerStarted","Data":"39918e1d61ff8eb21ddcf922f5e972382e17df71a7378719bff10173f03d9012"} Sep 07 12:42:38.144600 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.144395 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" event={"ID":"9e3585dd-16b6-4777-ab30-4f9997c785ea","Type":"ContainerStarted","Data":"fa24d442edb148c0962ddf4d94b7053f915db54033d89e693d4d73e2ec51cffb"} Sep 07 12:42:38.155692 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.155663 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-x9c6z"] Sep 07 12:42:38.160154 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.160101 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6td8w" podStartSLOduration=4.100732187 podStartE2EDuration="6.16008295s" totalImagesPullingTime="1.96193565s" totalInitContainerRuntime="97.415113ms" isStatefulPod=true podCreationTimestamp="2026-09-07 12:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:38.159699558 +0000 UTC m=+115.029442947" watchObservedRunningTime="2026-09-07 12:42:38.16008295 +0000 UTC m=+115.029826339" Sep 07 12:42:38.160827 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:42:38.160798 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1420798a_15bd_40c3_aa08_155002a3c8a9.slice/crio-39e7c8eea5b5be1bf595af1aececadb51c15d2b348c3e9ec74c35bcef56a24f7 WatchSource:0}: Error finding container 39e7c8eea5b5be1bf595af1aececadb51c15d2b348c3e9ec74c35bcef56a24f7: Status 404 returned error can't find the container with id 39e7c8eea5b5be1bf595af1aececadb51c15d2b348c3e9ec74c35bcef56a24f7 Sep 07 12:42:38.962472 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.962435 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:42:38.966434 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.966413 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:38.967143 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.967112 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:38.968381 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.968355 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 12:42:38.969636 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.969336 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 12:42:38.969636 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.969344 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8ojsf1sdn0bdo\"" Sep 07 12:42:38.969636 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.969395 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bwfv2\"" Sep 07 12:42:38.969636 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.969405 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 12:42:38.969636 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.969341 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 12:42:38.969636 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.969506 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 12:42:38.969636 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.969341 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 12:42:38.969636 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.969546 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 12:42:38.970024 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.969853 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 12:42:38.970024 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.969979 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 12:42:38.970258 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.970147 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 12:42:38.970335 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.970290 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 12:42:38.970394 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.970346 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 12:42:38.970441 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.970403 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 12:42:38.972921 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.972900 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 12:42:38.986528 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:38.986505 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:42:39.048771 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.048741 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.048902 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.048784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.048902 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.048810 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.048902 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.048878 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.049028 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.048928 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-config\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.049028 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.048946 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11f7de21-1e3f-4576-800e-c09742b0baa1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.049028 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.048960 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.049028 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.048988 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.049028 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.049014 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.049210 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.049042 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.049210 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.049068 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.049210 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.049098 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.049210 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.049127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-web-config\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.049210 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.049151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11f7de21-1e3f-4576-800e-c09742b0baa1-config-out\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.049210 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.049180 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.049445 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.049242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.049445 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.049263 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.049445 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.049280 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krjqd\" (UniqueName: \"kubernetes.io/projected/11f7de21-1e3f-4576-800e-c09742b0baa1-kube-api-access-krjqd\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.049445 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.049346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.049445 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.049374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.150475 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.150444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.150931 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.150486 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.150931 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.150510 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.150931 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.150540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-web-config\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.150931 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.150557 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11f7de21-1e3f-4576-800e-c09742b0baa1-config-out\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.150931 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.150605 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.150931 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.150638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.150931 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.150664 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.150931 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.150693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krjqd\" (UniqueName: \"kubernetes.io/projected/11f7de21-1e3f-4576-800e-c09742b0baa1-kube-api-access-krjqd\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.150931 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.150762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.150931 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.150785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.150931 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.150819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.150931 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.150884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.150931 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.150910 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.151791 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.150967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.151791 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.151027 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-config\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.151791 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.151052 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11f7de21-1e3f-4576-800e-c09742b0baa1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.151791 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.151073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.151791 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.151109 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.151791 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.151125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.152276 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.152133 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.156039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.156012 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.156619 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.156556 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.157158 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.157126 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.157418 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.157312 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.158098 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.158057 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.158368 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.158350 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11f7de21-1e3f-4576-800e-c09742b0baa1-config-out\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.159159 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.159137 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.159456 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.159419 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x9c6z" event={"ID":"1420798a-15bd-40c3-aa08-155002a3c8a9","Type":"ContainerStarted","Data":"39e7c8eea5b5be1bf595af1aececadb51c15d2b348c3e9ec74c35bcef56a24f7"} Sep 07 12:42:39.160698 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.160675 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.162273 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.161992 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.162273 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.162125 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.162273 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.162220 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-web-config\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.162468 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.162288 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.162588 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.162547 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.162737 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.162565 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.162827 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.162782 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.164741 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.164522 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-config\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.164741 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.164646 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krjqd\" (UniqueName: \"kubernetes.io/projected/11f7de21-1e3f-4576-800e-c09742b0baa1-kube-api-access-krjqd\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.165368 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.165338 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11f7de21-1e3f-4576-800e-c09742b0baa1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.165456 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.165388 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.277525 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.277453 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:39.369597 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.369554 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:39.471891 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.471822 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:39.645070 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:39.644921 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:42:39.648271 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:42:39.648245 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f7de21_1e3f_4576_800e_c09742b0baa1.slice/crio-1f3c16079802b2a79fb8841dc87ea8eee17d74ebddcb4af5bf339512b66f20c7 WatchSource:0}: Error finding container 1f3c16079802b2a79fb8841dc87ea8eee17d74ebddcb4af5bf339512b66f20c7: Status 404 returned error can't find the container with id 1f3c16079802b2a79fb8841dc87ea8eee17d74ebddcb4af5bf339512b66f20c7 Sep 07 12:42:40.166053 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:40.165792 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" event={"ID":"9e3585dd-16b6-4777-ab30-4f9997c785ea","Type":"ContainerStarted","Data":"773d10959f48e070109452306a6ac63d6a05015568236b0304872c5c30656e90"} Sep 07 12:42:40.169632 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:40.169604 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be343c94-049c-482e-b3c1-dbf1f6ce0eef","Type":"ContainerStarted","Data":"b4af1854b19cc4636830b42a5f2d97844562cd06be38b799b8fb3b76f178a61f"} Sep 07 12:42:40.169764 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:40.169671 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be343c94-049c-482e-b3c1-dbf1f6ce0eef","Type":"ContainerStarted","Data":"2b11f95605e393f68a36270087c5075a4a19f334d7ef6134f466240b8f5f95e3"} Sep 07 12:42:40.169764 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:40.169700 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be343c94-049c-482e-b3c1-dbf1f6ce0eef","Type":"ContainerStarted","Data":"f469b2a3cd76f219a380b500765afc39ca0ee3d448455fe492d158df00a06452"} Sep 07 12:42:40.169764 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:40.169728 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be343c94-049c-482e-b3c1-dbf1f6ce0eef","Type":"ContainerStarted","Data":"df0c0c9cb1fe1c117e8a1092e4e53e4b1ccbce59f4a6af1101ac8807d00116e5"} Sep 07 12:42:40.169764 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:40.169759 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be343c94-049c-482e-b3c1-dbf1f6ce0eef","Type":"ContainerStarted","Data":"e522485ec71b897d642e381801d178643bdc8a742fbabec96a9b8ccc3cf0de06"} Sep 07 12:42:40.172039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:40.171886 2579 generic.go:356] "Generic (PLEG): container finished" podID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerID="6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2" exitCode=0 Sep 07 12:42:40.172039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:40.171945 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11f7de21-1e3f-4576-800e-c09742b0baa1","Type":"ContainerDied","Data":"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2"} Sep 07 12:42:40.172039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:40.172003 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11f7de21-1e3f-4576-800e-c09742b0baa1","Type":"ContainerStarted","Data":"1f3c16079802b2a79fb8841dc87ea8eee17d74ebddcb4af5bf339512b66f20c7"} Sep 07 12:42:40.183689 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:40.183632 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" podStartSLOduration=1.485267175 podStartE2EDuration="3.183613066s" totalImagesPullingTime="1.698345891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:42:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:40.1822703 +0000 UTC m=+117.052013687" watchObservedRunningTime="2026-09-07 12:42:40.183613066 +0000 UTC m=+117.053356457" Sep 07 12:42:41.181722 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:41.181685 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be343c94-049c-482e-b3c1-dbf1f6ce0eef","Type":"ContainerStarted","Data":"553f77d84a30f125ba96aca7d7a8d733605d9aa6a3d3bf324d721cfe1fdae9a4"} Sep 07 12:42:41.183133 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:41.183108 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x9c6z" event={"ID":"1420798a-15bd-40c3-aa08-155002a3c8a9","Type":"ContainerStarted","Data":"3fe8634ff04f70125ae43df48bcc2fde0a05c093ca2fe873493f02558d53e08a"} Sep 07 12:42:41.213279 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:41.213218 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.517794109 podStartE2EDuration="8.213201462s" totalImagesPullingTime="4.673884147s" totalInitContainerRuntime="21.523206ms" isStatefulPod=false podCreationTimestamp="2026-09-07 12:42:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:41.212254925 +0000 UTC m=+118.081998311" watchObservedRunningTime="2026-09-07 12:42:41.213201462 +0000 UTC m=+118.082944850" Sep 07 12:42:41.231096 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:41.231041 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x9c6z" podStartSLOduration=2.100085844 podStartE2EDuration="4.231017717s" totalImagesPullingTime="2.130931873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:42:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:41.229548973 +0000 UTC m=+118.099292360" watchObservedRunningTime="2026-09-07 12:42:41.231017717 +0000 UTC m=+118.100761106" Sep 07 12:42:42.188642 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:42.188610 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x9c6z" Sep 07 12:42:42.193963 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:42.193929 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x9c6z" Sep 07 12:42:43.960801 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:43.960722 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:44.060056 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:44.060015 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:44.199381 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:44.199346 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11f7de21-1e3f-4576-800e-c09742b0baa1","Type":"ContainerStarted","Data":"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852"} Sep 07 12:42:44.199547 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:44.199433 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11f7de21-1e3f-4576-800e-c09742b0baa1","Type":"ContainerStarted","Data":"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621"} Sep 07 12:42:46.211233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:46.211199 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11f7de21-1e3f-4576-800e-c09742b0baa1","Type":"ContainerStarted","Data":"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f"} Sep 07 12:42:46.211595 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:46.211276 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11f7de21-1e3f-4576-800e-c09742b0baa1","Type":"ContainerStarted","Data":"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f"} Sep 07 12:42:46.211595 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:46.211320 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11f7de21-1e3f-4576-800e-c09742b0baa1","Type":"ContainerStarted","Data":"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86"} Sep 07 12:42:46.211595 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:46.211356 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11f7de21-1e3f-4576-800e-c09742b0baa1","Type":"ContainerStarted","Data":"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2"} Sep 07 12:42:46.245029 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:46.244974 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.080172419 podStartE2EDuration="8.244955973s" totalImagesPullingTime="5.131578807s" totalInitContainerRuntime="33.204747ms" isStatefulPod=false podCreationTimestamp="2026-09-07 12:42:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:46.242911102 +0000 UTC m=+123.112654493" watchObservedRunningTime="2026-09-07 12:42:46.244955973 +0000 UTC m=+123.114699360" Sep 07 12:42:47.210766 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:47.210729 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:47.420931 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:47.420901 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:47.551799 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:47.551732 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:49.277765 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:49.277732 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:50.513109 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:50.513074 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c784cbfb-dxh9k"] Sep 07 12:42:50.627912 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:50.627879 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:50.742855 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:50.742813 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:50.842478 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:50.842406 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:52.375280 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:52.375247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs\") pod \"network-metrics-daemon-9mbh5\" (UID: \"bce0dedd-2b68-4c5d-8504-150a18723edd\") " pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:42:52.377674 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:52.377657 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bce0dedd-2b68-4c5d-8504-150a18723edd-metrics-certs\") pod \"network-metrics-daemon-9mbh5\" (UID: \"bce0dedd-2b68-4c5d-8504-150a18723edd\") " pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:42:52.566846 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:52.566818 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2p7wt\"" Sep 07 12:42:52.574943 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:52.574925 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9mbh5" Sep 07 12:42:52.847808 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:52.847759 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9mbh5"] Sep 07 12:42:52.851623 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:42:52.851594 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbce0dedd_2b68_4c5d_8504_150a18723edd.slice/crio-908ccbcbdeb8356bbe7fc3390859ee1e5a098f07ff7ccd395c2198770d7ee42b WatchSource:0}: Error finding container 908ccbcbdeb8356bbe7fc3390859ee1e5a098f07ff7ccd395c2198770d7ee42b: Status 404 returned error can't find the container with id 908ccbcbdeb8356bbe7fc3390859ee1e5a098f07ff7ccd395c2198770d7ee42b Sep 07 12:42:53.082377 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:53.082345 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:53.183339 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:53.183307 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:53.241688 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:53.241653 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9mbh5" event={"ID":"bce0dedd-2b68-4c5d-8504-150a18723edd","Type":"ContainerStarted","Data":"908ccbcbdeb8356bbe7fc3390859ee1e5a098f07ff7ccd395c2198770d7ee42b"} Sep 07 12:42:53.533401 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:53.533364 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:53.637077 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:53.637039 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:54.248204 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:54.248166 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9mbh5" event={"ID":"bce0dedd-2b68-4c5d-8504-150a18723edd","Type":"ContainerStarted","Data":"f5c4c1e36bd1ee3704b2009652bf2e5bc27d87c6c058911a6e7633c8c7209cd0"} Sep 07 12:42:54.248360 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:54.248263 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9mbh5" event={"ID":"bce0dedd-2b68-4c5d-8504-150a18723edd","Type":"ContainerStarted","Data":"2943a0648d3389ded1422e41bec1a69cd7aa5b3f94f9f55f72bf6874b79a9d05"} Sep 07 12:42:54.264126 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:54.264067 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9mbh5" podStartSLOduration=130.272921255 podStartE2EDuration="2m11.264052049s" totalImagesPullingTime="991.130794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:42:54.263602198 +0000 UTC m=+131.133345581" watchObservedRunningTime="2026-09-07 12:42:54.264052049 +0000 UTC m=+131.133795446" Sep 07 12:42:54.393904 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:54.393870 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:54.494670 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:54.494638 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:56.639905 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:56.639875 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:56.704884 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:56.704858 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:42:57.394162 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:57.394130 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:57.394320 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:57.394184 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:42:57.980175 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:42:57.980127 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:43:01.203205 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.203170 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9848d959f-smqv6" podUID="fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb" containerName="console" containerID="cri-o://001b5a675e6e2d335477f93642f3b6dafef3031191291c220cfd4fdd06305c15" gracePeriod=15 Sep 07 12:43:01.376692 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.376632 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-764bd57775-s4bs8" podUID="93347c79-cfca-4053-946a-1d356b5d45e9" containerName="registry" containerID="cri-o://7871f83445ffd9c26b24c09f7a39fbed97c13284dd5e10d957285c5fc7b30448" gracePeriod=30 Sep 07 12:43:01.498669 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.498647 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:43:01.615381 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.615357 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:43:01.651395 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.651370 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-oauth-config\") pod \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " Sep 07 12:43:01.651550 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.651464 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-oauth-serving-cert\") pod \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " Sep 07 12:43:01.651550 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.651499 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp57p\" (UniqueName: \"kubernetes.io/projected/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-kube-api-access-hp57p\") pod \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " Sep 07 12:43:01.651550 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.651516 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-service-ca\") pod \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " Sep 07 12:43:01.651773 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.651592 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-config\") pod \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " Sep 07 12:43:01.651773 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.651622 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-serving-cert\") pod \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\" (UID: \"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb\") " Sep 07 12:43:01.651959 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.651920 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-service-ca" (OuterVolumeSpecName: "service-ca") pod "fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb" (UID: "fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:01.651959 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.651931 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb" (UID: "fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:01.652074 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.651989 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-config" (OuterVolumeSpecName: "console-config") pod "fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb" (UID: "fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:01.653950 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.653920 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb" (UID: "fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:01.653950 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.653931 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-kube-api-access-hp57p" (OuterVolumeSpecName: "kube-api-access-hp57p") pod "fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb" (UID: "fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb"). InnerVolumeSpecName "kube-api-access-hp57p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:43:01.654149 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.653976 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb" (UID: "fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:01.752388 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.752299 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93347c79-cfca-4053-946a-1d356b5d45e9-installation-pull-secrets\") pod \"93347c79-cfca-4053-946a-1d356b5d45e9\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " Sep 07 12:43:01.752388 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.752354 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93347c79-cfca-4053-946a-1d356b5d45e9-image-registry-private-configuration\") pod \"93347c79-cfca-4053-946a-1d356b5d45e9\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " Sep 07 12:43:01.752656 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.752406 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93347c79-cfca-4053-946a-1d356b5d45e9-registry-certificates\") pod \"93347c79-cfca-4053-946a-1d356b5d45e9\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " Sep 07 12:43:01.752656 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.752440 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93347c79-cfca-4053-946a-1d356b5d45e9-trusted-ca\") pod \"93347c79-cfca-4053-946a-1d356b5d45e9\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " Sep 07 12:43:01.752656 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.752464 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93347c79-cfca-4053-946a-1d356b5d45e9-ca-trust-extracted\") pod \"93347c79-cfca-4053-946a-1d356b5d45e9\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " Sep 07 12:43:01.752656 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.752497 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-bound-sa-token\") pod \"93347c79-cfca-4053-946a-1d356b5d45e9\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " Sep 07 12:43:01.752656 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.752521 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp6bj\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-kube-api-access-bp6bj\") pod \"93347c79-cfca-4053-946a-1d356b5d45e9\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " Sep 07 12:43:01.752656 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.752568 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls\") pod \"93347c79-cfca-4053-946a-1d356b5d45e9\" (UID: \"93347c79-cfca-4053-946a-1d356b5d45e9\") " Sep 07 12:43:01.752944 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.752883 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-config\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:01.752944 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.752899 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-serving-cert\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:01.752944 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.752913 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-console-oauth-config\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:01.752944 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.752927 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-oauth-serving-cert\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:01.752944 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.752940 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp57p\" (UniqueName: \"kubernetes.io/projected/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-kube-api-access-hp57p\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:01.753144 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.752954 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb-service-ca\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:01.753144 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.752996 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93347c79-cfca-4053-946a-1d356b5d45e9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "93347c79-cfca-4053-946a-1d356b5d45e9" (UID: "93347c79-cfca-4053-946a-1d356b5d45e9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:01.753460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.753429 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93347c79-cfca-4053-946a-1d356b5d45e9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "93347c79-cfca-4053-946a-1d356b5d45e9" (UID: "93347c79-cfca-4053-946a-1d356b5d45e9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:01.755067 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.755006 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93347c79-cfca-4053-946a-1d356b5d45e9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "93347c79-cfca-4053-946a-1d356b5d45e9" (UID: "93347c79-cfca-4053-946a-1d356b5d45e9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:01.755190 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.755156 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "93347c79-cfca-4053-946a-1d356b5d45e9" (UID: "93347c79-cfca-4053-946a-1d356b5d45e9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:43:01.755250 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.755184 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93347c79-cfca-4053-946a-1d356b5d45e9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "93347c79-cfca-4053-946a-1d356b5d45e9" (UID: "93347c79-cfca-4053-946a-1d356b5d45e9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:01.755751 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.755724 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-kube-api-access-bp6bj" (OuterVolumeSpecName: "kube-api-access-bp6bj") pod "93347c79-cfca-4053-946a-1d356b5d45e9" (UID: "93347c79-cfca-4053-946a-1d356b5d45e9"). InnerVolumeSpecName "kube-api-access-bp6bj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:43:01.755864 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.755850 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "93347c79-cfca-4053-946a-1d356b5d45e9" (UID: "93347c79-cfca-4053-946a-1d356b5d45e9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:43:01.760911 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.760887 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93347c79-cfca-4053-946a-1d356b5d45e9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "93347c79-cfca-4053-946a-1d356b5d45e9" (UID: "93347c79-cfca-4053-946a-1d356b5d45e9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:43:01.853412 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.853373 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93347c79-cfca-4053-946a-1d356b5d45e9-registry-certificates\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:01.853412 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.853406 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93347c79-cfca-4053-946a-1d356b5d45e9-trusted-ca\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:01.853412 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.853416 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93347c79-cfca-4053-946a-1d356b5d45e9-ca-trust-extracted\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:01.853669 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.853425 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-bound-sa-token\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:01.853669 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.853433 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp6bj\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-kube-api-access-bp6bj\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:01.853669 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.853441 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93347c79-cfca-4053-946a-1d356b5d45e9-registry-tls\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:01.853669 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.853449 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93347c79-cfca-4053-946a-1d356b5d45e9-installation-pull-secrets\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:01.853669 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:01.853460 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93347c79-cfca-4053-946a-1d356b5d45e9-image-registry-private-configuration\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:02.279988 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.279952 2579 generic.go:356] "Generic (PLEG): container finished" podID="fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb" containerID="001b5a675e6e2d335477f93642f3b6dafef3031191291c220cfd4fdd06305c15" exitCode=0 Sep 07 12:43:02.280443 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.280023 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9848d959f-smqv6" event={"ID":"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb","Type":"ContainerDied","Data":"001b5a675e6e2d335477f93642f3b6dafef3031191291c220cfd4fdd06305c15"} Sep 07 12:43:02.280443 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.280027 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9848d959f-smqv6" Sep 07 12:43:02.280443 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.280070 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9848d959f-smqv6" event={"ID":"fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb","Type":"ContainerDied","Data":"759fd03ff32ffa5292f55366c0ebf725328562418a01c2ad964c18b99a9de9b8"} Sep 07 12:43:02.280443 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.280090 2579 scope.go:117] "RemoveContainer" containerID="001b5a675e6e2d335477f93642f3b6dafef3031191291c220cfd4fdd06305c15" Sep 07 12:43:02.281438 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.281304 2579 generic.go:356] "Generic (PLEG): container finished" podID="93347c79-cfca-4053-946a-1d356b5d45e9" containerID="7871f83445ffd9c26b24c09f7a39fbed97c13284dd5e10d957285c5fc7b30448" exitCode=0 Sep 07 12:43:02.281438 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.281370 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764bd57775-s4bs8" Sep 07 12:43:02.281438 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.281391 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764bd57775-s4bs8" event={"ID":"93347c79-cfca-4053-946a-1d356b5d45e9","Type":"ContainerDied","Data":"7871f83445ffd9c26b24c09f7a39fbed97c13284dd5e10d957285c5fc7b30448"} Sep 07 12:43:02.281438 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.281438 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764bd57775-s4bs8" event={"ID":"93347c79-cfca-4053-946a-1d356b5d45e9","Type":"ContainerDied","Data":"b71a9ca65d130a6cf08974be1144c5d52104ab0f11d9d03803535f618dfbcf50"} Sep 07 12:43:02.289265 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.289210 2579 scope.go:117] "RemoveContainer" containerID="001b5a675e6e2d335477f93642f3b6dafef3031191291c220cfd4fdd06305c15" Sep 07 12:43:02.289605 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:02.289564 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"001b5a675e6e2d335477f93642f3b6dafef3031191291c220cfd4fdd06305c15\": container with ID starting with 001b5a675e6e2d335477f93642f3b6dafef3031191291c220cfd4fdd06305c15 not found: ID does not exist" containerID="001b5a675e6e2d335477f93642f3b6dafef3031191291c220cfd4fdd06305c15" Sep 07 12:43:02.289681 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.289617 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"001b5a675e6e2d335477f93642f3b6dafef3031191291c220cfd4fdd06305c15"} err="failed to get container status \"001b5a675e6e2d335477f93642f3b6dafef3031191291c220cfd4fdd06305c15\": rpc error: code = NotFound desc = could not find container \"001b5a675e6e2d335477f93642f3b6dafef3031191291c220cfd4fdd06305c15\": container with ID starting with 001b5a675e6e2d335477f93642f3b6dafef3031191291c220cfd4fdd06305c15 not found: ID does not exist" Sep 07 12:43:02.289681 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.289655 2579 scope.go:117] "RemoveContainer" containerID="7871f83445ffd9c26b24c09f7a39fbed97c13284dd5e10d957285c5fc7b30448" Sep 07 12:43:02.297391 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.297375 2579 scope.go:117] "RemoveContainer" containerID="7871f83445ffd9c26b24c09f7a39fbed97c13284dd5e10d957285c5fc7b30448" Sep 07 12:43:02.297684 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:02.297659 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7871f83445ffd9c26b24c09f7a39fbed97c13284dd5e10d957285c5fc7b30448\": container with ID starting with 7871f83445ffd9c26b24c09f7a39fbed97c13284dd5e10d957285c5fc7b30448 not found: ID does not exist" containerID="7871f83445ffd9c26b24c09f7a39fbed97c13284dd5e10d957285c5fc7b30448" Sep 07 12:43:02.297771 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.297686 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7871f83445ffd9c26b24c09f7a39fbed97c13284dd5e10d957285c5fc7b30448"} err="failed to get container status \"7871f83445ffd9c26b24c09f7a39fbed97c13284dd5e10d957285c5fc7b30448\": rpc error: code = NotFound desc = could not find container \"7871f83445ffd9c26b24c09f7a39fbed97c13284dd5e10d957285c5fc7b30448\": container with ID starting with 7871f83445ffd9c26b24c09f7a39fbed97c13284dd5e10d957285c5fc7b30448 not found: ID does not exist" Sep 07 12:43:02.302267 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.302222 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9848d959f-smqv6"] Sep 07 12:43:02.304136 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.304106 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9848d959f-smqv6"] Sep 07 12:43:02.314840 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.314773 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-764bd57775-s4bs8"] Sep 07 12:43:02.316592 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.316559 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-764bd57775-s4bs8"] Sep 07 12:43:02.347771 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.347740 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:43:02.425995 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:02.425964 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:43:03.659772 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:03.659743 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93347c79-cfca-4053-946a-1d356b5d45e9" path="/var/lib/kubelet/pods/93347c79-cfca-4053-946a-1d356b5d45e9/volumes" Sep 07 12:43:03.660128 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:03.660112 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb" path="/var/lib/kubelet/pods/fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb/volumes" Sep 07 12:43:15.540622 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:15.540545 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66c784cbfb-dxh9k" podUID="ec291469-f6d7-4a40-b27d-e65f693f6da3" containerName="console" containerID="cri-o://d6406bd1b589e0092ed2f9d19f288e3ab3355415fb71f213b6714acdbc37d53c" gracePeriod=15 Sep 07 12:43:15.808950 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:15.808887 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:43:15.969654 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:15.969616 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-service-ca\") pod \"ec291469-f6d7-4a40-b27d-e65f693f6da3\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " Sep 07 12:43:15.969791 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:15.969663 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-oauth-serving-cert\") pod \"ec291469-f6d7-4a40-b27d-e65f693f6da3\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " Sep 07 12:43:15.969791 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:15.969691 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-oauth-config\") pod \"ec291469-f6d7-4a40-b27d-e65f693f6da3\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " Sep 07 12:43:15.969791 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:15.969712 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-serving-cert\") pod \"ec291469-f6d7-4a40-b27d-e65f693f6da3\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " Sep 07 12:43:15.969791 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:15.969749 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tm6s9\" (UniqueName: \"kubernetes.io/projected/ec291469-f6d7-4a40-b27d-e65f693f6da3-kube-api-access-tm6s9\") pod \"ec291469-f6d7-4a40-b27d-e65f693f6da3\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " Sep 07 12:43:15.969791 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:15.969775 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-trusted-ca-bundle\") pod \"ec291469-f6d7-4a40-b27d-e65f693f6da3\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " Sep 07 12:43:15.970040 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:15.969833 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-config\") pod \"ec291469-f6d7-4a40-b27d-e65f693f6da3\" (UID: \"ec291469-f6d7-4a40-b27d-e65f693f6da3\") " Sep 07 12:43:15.970040 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:15.970014 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-service-ca" (OuterVolumeSpecName: "service-ca") pod "ec291469-f6d7-4a40-b27d-e65f693f6da3" (UID: "ec291469-f6d7-4a40-b27d-e65f693f6da3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:15.970143 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:15.970041 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ec291469-f6d7-4a40-b27d-e65f693f6da3" (UID: "ec291469-f6d7-4a40-b27d-e65f693f6da3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:15.970252 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:15.970225 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ec291469-f6d7-4a40-b27d-e65f693f6da3" (UID: "ec291469-f6d7-4a40-b27d-e65f693f6da3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:15.970370 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:15.970342 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-config" (OuterVolumeSpecName: "console-config") pod "ec291469-f6d7-4a40-b27d-e65f693f6da3" (UID: "ec291469-f6d7-4a40-b27d-e65f693f6da3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:15.972075 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:15.972048 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ec291469-f6d7-4a40-b27d-e65f693f6da3" (UID: "ec291469-f6d7-4a40-b27d-e65f693f6da3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:15.972158 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:15.972113 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec291469-f6d7-4a40-b27d-e65f693f6da3-kube-api-access-tm6s9" (OuterVolumeSpecName: "kube-api-access-tm6s9") pod "ec291469-f6d7-4a40-b27d-e65f693f6da3" (UID: "ec291469-f6d7-4a40-b27d-e65f693f6da3"). InnerVolumeSpecName "kube-api-access-tm6s9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:43:15.972201 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:15.972143 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ec291469-f6d7-4a40-b27d-e65f693f6da3" (UID: "ec291469-f6d7-4a40-b27d-e65f693f6da3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:16.070734 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.070660 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-config\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:16.070734 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.070684 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-service-ca\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:16.070734 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.070693 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-oauth-serving-cert\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:16.070734 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.070702 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-oauth-config\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:16.070734 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.070710 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec291469-f6d7-4a40-b27d-e65f693f6da3-console-serving-cert\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:16.070734 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.070717 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm6s9\" (UniqueName: \"kubernetes.io/projected/ec291469-f6d7-4a40-b27d-e65f693f6da3-kube-api-access-tm6s9\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:16.070734 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.070726 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec291469-f6d7-4a40-b27d-e65f693f6da3-trusted-ca-bundle\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:16.340386 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.340353 2579 generic.go:356] "Generic (PLEG): container finished" podID="ec291469-f6d7-4a40-b27d-e65f693f6da3" containerID="d6406bd1b589e0092ed2f9d19f288e3ab3355415fb71f213b6714acdbc37d53c" exitCode=0 Sep 07 12:43:16.340523 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.340404 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c784cbfb-dxh9k" Sep 07 12:43:16.340523 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.340439 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c784cbfb-dxh9k" event={"ID":"ec291469-f6d7-4a40-b27d-e65f693f6da3","Type":"ContainerDied","Data":"d6406bd1b589e0092ed2f9d19f288e3ab3355415fb71f213b6714acdbc37d53c"} Sep 07 12:43:16.340523 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.340503 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c784cbfb-dxh9k" event={"ID":"ec291469-f6d7-4a40-b27d-e65f693f6da3","Type":"ContainerDied","Data":"ad294a56d8072d436b2a6acc1e12443998d7cf54f06e1fc06f82b4b0eb7f55ee"} Sep 07 12:43:16.340672 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.340526 2579 scope.go:117] "RemoveContainer" containerID="d6406bd1b589e0092ed2f9d19f288e3ab3355415fb71f213b6714acdbc37d53c" Sep 07 12:43:16.342173 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.342151 2579 generic.go:356] "Generic (PLEG): container finished" podID="070684d2-bd22-4f70-93a2-9dff87ad479d" containerID="5efe8b2aff7ff39d650c208bf525e39107302577a804337d9a88ef5a0cf04b74" exitCode=0 Sep 07 12:43:16.342271 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.342190 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" event={"ID":"070684d2-bd22-4f70-93a2-9dff87ad479d","Type":"ContainerDied","Data":"5efe8b2aff7ff39d650c208bf525e39107302577a804337d9a88ef5a0cf04b74"} Sep 07 12:43:16.342496 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.342484 2579 scope.go:117] "RemoveContainer" containerID="5efe8b2aff7ff39d650c208bf525e39107302577a804337d9a88ef5a0cf04b74" Sep 07 12:43:16.378905 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.378882 2579 scope.go:117] "RemoveContainer" containerID="d6406bd1b589e0092ed2f9d19f288e3ab3355415fb71f213b6714acdbc37d53c" Sep 07 12:43:16.379419 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:16.379396 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6406bd1b589e0092ed2f9d19f288e3ab3355415fb71f213b6714acdbc37d53c\": container with ID starting with d6406bd1b589e0092ed2f9d19f288e3ab3355415fb71f213b6714acdbc37d53c not found: ID does not exist" containerID="d6406bd1b589e0092ed2f9d19f288e3ab3355415fb71f213b6714acdbc37d53c" Sep 07 12:43:16.379523 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.379429 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6406bd1b589e0092ed2f9d19f288e3ab3355415fb71f213b6714acdbc37d53c"} err="failed to get container status \"d6406bd1b589e0092ed2f9d19f288e3ab3355415fb71f213b6714acdbc37d53c\": rpc error: code = NotFound desc = could not find container \"d6406bd1b589e0092ed2f9d19f288e3ab3355415fb71f213b6714acdbc37d53c\": container with ID starting with d6406bd1b589e0092ed2f9d19f288e3ab3355415fb71f213b6714acdbc37d53c not found: ID does not exist" Sep 07 12:43:16.414621 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.414543 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c784cbfb-dxh9k"] Sep 07 12:43:16.416701 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:16.416676 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66c784cbfb-dxh9k"] Sep 07 12:43:17.351247 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:17.351214 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-jn4hz" event={"ID":"070684d2-bd22-4f70-93a2-9dff87ad479d","Type":"ContainerStarted","Data":"0285e0a328b10364ff7d96b0542b1068b82481cbe8f75ec823bc62e527b92f2f"} Sep 07 12:43:17.399768 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:17.399740 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:43:17.404014 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:17.403987 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-fbdd49684-gwjsc" Sep 07 12:43:17.409634 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:17.409606 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:43:17.504447 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:17.504418 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:43:17.660059 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:17.660027 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec291469-f6d7-4a40-b27d-e65f693f6da3" path="/var/lib/kubelet/pods/ec291469-f6d7-4a40-b27d-e65f693f6da3/volumes" Sep 07 12:43:39.278233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:39.278138 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:39.297344 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:39.297317 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:39.459541 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:39.459515 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:52.236136 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:52.236107 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:43:52.660271 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:52.660243 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:43:53.386980 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:53.386936 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:43:53.387568 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:53.387537 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="alertmanager" containerID="cri-o://e522485ec71b897d642e381801d178643bdc8a742fbabec96a9b8ccc3cf0de06" gracePeriod=120 Sep 07 12:43:53.388710 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:53.387820 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="kube-rbac-proxy" containerID="cri-o://2b11f95605e393f68a36270087c5075a4a19f334d7ef6134f466240b8f5f95e3" gracePeriod=120 Sep 07 12:43:53.388710 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:53.387962 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="kube-rbac-proxy-web" containerID="cri-o://f469b2a3cd76f219a380b500765afc39ca0ee3d448455fe492d158df00a06452" gracePeriod=120 Sep 07 12:43:53.388710 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:53.387998 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="prom-label-proxy" containerID="cri-o://553f77d84a30f125ba96aca7d7a8d733605d9aa6a3d3bf324d721cfe1fdae9a4" gracePeriod=120 Sep 07 12:43:53.388710 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:53.388085 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="config-reloader" containerID="cri-o://df0c0c9cb1fe1c117e8a1092e4e53e4b1ccbce59f4a6af1101ac8807d00116e5" gracePeriod=120 Sep 07 12:43:53.388710 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:53.388111 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="kube-rbac-proxy-metric" containerID="cri-o://b4af1854b19cc4636830b42a5f2d97844562cd06be38b799b8fb3b76f178a61f" gracePeriod=120 Sep 07 12:43:54.506078 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.506052 2579 generic.go:356] "Generic (PLEG): container finished" podID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerID="553f77d84a30f125ba96aca7d7a8d733605d9aa6a3d3bf324d721cfe1fdae9a4" exitCode=0 Sep 07 12:43:54.506299 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.506079 2579 generic.go:356] "Generic (PLEG): container finished" podID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerID="b4af1854b19cc4636830b42a5f2d97844562cd06be38b799b8fb3b76f178a61f" exitCode=0 Sep 07 12:43:54.506299 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.506086 2579 generic.go:356] "Generic (PLEG): container finished" podID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerID="2b11f95605e393f68a36270087c5075a4a19f334d7ef6134f466240b8f5f95e3" exitCode=0 Sep 07 12:43:54.506299 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.506092 2579 generic.go:356] "Generic (PLEG): container finished" podID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerID="df0c0c9cb1fe1c117e8a1092e4e53e4b1ccbce59f4a6af1101ac8807d00116e5" exitCode=0 Sep 07 12:43:54.506299 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.506097 2579 generic.go:356] "Generic (PLEG): container finished" podID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerID="e522485ec71b897d642e381801d178643bdc8a742fbabec96a9b8ccc3cf0de06" exitCode=0 Sep 07 12:43:54.506299 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.506131 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be343c94-049c-482e-b3c1-dbf1f6ce0eef","Type":"ContainerDied","Data":"553f77d84a30f125ba96aca7d7a8d733605d9aa6a3d3bf324d721cfe1fdae9a4"} Sep 07 12:43:54.506299 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.506216 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be343c94-049c-482e-b3c1-dbf1f6ce0eef","Type":"ContainerDied","Data":"b4af1854b19cc4636830b42a5f2d97844562cd06be38b799b8fb3b76f178a61f"} Sep 07 12:43:54.506299 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.506295 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be343c94-049c-482e-b3c1-dbf1f6ce0eef","Type":"ContainerDied","Data":"2b11f95605e393f68a36270087c5075a4a19f334d7ef6134f466240b8f5f95e3"} Sep 07 12:43:54.506609 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.506347 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be343c94-049c-482e-b3c1-dbf1f6ce0eef","Type":"ContainerDied","Data":"df0c0c9cb1fe1c117e8a1092e4e53e4b1ccbce59f4a6af1101ac8807d00116e5"} Sep 07 12:43:54.506609 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.506387 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be343c94-049c-482e-b3c1-dbf1f6ce0eef","Type":"ContainerDied","Data":"e522485ec71b897d642e381801d178643bdc8a742fbabec96a9b8ccc3cf0de06"} Sep 07 12:43:54.636606 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.636567 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:54.793560 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.793484 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be343c94-049c-482e-b3c1-dbf1f6ce0eef-metrics-client-ca\") pod \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " Sep 07 12:43:54.793560 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.793523 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-main-tls\") pod \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " Sep 07 12:43:54.793790 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.793564 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/be343c94-049c-482e-b3c1-dbf1f6ce0eef-alertmanager-main-db\") pod \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " Sep 07 12:43:54.793790 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.793718 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-cluster-tls-config\") pod \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " Sep 07 12:43:54.793790 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.793747 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-web-config\") pod \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " Sep 07 12:43:54.793946 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.793796 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy-web\") pod \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " Sep 07 12:43:54.793946 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.793821 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be343c94-049c-482e-b3c1-dbf1f6ce0eef-alertmanager-trusted-ca-bundle\") pod \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " Sep 07 12:43:54.793946 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.793845 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy\") pod \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " Sep 07 12:43:54.793946 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.793891 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be343c94-049c-482e-b3c1-dbf1f6ce0eef-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "be343c94-049c-482e-b3c1-dbf1f6ce0eef" (UID: "be343c94-049c-482e-b3c1-dbf1f6ce0eef"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:43:54.794160 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.793963 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be343c94-049c-482e-b3c1-dbf1f6ce0eef-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "be343c94-049c-482e-b3c1-dbf1f6ce0eef" (UID: "be343c94-049c-482e-b3c1-dbf1f6ce0eef"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:54.794160 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.794007 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be343c94-049c-482e-b3c1-dbf1f6ce0eef-tls-assets\") pod \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " Sep 07 12:43:54.794160 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.794043 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " Sep 07 12:43:54.794463 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.794175 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpz9p\" (UniqueName: \"kubernetes.io/projected/be343c94-049c-482e-b3c1-dbf1f6ce0eef-kube-api-access-zpz9p\") pod \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " Sep 07 12:43:54.794463 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.794209 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-config-volume\") pod \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " Sep 07 12:43:54.794463 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.794241 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be343c94-049c-482e-b3c1-dbf1f6ce0eef-config-out\") pod \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\" (UID: \"be343c94-049c-482e-b3c1-dbf1f6ce0eef\") " Sep 07 12:43:54.794463 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.794276 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be343c94-049c-482e-b3c1-dbf1f6ce0eef-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "be343c94-049c-482e-b3c1-dbf1f6ce0eef" (UID: "be343c94-049c-482e-b3c1-dbf1f6ce0eef"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:54.794693 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.794530 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/be343c94-049c-482e-b3c1-dbf1f6ce0eef-alertmanager-main-db\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:54.794693 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.794551 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be343c94-049c-482e-b3c1-dbf1f6ce0eef-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:54.794693 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.794568 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be343c94-049c-482e-b3c1-dbf1f6ce0eef-metrics-client-ca\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:54.796456 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.796172 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "be343c94-049c-482e-b3c1-dbf1f6ce0eef" (UID: "be343c94-049c-482e-b3c1-dbf1f6ce0eef"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:54.797553 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.797028 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "be343c94-049c-482e-b3c1-dbf1f6ce0eef" (UID: "be343c94-049c-482e-b3c1-dbf1f6ce0eef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:54.797553 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.797044 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be343c94-049c-482e-b3c1-dbf1f6ce0eef-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "be343c94-049c-482e-b3c1-dbf1f6ce0eef" (UID: "be343c94-049c-482e-b3c1-dbf1f6ce0eef"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:43:54.797868 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.797838 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be343c94-049c-482e-b3c1-dbf1f6ce0eef-config-out" (OuterVolumeSpecName: "config-out") pod "be343c94-049c-482e-b3c1-dbf1f6ce0eef" (UID: "be343c94-049c-482e-b3c1-dbf1f6ce0eef"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:43:54.797950 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.797898 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "be343c94-049c-482e-b3c1-dbf1f6ce0eef" (UID: "be343c94-049c-482e-b3c1-dbf1f6ce0eef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:54.798014 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.797985 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be343c94-049c-482e-b3c1-dbf1f6ce0eef-kube-api-access-zpz9p" (OuterVolumeSpecName: "kube-api-access-zpz9p") pod "be343c94-049c-482e-b3c1-dbf1f6ce0eef" (UID: "be343c94-049c-482e-b3c1-dbf1f6ce0eef"). InnerVolumeSpecName "kube-api-access-zpz9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:43:54.798337 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.798314 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-config-volume" (OuterVolumeSpecName: "config-volume") pod "be343c94-049c-482e-b3c1-dbf1f6ce0eef" (UID: "be343c94-049c-482e-b3c1-dbf1f6ce0eef"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:54.798795 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.798776 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "be343c94-049c-482e-b3c1-dbf1f6ce0eef" (UID: "be343c94-049c-482e-b3c1-dbf1f6ce0eef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:54.801412 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.801387 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "be343c94-049c-482e-b3c1-dbf1f6ce0eef" (UID: "be343c94-049c-482e-b3c1-dbf1f6ce0eef"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:54.808429 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.808410 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-web-config" (OuterVolumeSpecName: "web-config") pod "be343c94-049c-482e-b3c1-dbf1f6ce0eef" (UID: "be343c94-049c-482e-b3c1-dbf1f6ce0eef"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:54.895451 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.895428 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-cluster-tls-config\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:54.895531 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.895467 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-web-config\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:54.895531 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.895479 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:54.895531 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.895489 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:54.895531 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.895497 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/be343c94-049c-482e-b3c1-dbf1f6ce0eef-tls-assets\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:54.895531 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.895506 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:54.895531 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.895514 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpz9p\" (UniqueName: \"kubernetes.io/projected/be343c94-049c-482e-b3c1-dbf1f6ce0eef-kube-api-access-zpz9p\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:54.895531 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.895523 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-config-volume\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:54.895531 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.895531 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/be343c94-049c-482e-b3c1-dbf1f6ce0eef-config-out\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:54.895833 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:54.895539 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/be343c94-049c-482e-b3c1-dbf1f6ce0eef-secret-alertmanager-main-tls\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:55.513501 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.513468 2579 generic.go:356] "Generic (PLEG): container finished" podID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerID="f469b2a3cd76f219a380b500765afc39ca0ee3d448455fe492d158df00a06452" exitCode=0 Sep 07 12:43:55.513846 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.513550 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be343c94-049c-482e-b3c1-dbf1f6ce0eef","Type":"ContainerDied","Data":"f469b2a3cd76f219a380b500765afc39ca0ee3d448455fe492d158df00a06452"} Sep 07 12:43:55.513846 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.513645 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"be343c94-049c-482e-b3c1-dbf1f6ce0eef","Type":"ContainerDied","Data":"308aac9ffd82902ccfcb2d467bd95b055ccb9cbc8a4175779e8f7b1d1ff8462e"} Sep 07 12:43:55.513846 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.513560 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.513846 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.513689 2579 scope.go:117] "RemoveContainer" containerID="553f77d84a30f125ba96aca7d7a8d733605d9aa6a3d3bf324d721cfe1fdae9a4" Sep 07 12:43:55.521912 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.521888 2579 scope.go:117] "RemoveContainer" containerID="b4af1854b19cc4636830b42a5f2d97844562cd06be38b799b8fb3b76f178a61f" Sep 07 12:43:55.528592 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.528562 2579 scope.go:117] "RemoveContainer" containerID="2b11f95605e393f68a36270087c5075a4a19f334d7ef6134f466240b8f5f95e3" Sep 07 12:43:55.535153 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.535130 2579 scope.go:117] "RemoveContainer" containerID="f469b2a3cd76f219a380b500765afc39ca0ee3d448455fe492d158df00a06452" Sep 07 12:43:55.541697 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.541681 2579 scope.go:117] "RemoveContainer" containerID="df0c0c9cb1fe1c117e8a1092e4e53e4b1ccbce59f4a6af1101ac8807d00116e5" Sep 07 12:43:55.548757 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.548733 2579 scope.go:117] "RemoveContainer" containerID="e522485ec71b897d642e381801d178643bdc8a742fbabec96a9b8ccc3cf0de06" Sep 07 12:43:55.549444 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.549423 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:43:55.555080 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.555049 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:43:55.556552 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.556539 2579 scope.go:117] "RemoveContainer" containerID="3616ad77d9669ec2465874f97e82258ae9b83a06f7a59b58918d111de1b7fb25" Sep 07 12:43:55.563325 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.563307 2579 scope.go:117] "RemoveContainer" containerID="553f77d84a30f125ba96aca7d7a8d733605d9aa6a3d3bf324d721cfe1fdae9a4" Sep 07 12:43:55.563597 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:55.563559 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"553f77d84a30f125ba96aca7d7a8d733605d9aa6a3d3bf324d721cfe1fdae9a4\": container with ID starting with 553f77d84a30f125ba96aca7d7a8d733605d9aa6a3d3bf324d721cfe1fdae9a4 not found: ID does not exist" containerID="553f77d84a30f125ba96aca7d7a8d733605d9aa6a3d3bf324d721cfe1fdae9a4" Sep 07 12:43:55.563651 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.563612 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"553f77d84a30f125ba96aca7d7a8d733605d9aa6a3d3bf324d721cfe1fdae9a4"} err="failed to get container status \"553f77d84a30f125ba96aca7d7a8d733605d9aa6a3d3bf324d721cfe1fdae9a4\": rpc error: code = NotFound desc = could not find container \"553f77d84a30f125ba96aca7d7a8d733605d9aa6a3d3bf324d721cfe1fdae9a4\": container with ID starting with 553f77d84a30f125ba96aca7d7a8d733605d9aa6a3d3bf324d721cfe1fdae9a4 not found: ID does not exist" Sep 07 12:43:55.563651 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.563629 2579 scope.go:117] "RemoveContainer" containerID="b4af1854b19cc4636830b42a5f2d97844562cd06be38b799b8fb3b76f178a61f" Sep 07 12:43:55.563869 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:55.563855 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4af1854b19cc4636830b42a5f2d97844562cd06be38b799b8fb3b76f178a61f\": container with ID starting with b4af1854b19cc4636830b42a5f2d97844562cd06be38b799b8fb3b76f178a61f not found: ID does not exist" containerID="b4af1854b19cc4636830b42a5f2d97844562cd06be38b799b8fb3b76f178a61f" Sep 07 12:43:55.563908 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.563872 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4af1854b19cc4636830b42a5f2d97844562cd06be38b799b8fb3b76f178a61f"} err="failed to get container status \"b4af1854b19cc4636830b42a5f2d97844562cd06be38b799b8fb3b76f178a61f\": rpc error: code = NotFound desc = could not find container \"b4af1854b19cc4636830b42a5f2d97844562cd06be38b799b8fb3b76f178a61f\": container with ID starting with b4af1854b19cc4636830b42a5f2d97844562cd06be38b799b8fb3b76f178a61f not found: ID does not exist" Sep 07 12:43:55.563908 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.563885 2579 scope.go:117] "RemoveContainer" containerID="2b11f95605e393f68a36270087c5075a4a19f334d7ef6134f466240b8f5f95e3" Sep 07 12:43:55.564108 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:55.564092 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b11f95605e393f68a36270087c5075a4a19f334d7ef6134f466240b8f5f95e3\": container with ID starting with 2b11f95605e393f68a36270087c5075a4a19f334d7ef6134f466240b8f5f95e3 not found: ID does not exist" containerID="2b11f95605e393f68a36270087c5075a4a19f334d7ef6134f466240b8f5f95e3" Sep 07 12:43:55.564160 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.564114 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b11f95605e393f68a36270087c5075a4a19f334d7ef6134f466240b8f5f95e3"} err="failed to get container status \"2b11f95605e393f68a36270087c5075a4a19f334d7ef6134f466240b8f5f95e3\": rpc error: code = NotFound desc = could not find container \"2b11f95605e393f68a36270087c5075a4a19f334d7ef6134f466240b8f5f95e3\": container with ID starting with 2b11f95605e393f68a36270087c5075a4a19f334d7ef6134f466240b8f5f95e3 not found: ID does not exist" Sep 07 12:43:55.564160 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.564131 2579 scope.go:117] "RemoveContainer" containerID="f469b2a3cd76f219a380b500765afc39ca0ee3d448455fe492d158df00a06452" Sep 07 12:43:55.564372 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:55.564355 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f469b2a3cd76f219a380b500765afc39ca0ee3d448455fe492d158df00a06452\": container with ID starting with f469b2a3cd76f219a380b500765afc39ca0ee3d448455fe492d158df00a06452 not found: ID does not exist" containerID="f469b2a3cd76f219a380b500765afc39ca0ee3d448455fe492d158df00a06452" Sep 07 12:43:55.564415 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.564376 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f469b2a3cd76f219a380b500765afc39ca0ee3d448455fe492d158df00a06452"} err="failed to get container status \"f469b2a3cd76f219a380b500765afc39ca0ee3d448455fe492d158df00a06452\": rpc error: code = NotFound desc = could not find container \"f469b2a3cd76f219a380b500765afc39ca0ee3d448455fe492d158df00a06452\": container with ID starting with f469b2a3cd76f219a380b500765afc39ca0ee3d448455fe492d158df00a06452 not found: ID does not exist" Sep 07 12:43:55.564415 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.564391 2579 scope.go:117] "RemoveContainer" containerID="df0c0c9cb1fe1c117e8a1092e4e53e4b1ccbce59f4a6af1101ac8807d00116e5" Sep 07 12:43:55.564634 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:55.564616 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df0c0c9cb1fe1c117e8a1092e4e53e4b1ccbce59f4a6af1101ac8807d00116e5\": container with ID starting with df0c0c9cb1fe1c117e8a1092e4e53e4b1ccbce59f4a6af1101ac8807d00116e5 not found: ID does not exist" containerID="df0c0c9cb1fe1c117e8a1092e4e53e4b1ccbce59f4a6af1101ac8807d00116e5" Sep 07 12:43:55.564693 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.564641 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df0c0c9cb1fe1c117e8a1092e4e53e4b1ccbce59f4a6af1101ac8807d00116e5"} err="failed to get container status \"df0c0c9cb1fe1c117e8a1092e4e53e4b1ccbce59f4a6af1101ac8807d00116e5\": rpc error: code = NotFound desc = could not find container \"df0c0c9cb1fe1c117e8a1092e4e53e4b1ccbce59f4a6af1101ac8807d00116e5\": container with ID starting with df0c0c9cb1fe1c117e8a1092e4e53e4b1ccbce59f4a6af1101ac8807d00116e5 not found: ID does not exist" Sep 07 12:43:55.564693 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.564661 2579 scope.go:117] "RemoveContainer" containerID="e522485ec71b897d642e381801d178643bdc8a742fbabec96a9b8ccc3cf0de06" Sep 07 12:43:55.564908 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:55.564892 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e522485ec71b897d642e381801d178643bdc8a742fbabec96a9b8ccc3cf0de06\": container with ID starting with e522485ec71b897d642e381801d178643bdc8a742fbabec96a9b8ccc3cf0de06 not found: ID does not exist" containerID="e522485ec71b897d642e381801d178643bdc8a742fbabec96a9b8ccc3cf0de06" Sep 07 12:43:55.564945 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.564912 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e522485ec71b897d642e381801d178643bdc8a742fbabec96a9b8ccc3cf0de06"} err="failed to get container status \"e522485ec71b897d642e381801d178643bdc8a742fbabec96a9b8ccc3cf0de06\": rpc error: code = NotFound desc = could not find container \"e522485ec71b897d642e381801d178643bdc8a742fbabec96a9b8ccc3cf0de06\": container with ID starting with e522485ec71b897d642e381801d178643bdc8a742fbabec96a9b8ccc3cf0de06 not found: ID does not exist" Sep 07 12:43:55.564945 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.564923 2579 scope.go:117] "RemoveContainer" containerID="3616ad77d9669ec2465874f97e82258ae9b83a06f7a59b58918d111de1b7fb25" Sep 07 12:43:55.565154 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:55.565137 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3616ad77d9669ec2465874f97e82258ae9b83a06f7a59b58918d111de1b7fb25\": container with ID starting with 3616ad77d9669ec2465874f97e82258ae9b83a06f7a59b58918d111de1b7fb25 not found: ID does not exist" containerID="3616ad77d9669ec2465874f97e82258ae9b83a06f7a59b58918d111de1b7fb25" Sep 07 12:43:55.565193 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.565178 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3616ad77d9669ec2465874f97e82258ae9b83a06f7a59b58918d111de1b7fb25"} err="failed to get container status \"3616ad77d9669ec2465874f97e82258ae9b83a06f7a59b58918d111de1b7fb25\": rpc error: code = NotFound desc = could not find container \"3616ad77d9669ec2465874f97e82258ae9b83a06f7a59b58918d111de1b7fb25\": container with ID starting with 3616ad77d9669ec2465874f97e82258ae9b83a06f7a59b58918d111de1b7fb25 not found: ID does not exist" Sep 07 12:43:55.624087 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624061 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:43:55.624449 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624432 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb" containerName="console" Sep 07 12:43:55.624536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624453 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb" containerName="console" Sep 07 12:43:55.624536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624470 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="kube-rbac-proxy-web" Sep 07 12:43:55.624536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624479 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="kube-rbac-proxy-web" Sep 07 12:43:55.624536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624490 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="init-config-reloader" Sep 07 12:43:55.624536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624498 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="init-config-reloader" Sep 07 12:43:55.624536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624508 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="kube-rbac-proxy" Sep 07 12:43:55.624536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624516 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="kube-rbac-proxy" Sep 07 12:43:55.624536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624526 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="kube-rbac-proxy-metric" Sep 07 12:43:55.624536 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624533 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="kube-rbac-proxy-metric" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624543 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="prom-label-proxy" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624551 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="prom-label-proxy" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624563 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="alertmanager" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624587 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="alertmanager" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624596 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="config-reloader" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624603 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="config-reloader" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624620 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93347c79-cfca-4053-946a-1d356b5d45e9" containerName="registry" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624627 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="93347c79-cfca-4053-946a-1d356b5d45e9" containerName="registry" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624640 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec291469-f6d7-4a40-b27d-e65f693f6da3" containerName="console" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624648 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec291469-f6d7-4a40-b27d-e65f693f6da3" containerName="console" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624736 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb21cdb4-dcfa-4f40-9fe0-1903d68fcedb" containerName="console" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624750 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="kube-rbac-proxy-web" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624761 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="config-reloader" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624771 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="prom-label-proxy" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624781 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="kube-rbac-proxy-metric" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624789 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec291469-f6d7-4a40-b27d-e65f693f6da3" containerName="console" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624796 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="kube-rbac-proxy" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624803 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="93347c79-cfca-4053-946a-1d356b5d45e9" containerName="registry" Sep 07 12:43:55.624970 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.624810 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" containerName="alertmanager" Sep 07 12:43:55.628623 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.628605 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.634697 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.634665 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 07 12:43:55.634809 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.634758 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 07 12:43:55.634979 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.634758 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 07 12:43:55.634979 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.634758 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 07 12:43:55.635281 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.635264 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 07 12:43:55.635281 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.635274 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 07 12:43:55.638609 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.638590 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bwwnm\"" Sep 07 12:43:55.638702 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.638596 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 07 12:43:55.638784 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.638770 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 07 12:43:55.644804 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.644735 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 07 12:43:55.660157 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.660125 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be343c94-049c-482e-b3c1-dbf1f6ce0eef" path="/var/lib/kubelet/pods/be343c94-049c-482e-b3c1-dbf1f6ce0eef/volumes" Sep 07 12:43:55.676037 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.676011 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:43:55.700757 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.700734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b449f43-4c7f-41ee-8864-6178bbd6ff45-config-out\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.700836 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.700762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b449f43-4c7f-41ee-8864-6178bbd6ff45-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.700836 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.700779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-config-volume\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.700836 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.700795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.700836 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.700809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b449f43-4c7f-41ee-8864-6178bbd6ff45-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.700966 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.700921 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.700966 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.700950 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.701027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.700964 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.701027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.700991 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b449f43-4c7f-41ee-8864-6178bbd6ff45-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.701027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.701023 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.701111 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.701038 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjthb\" (UniqueName: \"kubernetes.io/projected/9b449f43-4c7f-41ee-8864-6178bbd6ff45-kube-api-access-mjthb\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.701111 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.701060 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b449f43-4c7f-41ee-8864-6178bbd6ff45-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.701111 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.701088 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-web-config\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.802023 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.801951 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b449f43-4c7f-41ee-8864-6178bbd6ff45-config-out\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.802023 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.801999 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b449f43-4c7f-41ee-8864-6178bbd6ff45-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.802214 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.802023 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-config-volume\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.802214 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.802043 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.802214 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.802170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b449f43-4c7f-41ee-8864-6178bbd6ff45-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.802369 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.802303 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.802369 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.802340 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.802468 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.802366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.802468 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.802416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b449f43-4c7f-41ee-8864-6178bbd6ff45-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.802468 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.802452 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.802666 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.802475 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjthb\" (UniqueName: \"kubernetes.io/projected/9b449f43-4c7f-41ee-8864-6178bbd6ff45-kube-api-access-mjthb\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.802666 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.802510 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b449f43-4c7f-41ee-8864-6178bbd6ff45-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.802666 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.802538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-web-config\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.802983 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.802860 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b449f43-4c7f-41ee-8864-6178bbd6ff45-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.803104 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.803080 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9b449f43-4c7f-41ee-8864-6178bbd6ff45-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.804014 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.803983 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b449f43-4c7f-41ee-8864-6178bbd6ff45-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.805183 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.804758 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-config-volume\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.805183 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.804842 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.805183 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.804998 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9b449f43-4c7f-41ee-8864-6178bbd6ff45-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.805183 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.805028 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9b449f43-4c7f-41ee-8864-6178bbd6ff45-config-out\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.805882 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.805691 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.806630 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.806608 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-web-config\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.806701 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.806638 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.807001 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.806985 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.807403 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.807385 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9b449f43-4c7f-41ee-8864-6178bbd6ff45-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.816394 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.816372 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjthb\" (UniqueName: \"kubernetes.io/projected/9b449f43-4c7f-41ee-8864-6178bbd6ff45-kube-api-access-mjthb\") pod \"alertmanager-main-0\" (UID: \"9b449f43-4c7f-41ee-8864-6178bbd6ff45\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:55.937722 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:55.937691 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:43:56.270300 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:56.270267 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:43:56.274659 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:43:56.274636 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b449f43_4c7f_41ee_8864_6178bbd6ff45.slice/crio-f322e28068f0a73e706770ee16965eb24b3a54c6c2f4893609aea5a3df55847c WatchSource:0}: Error finding container f322e28068f0a73e706770ee16965eb24b3a54c6c2f4893609aea5a3df55847c: Status 404 returned error can't find the container with id f322e28068f0a73e706770ee16965eb24b3a54c6c2f4893609aea5a3df55847c Sep 07 12:43:56.519878 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:56.519842 2579 generic.go:356] "Generic (PLEG): container finished" podID="9b449f43-4c7f-41ee-8864-6178bbd6ff45" containerID="1d7584a2dba830cddba25d6ba7e10d42fbc6d01bd957696d4bb322f7de0cc93f" exitCode=0 Sep 07 12:43:56.520352 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:56.519919 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b449f43-4c7f-41ee-8864-6178bbd6ff45","Type":"ContainerDied","Data":"1d7584a2dba830cddba25d6ba7e10d42fbc6d01bd957696d4bb322f7de0cc93f"} Sep 07 12:43:56.520352 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:56.519984 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b449f43-4c7f-41ee-8864-6178bbd6ff45","Type":"ContainerStarted","Data":"f322e28068f0a73e706770ee16965eb24b3a54c6c2f4893609aea5a3df55847c"} Sep 07 12:43:57.530616 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.530565 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b449f43-4c7f-41ee-8864-6178bbd6ff45","Type":"ContainerStarted","Data":"4d59282403bc25bb91b6920dd7cdc01b28ea5649efa686db64bdefe5ff6c97e7"} Sep 07 12:43:57.531052 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.530644 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b449f43-4c7f-41ee-8864-6178bbd6ff45","Type":"ContainerStarted","Data":"3f3301a735dd0f8df1959aa8747959bb978b1c445656f9982ae283fdcafad0b4"} Sep 07 12:43:57.531052 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.530672 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b449f43-4c7f-41ee-8864-6178bbd6ff45","Type":"ContainerStarted","Data":"6e916421c7923ff642f0747d64cceeec4a420be299cbcacea52579d9383d8bd4"} Sep 07 12:43:57.531052 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.530694 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b449f43-4c7f-41ee-8864-6178bbd6ff45","Type":"ContainerStarted","Data":"9db242f302c866eb1f991bdd9149b3910a02082acfa75bd3feeca18a3e86b91c"} Sep 07 12:43:57.531052 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.530718 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b449f43-4c7f-41ee-8864-6178bbd6ff45","Type":"ContainerStarted","Data":"429db7a2b18b84772637b127bb9d00e28517c5020c34cdb07d1f7268cc11d47b"} Sep 07 12:43:57.531052 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.530740 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9b449f43-4c7f-41ee-8864-6178bbd6ff45","Type":"ContainerStarted","Data":"317d2973652d26ad445a75a9d1e41b98b64b489fb452a45e13c63621b4485311"} Sep 07 12:43:57.549685 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.549647 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt"] Sep 07 12:43:57.556039 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.554060 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.574026 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.574006 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 07 12:43:57.574132 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.574048 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 07 12:43:57.574132 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.574121 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 07 12:43:57.574352 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.574338 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2rm7l\"" Sep 07 12:43:57.578109 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.578092 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 07 12:43:57.578194 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.578098 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 07 12:43:57.593016 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.592987 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 07 12:43:57.597100 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.597072 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt"] Sep 07 12:43:57.650315 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.650262 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6346823710000002 podStartE2EDuration="2.650247337s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.564966ms" isStatefulPod=false podCreationTimestamp="2026-09-07 12:43:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:43:57.649823958 +0000 UTC m=+194.519567370" watchObservedRunningTime="2026-09-07 12:43:57.650247337 +0000 UTC m=+194.519990723" Sep 07 12:43:57.718858 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.718814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe2bc492-9fce-4904-91dc-085bff10caa0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.719023 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.718868 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe2bc492-9fce-4904-91dc-085bff10caa0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.719023 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.718909 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fe2bc492-9fce-4904-91dc-085bff10caa0-federate-client-tls\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.719023 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.718986 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k92k6\" (UniqueName: \"kubernetes.io/projected/fe2bc492-9fce-4904-91dc-085bff10caa0-kube-api-access-k92k6\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.719171 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.719022 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fe2bc492-9fce-4904-91dc-085bff10caa0-telemeter-client-tls\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.719171 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.719087 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fe2bc492-9fce-4904-91dc-085bff10caa0-secret-telemeter-client\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.719171 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.719123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe2bc492-9fce-4904-91dc-085bff10caa0-serving-certs-ca-bundle\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.719171 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.719156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe2bc492-9fce-4904-91dc-085bff10caa0-metrics-client-ca\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.819950 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.819872 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe2bc492-9fce-4904-91dc-085bff10caa0-serving-certs-ca-bundle\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.819950 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.819908 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe2bc492-9fce-4904-91dc-085bff10caa0-metrics-client-ca\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.820153 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.820021 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe2bc492-9fce-4904-91dc-085bff10caa0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.820153 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.820074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe2bc492-9fce-4904-91dc-085bff10caa0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.820153 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.820121 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fe2bc492-9fce-4904-91dc-085bff10caa0-federate-client-tls\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.820315 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.820169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k92k6\" (UniqueName: \"kubernetes.io/projected/fe2bc492-9fce-4904-91dc-085bff10caa0-kube-api-access-k92k6\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.820315 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.820201 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fe2bc492-9fce-4904-91dc-085bff10caa0-telemeter-client-tls\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.820315 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.820293 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fe2bc492-9fce-4904-91dc-085bff10caa0-secret-telemeter-client\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.820732 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.820704 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe2bc492-9fce-4904-91dc-085bff10caa0-metrics-client-ca\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.820841 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.820779 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe2bc492-9fce-4904-91dc-085bff10caa0-serving-certs-ca-bundle\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.821122 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.821099 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe2bc492-9fce-4904-91dc-085bff10caa0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.822448 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.822428 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe2bc492-9fce-4904-91dc-085bff10caa0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.822630 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.822609 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fe2bc492-9fce-4904-91dc-085bff10caa0-federate-client-tls\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.823227 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.823203 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fe2bc492-9fce-4904-91dc-085bff10caa0-telemeter-client-tls\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.823227 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.823223 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fe2bc492-9fce-4904-91dc-085bff10caa0-secret-telemeter-client\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.833055 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.833036 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k92k6\" (UniqueName: \"kubernetes.io/projected/fe2bc492-9fce-4904-91dc-085bff10caa0-kube-api-access-k92k6\") pod \"telemeter-client-59fbc7df7b-wcjtt\" (UID: \"fe2bc492-9fce-4904-91dc-085bff10caa0\") " pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:57.865044 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:57.865018 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" Sep 07 12:43:58.044788 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.044757 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:43:58.045096 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.045059 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="prometheus" containerID="cri-o://6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621" gracePeriod=600 Sep 07 12:43:58.045096 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.045077 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="kube-rbac-proxy" containerID="cri-o://a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f" gracePeriod=600 Sep 07 12:43:58.045300 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.045122 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f" gracePeriod=600 Sep 07 12:43:58.045300 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.045120 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="kube-rbac-proxy-web" containerID="cri-o://5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86" gracePeriod=600 Sep 07 12:43:58.045300 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.045143 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="config-reloader" containerID="cri-o://52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852" gracePeriod=600 Sep 07 12:43:58.045300 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.045105 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="thanos-sidecar" containerID="cri-o://197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2" gracePeriod=600 Sep 07 12:43:58.191746 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.191715 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt"] Sep 07 12:43:58.195015 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:43:58.194989 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe2bc492_9fce_4904_91dc_085bff10caa0.slice/crio-3dc30f4ec66310b47cfdc1edd3946ecd14f970800268b6896f3beb0f4d68db25 WatchSource:0}: Error finding container 3dc30f4ec66310b47cfdc1edd3946ecd14f970800268b6896f3beb0f4d68db25: Status 404 returned error can't find the container with id 3dc30f4ec66310b47cfdc1edd3946ecd14f970800268b6896f3beb0f4d68db25 Sep 07 12:43:58.284506 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.284484 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.425995 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.425968 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.426167 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.426001 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-metrics-client-certs\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.426167 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.426036 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-serving-certs-ca-bundle\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.426167 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.426066 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-config\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.426331 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.426184 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-metrics-client-ca\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.426640 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.426270 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-thanos-prometheus-http-client-file\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.426926 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.426680 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krjqd\" (UniqueName: \"kubernetes.io/projected/11f7de21-1e3f-4576-800e-c09742b0baa1-kube-api-access-krjqd\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.426926 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.426719 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-grpc-tls\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.426926 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.426744 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-web-config\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.426926 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.426799 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-0\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.426926 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.426830 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-kube-rbac-proxy\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.426926 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.426854 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-trusted-ca-bundle\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.426926 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.426919 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-db\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.427286 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.426968 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-tls\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.427286 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.426411 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:58.427286 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.426994 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-2\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.427286 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.426528 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:58.427286 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.427023 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11f7de21-1e3f-4576-800e-c09742b0baa1-tls-assets\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.427286 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.427048 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11f7de21-1e3f-4576-800e-c09742b0baa1-config-out\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.427286 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.427089 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-kubelet-serving-ca-bundle\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.427286 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.427126 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-1\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.427286 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.427202 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"11f7de21-1e3f-4576-800e-c09742b0baa1\" (UID: \"11f7de21-1e3f-4576-800e-c09742b0baa1\") " Sep 07 12:43:58.427864 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.427616 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:58.427864 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.427790 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.427864 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.427812 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.427864 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.427827 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-metrics-client-ca\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.428070 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.427928 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:58.429331 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.429001 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:58.429331 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.429101 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:58.429331 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.429152 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:58.429653 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.429479 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:58.429882 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.429835 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:58.429962 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.429919 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-config" (OuterVolumeSpecName: "config") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:58.430327 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.430295 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:43:58.430810 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.430784 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:43:58.430924 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.430880 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:58.431221 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.431196 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:58.431431 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.431414 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:58.432211 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.432185 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:58.432315 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.432193 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11f7de21-1e3f-4576-800e-c09742b0baa1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:43:58.432315 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.432232 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11f7de21-1e3f-4576-800e-c09742b0baa1-kube-api-access-krjqd" (OuterVolumeSpecName: "kube-api-access-krjqd") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "kube-api-access-krjqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:43:58.432436 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.432423 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11f7de21-1e3f-4576-800e-c09742b0baa1-config-out" (OuterVolumeSpecName: "config-out") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:43:58.441133 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.441108 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-web-config" (OuterVolumeSpecName: "web-config") pod "11f7de21-1e3f-4576-800e-c09742b0baa1" (UID: "11f7de21-1e3f-4576-800e-c09742b0baa1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:43:58.528616 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528568 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.528616 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528615 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-metrics-client-certs\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.528769 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528628 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-config\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.528769 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528640 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.528769 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528654 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krjqd\" (UniqueName: \"kubernetes.io/projected/11f7de21-1e3f-4576-800e-c09742b0baa1-kube-api-access-krjqd\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.528769 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528666 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-grpc-tls\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.528769 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528678 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-web-config\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.528769 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528692 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.528769 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528704 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-kube-rbac-proxy\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.528769 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528716 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.528769 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528730 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-db\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.528769 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528744 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.528769 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528756 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11f7de21-1e3f-4576-800e-c09742b0baa1-tls-assets\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.528769 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528768 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11f7de21-1e3f-4576-800e-c09742b0baa1-config-out\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.529136 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528780 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.529136 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528793 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11f7de21-1e3f-4576-800e-c09742b0baa1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.529136 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.528808 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11f7de21-1e3f-4576-800e-c09742b0baa1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-78.ec2.internal\" DevicePath \"\"" Sep 07 12:43:58.538698 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.538674 2579 generic.go:356] "Generic (PLEG): container finished" podID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerID="4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f" exitCode=0 Sep 07 12:43:58.538698 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.538696 2579 generic.go:356] "Generic (PLEG): container finished" podID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerID="a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f" exitCode=0 Sep 07 12:43:58.539115 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.538703 2579 generic.go:356] "Generic (PLEG): container finished" podID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerID="5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86" exitCode=0 Sep 07 12:43:58.539115 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.538709 2579 generic.go:356] "Generic (PLEG): container finished" podID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerID="197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2" exitCode=0 Sep 07 12:43:58.539115 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.538714 2579 generic.go:356] "Generic (PLEG): container finished" podID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerID="52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852" exitCode=0 Sep 07 12:43:58.539115 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.538719 2579 generic.go:356] "Generic (PLEG): container finished" podID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerID="6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621" exitCode=0 Sep 07 12:43:58.539115 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.538751 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11f7de21-1e3f-4576-800e-c09742b0baa1","Type":"ContainerDied","Data":"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f"} Sep 07 12:43:58.539115 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.538763 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.539115 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.538812 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11f7de21-1e3f-4576-800e-c09742b0baa1","Type":"ContainerDied","Data":"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f"} Sep 07 12:43:58.539115 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.538849 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11f7de21-1e3f-4576-800e-c09742b0baa1","Type":"ContainerDied","Data":"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86"} Sep 07 12:43:58.539115 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.538881 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11f7de21-1e3f-4576-800e-c09742b0baa1","Type":"ContainerDied","Data":"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2"} Sep 07 12:43:58.539115 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.538907 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11f7de21-1e3f-4576-800e-c09742b0baa1","Type":"ContainerDied","Data":"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852"} Sep 07 12:43:58.539115 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.538948 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11f7de21-1e3f-4576-800e-c09742b0baa1","Type":"ContainerDied","Data":"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621"} Sep 07 12:43:58.539115 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.538905 2579 scope.go:117] "RemoveContainer" containerID="4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f" Sep 07 12:43:58.539115 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.538976 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11f7de21-1e3f-4576-800e-c09742b0baa1","Type":"ContainerDied","Data":"1f3c16079802b2a79fb8841dc87ea8eee17d74ebddcb4af5bf339512b66f20c7"} Sep 07 12:43:58.540247 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.540223 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" event={"ID":"fe2bc492-9fce-4904-91dc-085bff10caa0","Type":"ContainerStarted","Data":"3dc30f4ec66310b47cfdc1edd3946ecd14f970800268b6896f3beb0f4d68db25"} Sep 07 12:43:58.547157 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.547139 2579 scope.go:117] "RemoveContainer" containerID="a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f" Sep 07 12:43:58.553717 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.553702 2579 scope.go:117] "RemoveContainer" containerID="5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86" Sep 07 12:43:58.560271 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.560255 2579 scope.go:117] "RemoveContainer" containerID="197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2" Sep 07 12:43:58.567015 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.566998 2579 scope.go:117] "RemoveContainer" containerID="52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852" Sep 07 12:43:58.573476 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.573462 2579 scope.go:117] "RemoveContainer" containerID="6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621" Sep 07 12:43:58.580431 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.580417 2579 scope.go:117] "RemoveContainer" containerID="6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2" Sep 07 12:43:58.587563 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.587541 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:43:58.588188 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.588168 2579 scope.go:117] "RemoveContainer" containerID="4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f" Sep 07 12:43:58.588503 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:58.588479 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f\": container with ID starting with 4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f not found: ID does not exist" containerID="4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f" Sep 07 12:43:58.588545 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.588512 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f"} err="failed to get container status \"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f\": rpc error: code = NotFound desc = could not find container \"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f\": container with ID starting with 4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f not found: ID does not exist" Sep 07 12:43:58.588545 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.588529 2579 scope.go:117] "RemoveContainer" containerID="a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f" Sep 07 12:43:58.588797 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:58.588778 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f\": container with ID starting with a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f not found: ID does not exist" containerID="a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f" Sep 07 12:43:58.588848 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.588802 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f"} err="failed to get container status \"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f\": rpc error: code = NotFound desc = could not find container \"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f\": container with ID starting with a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f not found: ID does not exist" Sep 07 12:43:58.588848 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.588814 2579 scope.go:117] "RemoveContainer" containerID="5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86" Sep 07 12:43:58.589067 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:58.589049 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86\": container with ID starting with 5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86 not found: ID does not exist" containerID="5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86" Sep 07 12:43:58.589129 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.589075 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86"} err="failed to get container status \"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86\": rpc error: code = NotFound desc = could not find container \"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86\": container with ID starting with 5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86 not found: ID does not exist" Sep 07 12:43:58.589129 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.589095 2579 scope.go:117] "RemoveContainer" containerID="197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2" Sep 07 12:43:58.589343 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:58.589328 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2\": container with ID starting with 197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2 not found: ID does not exist" containerID="197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2" Sep 07 12:43:58.589396 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.589346 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2"} err="failed to get container status \"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2\": rpc error: code = NotFound desc = could not find container \"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2\": container with ID starting with 197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2 not found: ID does not exist" Sep 07 12:43:58.589396 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.589358 2579 scope.go:117] "RemoveContainer" containerID="52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852" Sep 07 12:43:58.589565 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:58.589551 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852\": container with ID starting with 52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852 not found: ID does not exist" containerID="52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852" Sep 07 12:43:58.589629 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.589568 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852"} err="failed to get container status \"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852\": rpc error: code = NotFound desc = could not find container \"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852\": container with ID starting with 52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852 not found: ID does not exist" Sep 07 12:43:58.589629 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.589601 2579 scope.go:117] "RemoveContainer" containerID="6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621" Sep 07 12:43:58.589812 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:58.589795 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621\": container with ID starting with 6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621 not found: ID does not exist" containerID="6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621" Sep 07 12:43:58.589867 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.589820 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621"} err="failed to get container status \"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621\": rpc error: code = NotFound desc = could not find container \"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621\": container with ID starting with 6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621 not found: ID does not exist" Sep 07 12:43:58.589867 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.589841 2579 scope.go:117] "RemoveContainer" containerID="6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2" Sep 07 12:43:58.590049 ip-10-0-139-78 kubenswrapper[2579]: E0907 12:43:58.590036 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2\": container with ID starting with 6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2 not found: ID does not exist" containerID="6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2" Sep 07 12:43:58.590090 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.590052 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2"} err="failed to get container status \"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2\": rpc error: code = NotFound desc = could not find container \"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2\": container with ID starting with 6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2 not found: ID does not exist" Sep 07 12:43:58.590090 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.590063 2579 scope.go:117] "RemoveContainer" containerID="4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f" Sep 07 12:43:58.590233 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.590217 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f"} err="failed to get container status \"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f\": rpc error: code = NotFound desc = could not find container \"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f\": container with ID starting with 4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f not found: ID does not exist" Sep 07 12:43:58.590268 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.590234 2579 scope.go:117] "RemoveContainer" containerID="a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f" Sep 07 12:43:58.590429 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.590413 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f"} err="failed to get container status \"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f\": rpc error: code = NotFound desc = could not find container \"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f\": container with ID starting with a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f not found: ID does not exist" Sep 07 12:43:58.590506 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.590430 2579 scope.go:117] "RemoveContainer" containerID="5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86" Sep 07 12:43:58.590895 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.590879 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86"} err="failed to get container status \"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86\": rpc error: code = NotFound desc = could not find container \"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86\": container with ID starting with 5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86 not found: ID does not exist" Sep 07 12:43:58.590976 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.590895 2579 scope.go:117] "RemoveContainer" containerID="197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2" Sep 07 12:43:58.591126 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.591111 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2"} err="failed to get container status \"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2\": rpc error: code = NotFound desc = could not find container \"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2\": container with ID starting with 197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2 not found: ID does not exist" Sep 07 12:43:58.591173 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.591125 2579 scope.go:117] "RemoveContainer" containerID="52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852" Sep 07 12:43:58.591345 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.591330 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852"} err="failed to get container status \"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852\": rpc error: code = NotFound desc = could not find container \"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852\": container with ID starting with 52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852 not found: ID does not exist" Sep 07 12:43:58.591345 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.591343 2579 scope.go:117] "RemoveContainer" containerID="6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621" Sep 07 12:43:58.591508 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.591493 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621"} err="failed to get container status \"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621\": rpc error: code = NotFound desc = could not find container \"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621\": container with ID starting with 6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621 not found: ID does not exist" Sep 07 12:43:58.591546 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.591507 2579 scope.go:117] "RemoveContainer" containerID="6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2" Sep 07 12:43:58.591730 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.591713 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2"} err="failed to get container status \"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2\": rpc error: code = NotFound desc = could not find container \"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2\": container with ID starting with 6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2 not found: ID does not exist" Sep 07 12:43:58.591730 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.591726 2579 scope.go:117] "RemoveContainer" containerID="4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f" Sep 07 12:43:58.591956 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.591936 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f"} err="failed to get container status \"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f\": rpc error: code = NotFound desc = could not find container \"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f\": container with ID starting with 4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f not found: ID does not exist" Sep 07 12:43:58.591956 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.591955 2579 scope.go:117] "RemoveContainer" containerID="a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f" Sep 07 12:43:58.592196 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.592180 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f"} err="failed to get container status \"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f\": rpc error: code = NotFound desc = could not find container \"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f\": container with ID starting with a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f not found: ID does not exist" Sep 07 12:43:58.592249 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.592196 2579 scope.go:117] "RemoveContainer" containerID="5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86" Sep 07 12:43:58.592386 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.592366 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86"} err="failed to get container status \"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86\": rpc error: code = NotFound desc = could not find container \"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86\": container with ID starting with 5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86 not found: ID does not exist" Sep 07 12:43:58.592461 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.592388 2579 scope.go:117] "RemoveContainer" containerID="197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2" Sep 07 12:43:58.592697 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.592662 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2"} err="failed to get container status \"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2\": rpc error: code = NotFound desc = could not find container \"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2\": container with ID starting with 197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2 not found: ID does not exist" Sep 07 12:43:58.592697 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.592687 2579 scope.go:117] "RemoveContainer" containerID="52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852" Sep 07 12:43:58.593033 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.593000 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852"} err="failed to get container status \"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852\": rpc error: code = NotFound desc = could not find container \"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852\": container with ID starting with 52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852 not found: ID does not exist" Sep 07 12:43:58.593142 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.593033 2579 scope.go:117] "RemoveContainer" containerID="6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621" Sep 07 12:43:58.593360 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.593314 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621"} err="failed to get container status \"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621\": rpc error: code = NotFound desc = could not find container \"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621\": container with ID starting with 6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621 not found: ID does not exist" Sep 07 12:43:58.593360 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.593341 2579 scope.go:117] "RemoveContainer" containerID="6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2" Sep 07 12:43:58.593814 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.593784 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2"} err="failed to get container status \"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2\": rpc error: code = NotFound desc = could not find container \"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2\": container with ID starting with 6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2 not found: ID does not exist" Sep 07 12:43:58.593814 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.593814 2579 scope.go:117] "RemoveContainer" containerID="4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f" Sep 07 12:43:58.594105 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.594080 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f"} err="failed to get container status \"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f\": rpc error: code = NotFound desc = could not find container \"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f\": container with ID starting with 4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f not found: ID does not exist" Sep 07 12:43:58.594158 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.594107 2579 scope.go:117] "RemoveContainer" containerID="a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f" Sep 07 12:43:58.594401 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.594383 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f"} err="failed to get container status \"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f\": rpc error: code = NotFound desc = could not find container \"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f\": container with ID starting with a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f not found: ID does not exist" Sep 07 12:43:58.594401 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.594401 2579 scope.go:117] "RemoveContainer" containerID="5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86" Sep 07 12:43:58.599360 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.595047 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86"} err="failed to get container status \"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86\": rpc error: code = NotFound desc = could not find container \"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86\": container with ID starting with 5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86 not found: ID does not exist" Sep 07 12:43:58.599360 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.595095 2579 scope.go:117] "RemoveContainer" containerID="197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2" Sep 07 12:43:58.599360 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.595658 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:43:58.599811 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.599778 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2"} err="failed to get container status \"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2\": rpc error: code = NotFound desc = could not find container \"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2\": container with ID starting with 197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2 not found: ID does not exist" Sep 07 12:43:58.599811 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.599809 2579 scope.go:117] "RemoveContainer" containerID="52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852" Sep 07 12:43:58.600070 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.600039 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852"} err="failed to get container status \"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852\": rpc error: code = NotFound desc = could not find container \"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852\": container with ID starting with 52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852 not found: ID does not exist" Sep 07 12:43:58.600070 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.600063 2579 scope.go:117] "RemoveContainer" containerID="6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621" Sep 07 12:43:58.600326 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.600299 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621"} err="failed to get container status \"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621\": rpc error: code = NotFound desc = could not find container \"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621\": container with ID starting with 6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621 not found: ID does not exist" Sep 07 12:43:58.600326 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.600322 2579 scope.go:117] "RemoveContainer" containerID="6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2" Sep 07 12:43:58.600560 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.600544 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2"} err="failed to get container status \"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2\": rpc error: code = NotFound desc = could not find container \"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2\": container with ID starting with 6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2 not found: ID does not exist" Sep 07 12:43:58.600560 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.600560 2579 scope.go:117] "RemoveContainer" containerID="4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f" Sep 07 12:43:58.600803 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.600788 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f"} err="failed to get container status \"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f\": rpc error: code = NotFound desc = could not find container \"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f\": container with ID starting with 4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f not found: ID does not exist" Sep 07 12:43:58.600848 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.600803 2579 scope.go:117] "RemoveContainer" containerID="a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f" Sep 07 12:43:58.601087 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.601066 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f"} err="failed to get container status \"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f\": rpc error: code = NotFound desc = could not find container \"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f\": container with ID starting with a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f not found: ID does not exist" Sep 07 12:43:58.601150 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.601095 2579 scope.go:117] "RemoveContainer" containerID="5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86" Sep 07 12:43:58.601390 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.601361 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86"} err="failed to get container status \"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86\": rpc error: code = NotFound desc = could not find container \"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86\": container with ID starting with 5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86 not found: ID does not exist" Sep 07 12:43:58.601446 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.601401 2579 scope.go:117] "RemoveContainer" containerID="197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2" Sep 07 12:43:58.601681 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.601654 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2"} err="failed to get container status \"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2\": rpc error: code = NotFound desc = could not find container \"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2\": container with ID starting with 197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2 not found: ID does not exist" Sep 07 12:43:58.601735 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.601687 2579 scope.go:117] "RemoveContainer" containerID="52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852" Sep 07 12:43:58.602038 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.602009 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852"} err="failed to get container status \"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852\": rpc error: code = NotFound desc = could not find container \"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852\": container with ID starting with 52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852 not found: ID does not exist" Sep 07 12:43:58.602038 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.602034 2579 scope.go:117] "RemoveContainer" containerID="6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621" Sep 07 12:43:58.602244 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.602228 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621"} err="failed to get container status \"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621\": rpc error: code = NotFound desc = could not find container \"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621\": container with ID starting with 6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621 not found: ID does not exist" Sep 07 12:43:58.602292 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.602244 2579 scope.go:117] "RemoveContainer" containerID="6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2" Sep 07 12:43:58.602426 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.602410 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2"} err="failed to get container status \"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2\": rpc error: code = NotFound desc = could not find container \"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2\": container with ID starting with 6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2 not found: ID does not exist" Sep 07 12:43:58.602467 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.602426 2579 scope.go:117] "RemoveContainer" containerID="4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f" Sep 07 12:43:58.602655 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.602639 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f"} err="failed to get container status \"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f\": rpc error: code = NotFound desc = could not find container \"4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f\": container with ID starting with 4671c9df78c6c8229408e723362a63790e511fe45016d1813b4015eaedc83a9f not found: ID does not exist" Sep 07 12:43:58.602694 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.602655 2579 scope.go:117] "RemoveContainer" containerID="a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f" Sep 07 12:43:58.602841 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.602826 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f"} err="failed to get container status \"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f\": rpc error: code = NotFound desc = could not find container \"a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f\": container with ID starting with a5dc9006150e0c56a24a860efe1ead5e7d07a6c36a784f26877236db525efc4f not found: ID does not exist" Sep 07 12:43:58.602841 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.602840 2579 scope.go:117] "RemoveContainer" containerID="5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86" Sep 07 12:43:58.603083 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.603056 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86"} err="failed to get container status \"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86\": rpc error: code = NotFound desc = could not find container \"5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86\": container with ID starting with 5cdca656381c9c8adaed5e1cb114dcc09dbdcb5792efb5bf9ed800a3ab67fc86 not found: ID does not exist" Sep 07 12:43:58.603123 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.603083 2579 scope.go:117] "RemoveContainer" containerID="197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2" Sep 07 12:43:58.603280 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.603263 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2"} err="failed to get container status \"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2\": rpc error: code = NotFound desc = could not find container \"197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2\": container with ID starting with 197715775cd75f7a7c5cb6a1e71ca4b9316fef6068a48397d8268088d825bef2 not found: ID does not exist" Sep 07 12:43:58.603317 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.603280 2579 scope.go:117] "RemoveContainer" containerID="52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852" Sep 07 12:43:58.603484 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.603468 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852"} err="failed to get container status \"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852\": rpc error: code = NotFound desc = could not find container \"52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852\": container with ID starting with 52d8273dd81c5ffabbf39dec38d822abce5133b137a498e5facb3561de524852 not found: ID does not exist" Sep 07 12:43:58.603526 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.603484 2579 scope.go:117] "RemoveContainer" containerID="6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621" Sep 07 12:43:58.603705 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.603688 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621"} err="failed to get container status \"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621\": rpc error: code = NotFound desc = could not find container \"6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621\": container with ID starting with 6995b3fc08ad191affd527ed9c0eb3be64f8f0716ac92cb6eecf08418ba2d621 not found: ID does not exist" Sep 07 12:43:58.603746 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.603705 2579 scope.go:117] "RemoveContainer" containerID="6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2" Sep 07 12:43:58.603917 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.603899 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2"} err="failed to get container status \"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2\": rpc error: code = NotFound desc = could not find container \"6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2\": container with ID starting with 6744afac1d8358fb163f2b01226f84842f49fff45992d52792ff34ece54cc6f2 not found: ID does not exist" Sep 07 12:43:58.681384 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681331 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:43:58.681657 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681646 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="thanos-sidecar" Sep 07 12:43:58.681705 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681659 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="thanos-sidecar" Sep 07 12:43:58.681705 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681670 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="init-config-reloader" Sep 07 12:43:58.681705 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681675 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="init-config-reloader" Sep 07 12:43:58.681705 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681684 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="kube-rbac-proxy-thanos" Sep 07 12:43:58.681705 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681690 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="kube-rbac-proxy-thanos" Sep 07 12:43:58.681705 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681703 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="config-reloader" Sep 07 12:43:58.681705 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681708 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="config-reloader" Sep 07 12:43:58.681928 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681728 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="kube-rbac-proxy-web" Sep 07 12:43:58.681928 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681734 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="kube-rbac-proxy-web" Sep 07 12:43:58.681928 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681741 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="prometheus" Sep 07 12:43:58.681928 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681746 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="prometheus" Sep 07 12:43:58.681928 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681751 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="kube-rbac-proxy" Sep 07 12:43:58.681928 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681756 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="kube-rbac-proxy" Sep 07 12:43:58.681928 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681798 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="prometheus" Sep 07 12:43:58.681928 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681806 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="kube-rbac-proxy" Sep 07 12:43:58.681928 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681812 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="config-reloader" Sep 07 12:43:58.681928 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681817 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="kube-rbac-proxy-thanos" Sep 07 12:43:58.681928 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681822 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="kube-rbac-proxy-web" Sep 07 12:43:58.681928 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.681826 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" containerName="thanos-sidecar" Sep 07 12:43:58.687317 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.687302 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.689785 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.689767 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 12:43:58.692943 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.692923 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 12:43:58.693055 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.693038 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 12:43:58.693125 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.693078 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 12:43:58.693240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.693221 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 12:43:58.693240 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.693230 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 12:43:58.693504 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.693485 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 12:43:58.694173 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.694140 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 12:43:58.694265 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.694182 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8ojsf1sdn0bdo\"" Sep 07 12:43:58.694265 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.694251 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 12:43:58.694367 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.694263 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bwfv2\"" Sep 07 12:43:58.694517 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.694491 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 12:43:58.695358 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.695341 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 12:43:58.695441 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.695343 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 12:43:58.726885 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.726862 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 12:43:58.728412 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.728394 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:43:58.732972 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.732954 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 12:43:58.830567 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.830542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.830702 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.830604 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.830702 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.830647 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-web-config\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.830702 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.830679 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.830828 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.830704 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.830828 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.830787 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-config\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.830902 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.830869 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59zmv\" (UniqueName: \"kubernetes.io/projected/47fa88a2-f8dc-4529-8203-3837b983f491-kube-api-access-59zmv\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.830966 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.830947 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.831013 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.830985 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47fa88a2-f8dc-4529-8203-3837b983f491-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.831100 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.831029 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.831167 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.831145 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47fa88a2-f8dc-4529-8203-3837b983f491-config-out\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.831222 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.831184 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.831276 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.831221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.831276 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.831264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.831358 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.831290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.831358 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.831313 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.831422 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.831360 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/47fa88a2-f8dc-4529-8203-3837b983f491-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.831422 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.831396 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.831422 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.831417 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.831630 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.831437 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.931963 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.931892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/47fa88a2-f8dc-4529-8203-3837b983f491-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.931963 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.931929 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.931963 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.931944 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.932203 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.931965 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.932203 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.931993 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.932203 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932110 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.932203 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-web-config\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.932203 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932174 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.932203 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932198 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.932497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-config\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.932497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932256 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59zmv\" (UniqueName: \"kubernetes.io/projected/47fa88a2-f8dc-4529-8203-3837b983f491-kube-api-access-59zmv\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.932497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932292 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.932497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47fa88a2-f8dc-4529-8203-3837b983f491-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.932497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932355 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/47fa88a2-f8dc-4529-8203-3837b983f491-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.932497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932363 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.932497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932387 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47fa88a2-f8dc-4529-8203-3837b983f491-config-out\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.932497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932404 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.932497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.932497 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932494 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.933006 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932519 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.933006 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932542 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.933006 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.932746 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.933182 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.933155 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.933916 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.933889 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.934022 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.933968 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.936271 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.935345 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.936271 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.936021 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.936271 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.936056 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.936271 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.936128 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.936271 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.936259 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/47fa88a2-f8dc-4529-8203-3837b983f491-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.936920 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.936896 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.937027 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.936974 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.937422 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.937379 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-web-config\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.937506 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.937478 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47fa88a2-f8dc-4529-8203-3837b983f491-config-out\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.937814 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.937795 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-config\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.937916 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.937893 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.938145 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.938129 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.938890 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.938874 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47fa88a2-f8dc-4529-8203-3837b983f491-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.939557 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.939541 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47fa88a2-f8dc-4529-8203-3837b983f491-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.944917 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.944892 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59zmv\" (UniqueName: \"kubernetes.io/projected/47fa88a2-f8dc-4529-8203-3837b983f491-kube-api-access-59zmv\") pod \"prometheus-k8s-0\" (UID: \"47fa88a2-f8dc-4529-8203-3837b983f491\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:58.996565 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:58.996541 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:59.311659 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:59.311627 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:43:59.314233 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:43:59.314199 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47fa88a2_f8dc_4529_8203_3837b983f491.slice/crio-0e6ebb04806584b290bedc28b81488626b17a423b4a0928de12157d783dc18ab WatchSource:0}: Error finding container 0e6ebb04806584b290bedc28b81488626b17a423b4a0928de12157d783dc18ab: Status 404 returned error can't find the container with id 0e6ebb04806584b290bedc28b81488626b17a423b4a0928de12157d783dc18ab Sep 07 12:43:59.548904 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:59.548871 2579 generic.go:356] "Generic (PLEG): container finished" podID="47fa88a2-f8dc-4529-8203-3837b983f491" containerID="7f5fefe27296739eff4fa600564014c31f192a6b3aa7cd577957b972b8a4926c" exitCode=0 Sep 07 12:43:59.549367 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:59.548940 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47fa88a2-f8dc-4529-8203-3837b983f491","Type":"ContainerDied","Data":"7f5fefe27296739eff4fa600564014c31f192a6b3aa7cd577957b972b8a4926c"} Sep 07 12:43:59.549367 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:59.549012 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47fa88a2-f8dc-4529-8203-3837b983f491","Type":"ContainerStarted","Data":"0e6ebb04806584b290bedc28b81488626b17a423b4a0928de12157d783dc18ab"} Sep 07 12:43:59.663599 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:43:59.663093 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11f7de21-1e3f-4576-800e-c09742b0baa1" path="/var/lib/kubelet/pods/11f7de21-1e3f-4576-800e-c09742b0baa1/volumes" Sep 07 12:44:00.555878 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:00.555837 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" event={"ID":"fe2bc492-9fce-4904-91dc-085bff10caa0","Type":"ContainerStarted","Data":"453aa69ebcd51bcd5861ad7f34422b51d8acefeef4002869f4e0d7f1fb56187e"} Sep 07 12:44:00.556293 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:00.555908 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" event={"ID":"fe2bc492-9fce-4904-91dc-085bff10caa0","Type":"ContainerStarted","Data":"71b7ede1d215674c065671dedd9788d54fac367e940e62726eda32fb84c4c907"} Sep 07 12:44:00.556293 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:00.555942 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" event={"ID":"fe2bc492-9fce-4904-91dc-085bff10caa0","Type":"ContainerStarted","Data":"e15e2ab50060874e58efd68e9488a40257b31f3d4bda706731adc04e18a8bca3"} Sep 07 12:44:00.559211 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:00.559188 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47fa88a2-f8dc-4529-8203-3837b983f491","Type":"ContainerStarted","Data":"6c23296bb06220343bd56ab51292eaa4ce0603b19ba425dda488098c3e2de7f4"} Sep 07 12:44:00.559324 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:00.559240 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47fa88a2-f8dc-4529-8203-3837b983f491","Type":"ContainerStarted","Data":"e44faebd17f88f99065f758cfd80a0a737e94a75e5e9e9fac6c73702a003c16a"} Sep 07 12:44:00.559324 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:00.559272 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47fa88a2-f8dc-4529-8203-3837b983f491","Type":"ContainerStarted","Data":"cf58909385b2ed7f9729bc39afbc16d1c3cc780eb736ece19a940e648168a3a5"} Sep 07 12:44:00.559324 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:00.559297 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47fa88a2-f8dc-4529-8203-3837b983f491","Type":"ContainerStarted","Data":"a7c9dfcf7d75ed34c1dc256dd862ad3b6de2abbfef8d94950038a7c444f7a4af"} Sep 07 12:44:00.559324 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:00.559324 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47fa88a2-f8dc-4529-8203-3837b983f491","Type":"ContainerStarted","Data":"765ab688a6ef488da332ad5517ca4751d961ec361cda42695afc736b8f0f249e"} Sep 07 12:44:00.559478 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:00.559361 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"47fa88a2-f8dc-4529-8203-3837b983f491","Type":"ContainerStarted","Data":"59894bcd3bcedf324dc655a4b8916b2beac7225471bf415c1c9180fabc69646c"} Sep 07 12:44:00.709282 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:00.709227 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-59fbc7df7b-wcjtt" podStartSLOduration=1.78068522 podStartE2EDuration="3.709212468s" totalImagesPullingTime="1.928527248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:43:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:44:00.607758994 +0000 UTC m=+197.477502383" watchObservedRunningTime="2026-09-07 12:44:00.709212468 +0000 UTC m=+197.578955854" Sep 07 12:44:00.969303 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:00.969213 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:44:01.130740 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:01.130700 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:44:01.240444 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:01.240342 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:44:01.605191 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:01.605112 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:44:01.690209 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:01.690175 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:44:03.997211 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:03.997184 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:44:04.254706 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:04.254617 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:44:12.040713 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:12.040675 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:44:12.131604 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:12.131555 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:44:12.238733 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:12.238705 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:44:47.136941 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:47.136909 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:44:47.237096 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:47.237057 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:44:58.997715 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:58.997685 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:44:59.013496 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:59.013473 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:44:59.044973 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:59.044922 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=61.025458146 podStartE2EDuration="1m1.044908791s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.450645ms" isStatefulPod=false podCreationTimestamp="2026-09-07 12:43:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:44:00.716304227 +0000 UTC m=+197.586047614" watchObservedRunningTime="2026-09-07 12:44:59.044908791 +0000 UTC m=+255.914652175" Sep 07 12:44:59.802412 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:44:59.802386 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:45:07.187630 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:45:07.187522 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:45:07.873252 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:45:07.873217 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:45:07.943509 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:45:07.943475 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:45:10.359615 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:45:10.359565 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:45:10.430788 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:45:10.430765 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:45:19.851480 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:45:19.851444 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:45:19.925929 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:45:19.925902 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:45:21.344088 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:45:21.344050 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:45:21.489194 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:45:21.489163 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:45:21.593971 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:45:21.593940 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:45:32.365036 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:45:32.365002 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:45:32.458333 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:45:32.458295 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:45:43.574337 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:45:43.574310 2579 kubelet.go:1648] "Image garbage collection succeeded" Sep 07 12:45:55.657217 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:45:55.657186 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:12.501778 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:12.501746 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:18.647206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:18.647174 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:34.277198 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:34.277167 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:35.054557 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:35.054525 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:37.889796 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:37.889766 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:37.970412 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:37.970377 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:40.066784 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:40.066734 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:40.164902 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:40.164859 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:42.266363 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.266314 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:42.459918 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.459889 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:42.635821 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.635739 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dxtx8"] Sep 07 12:47:42.639009 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.638986 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dxtx8" Sep 07 12:47:42.641542 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.641522 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 07 12:47:42.642156 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.642140 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 07 12:47:42.642211 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.642165 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mr7gl\"" Sep 07 12:47:42.648351 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.648330 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dxtx8"] Sep 07 12:47:42.730595 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.730542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13a83a90-fd64-482f-951e-106cc7b063f3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dxtx8\" (UID: \"13a83a90-fd64-482f-951e-106cc7b063f3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dxtx8" Sep 07 12:47:42.730737 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.730659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md6ng\" (UniqueName: \"kubernetes.io/projected/13a83a90-fd64-482f-951e-106cc7b063f3-kube-api-access-md6ng\") pod \"cert-manager-cainjector-559cdd8c87-dxtx8\" (UID: \"13a83a90-fd64-482f-951e-106cc7b063f3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dxtx8" Sep 07 12:47:42.831599 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.831554 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13a83a90-fd64-482f-951e-106cc7b063f3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dxtx8\" (UID: \"13a83a90-fd64-482f-951e-106cc7b063f3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dxtx8" Sep 07 12:47:42.831740 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.831627 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md6ng\" (UniqueName: \"kubernetes.io/projected/13a83a90-fd64-482f-951e-106cc7b063f3-kube-api-access-md6ng\") pod \"cert-manager-cainjector-559cdd8c87-dxtx8\" (UID: \"13a83a90-fd64-482f-951e-106cc7b063f3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dxtx8" Sep 07 12:47:42.839279 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.839256 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13a83a90-fd64-482f-951e-106cc7b063f3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dxtx8\" (UID: \"13a83a90-fd64-482f-951e-106cc7b063f3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dxtx8" Sep 07 12:47:42.839475 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.839453 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md6ng\" (UniqueName: \"kubernetes.io/projected/13a83a90-fd64-482f-951e-106cc7b063f3-kube-api-access-md6ng\") pod \"cert-manager-cainjector-559cdd8c87-dxtx8\" (UID: \"13a83a90-fd64-482f-951e-106cc7b063f3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dxtx8" Sep 07 12:47:42.879125 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.879097 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:42.949797 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.949772 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:42.960755 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:42.960735 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dxtx8" Sep 07 12:47:43.232110 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:43.232076 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dxtx8"] Sep 07 12:47:43.234857 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:47:43.234827 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13a83a90_fd64_482f_951e_106cc7b063f3.slice/crio-c2c7fd21b4138c00aea464607c248e63f2af13bc759a1bea4ab2b912060b8c63 WatchSource:0}: Error finding container c2c7fd21b4138c00aea464607c248e63f2af13bc759a1bea4ab2b912060b8c63: Status 404 returned error can't find the container with id c2c7fd21b4138c00aea464607c248e63f2af13bc759a1bea4ab2b912060b8c63 Sep 07 12:47:43.236716 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:43.236697 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 12:47:43.433206 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:43.433169 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dxtx8" event={"ID":"13a83a90-fd64-482f-951e-106cc7b063f3","Type":"ContainerStarted","Data":"c2c7fd21b4138c00aea464607c248e63f2af13bc759a1bea4ab2b912060b8c63"} Sep 07 12:47:45.485806 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:45.485769 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:45.586976 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:45.586940 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:50.694225 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:50.694187 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:52.473312 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:52.473280 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dxtx8" event={"ID":"13a83a90-fd64-482f-951e-106cc7b063f3","Type":"ContainerStarted","Data":"5a7a0752317990f9425243c61f435524de1abd355df083befe34a49bd6c3671e"} Sep 07 12:47:52.488416 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:52.488374 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dxtx8" podStartSLOduration=1.650366702 podStartE2EDuration="10.488358329s" totalImagesPullingTime="8.837991627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:47:52.487683796 +0000 UTC m=+429.357427186" watchObservedRunningTime="2026-09-07 12:47:52.488358329 +0000 UTC m=+429.358101715" Sep 07 12:47:52.852286 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:52.852214 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:52.953117 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:52.953068 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:56.756587 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:56.756545 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:56.857808 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:56.857752 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:47:56.955694 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:47:56.955656 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:48:08.284352 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:08.284249 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:48:08.383485 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:08.383453 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:48:10.512263 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:10.512233 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-4vchg"] Sep 07 12:48:10.517889 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:10.517874 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-4vchg" Sep 07 12:48:10.520802 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:10.520768 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-fc4qq\"" Sep 07 12:48:10.521108 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:10.521095 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:48:10.521726 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:10.521710 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 07 12:48:10.531431 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:10.531407 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-4vchg"] Sep 07 12:48:10.659987 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:10.659955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c76dcd0d-4b78-42e0-9a2e-73e30d77baad-tmp\") pod \"jobset-operator-5bc45f897-4vchg\" (UID: \"c76dcd0d-4b78-42e0-9a2e-73e30d77baad\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4vchg" Sep 07 12:48:10.659987 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:10.659990 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zz4t\" (UniqueName: \"kubernetes.io/projected/c76dcd0d-4b78-42e0-9a2e-73e30d77baad-kube-api-access-2zz4t\") pod \"jobset-operator-5bc45f897-4vchg\" (UID: \"c76dcd0d-4b78-42e0-9a2e-73e30d77baad\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4vchg" Sep 07 12:48:10.760819 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:10.760791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c76dcd0d-4b78-42e0-9a2e-73e30d77baad-tmp\") pod \"jobset-operator-5bc45f897-4vchg\" (UID: \"c76dcd0d-4b78-42e0-9a2e-73e30d77baad\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4vchg" Sep 07 12:48:10.760964 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:10.760825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zz4t\" (UniqueName: \"kubernetes.io/projected/c76dcd0d-4b78-42e0-9a2e-73e30d77baad-kube-api-access-2zz4t\") pod \"jobset-operator-5bc45f897-4vchg\" (UID: \"c76dcd0d-4b78-42e0-9a2e-73e30d77baad\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4vchg" Sep 07 12:48:10.761196 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:10.761174 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c76dcd0d-4b78-42e0-9a2e-73e30d77baad-tmp\") pod \"jobset-operator-5bc45f897-4vchg\" (UID: \"c76dcd0d-4b78-42e0-9a2e-73e30d77baad\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4vchg" Sep 07 12:48:10.769929 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:10.769885 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zz4t\" (UniqueName: \"kubernetes.io/projected/c76dcd0d-4b78-42e0-9a2e-73e30d77baad-kube-api-access-2zz4t\") pod \"jobset-operator-5bc45f897-4vchg\" (UID: \"c76dcd0d-4b78-42e0-9a2e-73e30d77baad\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4vchg" Sep 07 12:48:10.826828 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:10.826806 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-4vchg" Sep 07 12:48:11.119413 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:11.119389 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-4vchg"] Sep 07 12:48:11.122123 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:48:11.122093 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc76dcd0d_4b78_42e0_9a2e_73e30d77baad.slice/crio-6eff1865307ba32b7b0ef15f4210fbc9e66d054987c09cb7569a9a89ab329d37 WatchSource:0}: Error finding container 6eff1865307ba32b7b0ef15f4210fbc9e66d054987c09cb7569a9a89ab329d37: Status 404 returned error can't find the container with id 6eff1865307ba32b7b0ef15f4210fbc9e66d054987c09cb7569a9a89ab329d37 Sep 07 12:48:11.552925 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:11.552892 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-4vchg" event={"ID":"c76dcd0d-4b78-42e0-9a2e-73e30d77baad","Type":"ContainerStarted","Data":"6eff1865307ba32b7b0ef15f4210fbc9e66d054987c09cb7569a9a89ab329d37"} Sep 07 12:48:17.581523 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:17.581487 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-4vchg" event={"ID":"c76dcd0d-4b78-42e0-9a2e-73e30d77baad","Type":"ContainerStarted","Data":"2543b9fed70f38b795c6239eb901313c4774d2656b397d313249796e2957aff5"} Sep 07 12:48:17.597018 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:17.596960 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-4vchg" podStartSLOduration=1.358444025 podStartE2EDuration="7.596923592s" totalImagesPullingTime="6.238479567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:48:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:48:17.59639485 +0000 UTC m=+454.466138237" watchObservedRunningTime="2026-09-07 12:48:17.596923592 +0000 UTC m=+454.466666979" Sep 07 12:48:18.768155 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:18.768119 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:48:19.545005 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:19.544975 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:48:19.609091 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:19.609059 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:48:21.070692 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:21.070658 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:48:25.334559 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:25.334525 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:48:25.434797 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:25.434770 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:48:26.179679 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:26.179646 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:48:27.177026 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:27.176989 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:48:27.238934 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:48:27.238902 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:50:30.737053 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:50:30.737012 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:50:30.798130 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:50:30.798098 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:52:15.913859 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:52:15.913821 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:52:15.976808 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:52:15.976780 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:53:09.965991 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:09.965916 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:53:10.109834 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:10.109796 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5qvf5/must-gather-8m2vr"] Sep 07 12:53:10.113399 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:10.113383 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5qvf5/must-gather-8m2vr" Sep 07 12:53:10.115742 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:10.115720 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5qvf5\"/\"kube-root-ca.crt\"" Sep 07 12:53:10.115995 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:10.115976 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5qvf5\"/\"default-dockercfg-t88c4\"" Sep 07 12:53:10.116432 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:10.116419 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5qvf5\"/\"openshift-service-ca.crt\"" Sep 07 12:53:10.126105 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:10.126086 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5qvf5/must-gather-8m2vr"] Sep 07 12:53:10.182242 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:10.182214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ebe06162-e55e-4dc0-8a04-8f8cdeebc5a4-must-gather-output\") pod \"must-gather-8m2vr\" (UID: \"ebe06162-e55e-4dc0-8a04-8f8cdeebc5a4\") " pod="openshift-must-gather-5qvf5/must-gather-8m2vr" Sep 07 12:53:10.182355 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:10.182262 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czd58\" (UniqueName: \"kubernetes.io/projected/ebe06162-e55e-4dc0-8a04-8f8cdeebc5a4-kube-api-access-czd58\") pod \"must-gather-8m2vr\" (UID: \"ebe06162-e55e-4dc0-8a04-8f8cdeebc5a4\") " pod="openshift-must-gather-5qvf5/must-gather-8m2vr" Sep 07 12:53:10.283538 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:10.283478 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ebe06162-e55e-4dc0-8a04-8f8cdeebc5a4-must-gather-output\") pod \"must-gather-8m2vr\" (UID: \"ebe06162-e55e-4dc0-8a04-8f8cdeebc5a4\") " pod="openshift-must-gather-5qvf5/must-gather-8m2vr" Sep 07 12:53:10.283538 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:10.283520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czd58\" (UniqueName: \"kubernetes.io/projected/ebe06162-e55e-4dc0-8a04-8f8cdeebc5a4-kube-api-access-czd58\") pod \"must-gather-8m2vr\" (UID: \"ebe06162-e55e-4dc0-8a04-8f8cdeebc5a4\") " pod="openshift-must-gather-5qvf5/must-gather-8m2vr" Sep 07 12:53:10.283889 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:10.283870 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ebe06162-e55e-4dc0-8a04-8f8cdeebc5a4-must-gather-output\") pod \"must-gather-8m2vr\" (UID: \"ebe06162-e55e-4dc0-8a04-8f8cdeebc5a4\") " pod="openshift-must-gather-5qvf5/must-gather-8m2vr" Sep 07 12:53:10.293271 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:10.293247 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czd58\" (UniqueName: \"kubernetes.io/projected/ebe06162-e55e-4dc0-8a04-8f8cdeebc5a4-kube-api-access-czd58\") pod \"must-gather-8m2vr\" (UID: \"ebe06162-e55e-4dc0-8a04-8f8cdeebc5a4\") " pod="openshift-must-gather-5qvf5/must-gather-8m2vr" Sep 07 12:53:10.422181 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:10.422150 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5qvf5/must-gather-8m2vr" Sep 07 12:53:10.698113 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:10.698084 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5qvf5/must-gather-8m2vr"] Sep 07 12:53:10.700680 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:53:10.700643 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebe06162_e55e_4dc0_8a04_8f8cdeebc5a4.slice/crio-d42fdd01ff5dd25268e8ab8cd7349371b6813b3885b3d1b1addfc5692d02aede WatchSource:0}: Error finding container d42fdd01ff5dd25268e8ab8cd7349371b6813b3885b3d1b1addfc5692d02aede: Status 404 returned error can't find the container with id d42fdd01ff5dd25268e8ab8cd7349371b6813b3885b3d1b1addfc5692d02aede Sep 07 12:53:10.702713 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:10.702695 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 12:53:10.744722 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:10.744698 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5qvf5/must-gather-8m2vr" event={"ID":"ebe06162-e55e-4dc0-8a04-8f8cdeebc5a4","Type":"ContainerStarted","Data":"d42fdd01ff5dd25268e8ab8cd7349371b6813b3885b3d1b1addfc5692d02aede"} Sep 07 12:53:11.752038 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:11.752006 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5qvf5/must-gather-8m2vr" event={"ID":"ebe06162-e55e-4dc0-8a04-8f8cdeebc5a4","Type":"ContainerStarted","Data":"b7bd58c77688b621c91bb5f07327a6f5d52b0b271d98ce3b8b9380034e9ebcaa"} Sep 07 12:53:12.759164 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:12.759128 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5qvf5/must-gather-8m2vr" event={"ID":"ebe06162-e55e-4dc0-8a04-8f8cdeebc5a4","Type":"ContainerStarted","Data":"d048de0118928cc00793a2bebe1a1807836c46c488568d43415fac56fd6fca02"} Sep 07 12:53:12.778859 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:12.778791 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5qvf5/must-gather-8m2vr" podStartSLOduration=1.904987592 podStartE2EDuration="2.778771035s" totalImagesPullingTime="873.783443ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:53:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:12.776630106 +0000 UTC m=+749.646373493" watchObservedRunningTime="2026-09-07 12:53:12.778771035 +0000 UTC m=+749.648514423" Sep 07 12:53:13.069476 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:13.069402 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pfgjt_3fce5c0f-7c8a-4f83-be38-940c689527e8/global-pull-secret-syncer/0.log" Sep 07 12:53:13.117879 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:13.117846 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" Sep 07 12:53:13.211210 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:13.211160 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-78.ec2.internal_354628df5e5c0356cd158ffc3ea8a19c/haproxy/0.log" Sep 07 12:53:14.890677 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:14.890632 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:53:15.568513 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:15.568478 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:53:15.658992 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:15.658916 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024 Sep 07 12:53:16.720989 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:16.720916 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b449f43-4c7f-41ee-8864-6178bbd6ff45/alertmanager/0.log" Sep 07 12:53:16.756905 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:16.756634 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b449f43-4c7f-41ee-8864-6178bbd6ff45/config-reloader/0.log" Sep 07 12:53:16.785311 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:16.785278 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b449f43-4c7f-41ee-8864-6178bbd6ff45/kube-rbac-proxy-web/0.log" Sep 07 12:53:16.820431 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:16.820380 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b449f43-4c7f-41ee-8864-6178bbd6ff45/kube-rbac-proxy/0.log" Sep 07 12:53:16.840516 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:16.840485 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b449f43-4c7f-41ee-8864-6178bbd6ff45/kube-rbac-proxy-metric/0.log" Sep 07 12:53:16.862587 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:16.862526 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b449f43-4c7f-41ee-8864-6178bbd6ff45/prom-label-proxy/0.log" Sep 07 12:53:16.888012 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:16.887977 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9b449f43-4c7f-41ee-8864-6178bbd6ff45/init-config-reloader/0.log" Sep 07 12:53:16.925418 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:16.925317 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-6g9st_810685be-a0c1-4a32-8f4c-d28e0ddd149d/cluster-monitoring-operator/0.log" Sep 07 12:53:16.953563 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:16.953533 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-j89jq_b612243e-76eb-4408-8a3a-81fe9dfdf5d7/kube-state-metrics/0.log" Sep 07 12:53:16.977817 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:16.977777 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-j89jq_b612243e-76eb-4408-8a3a-81fe9dfdf5d7/kube-rbac-proxy-main/0.log" Sep 07 12:53:17.011981 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.011934 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-j89jq_b612243e-76eb-4408-8a3a-81fe9dfdf5d7/kube-rbac-proxy-self/0.log" Sep 07 12:53:17.081211 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.081088 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-fbdd49684-gwjsc_9e3585dd-16b6-4777-ab30-4f9997c785ea/metrics-server/0.log" Sep 07 12:53:17.123719 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.123691 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-x9c6z_1420798a-15bd-40c3-aa08-155002a3c8a9/monitoring-plugin/0.log" Sep 07 12:53:17.180793 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.180712 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6td8w_191a899e-a6d0-4f17-9cf3-9012d3792fc7/node-exporter/0.log" Sep 07 12:53:17.211439 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.211413 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6td8w_191a899e-a6d0-4f17-9cf3-9012d3792fc7/kube-rbac-proxy/0.log" Sep 07 12:53:17.238512 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.238485 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6td8w_191a899e-a6d0-4f17-9cf3-9012d3792fc7/init-textfile/0.log" Sep 07 12:53:17.427785 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.427754 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-nx58j_6a4b6b73-53a5-4e26-aa50-ab91d78563f7/kube-rbac-proxy-main/0.log" Sep 07 12:53:17.449478 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.449387 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-nx58j_6a4b6b73-53a5-4e26-aa50-ab91d78563f7/kube-rbac-proxy-self/0.log" Sep 07 12:53:17.473124 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.473097 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-nx58j_6a4b6b73-53a5-4e26-aa50-ab91d78563f7/openshift-state-metrics/0.log" Sep 07 12:53:17.518638 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.518612 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47fa88a2-f8dc-4529-8203-3837b983f491/prometheus/0.log" Sep 07 12:53:17.542787 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.542674 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47fa88a2-f8dc-4529-8203-3837b983f491/config-reloader/0.log" Sep 07 12:53:17.579084 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.578907 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47fa88a2-f8dc-4529-8203-3837b983f491/thanos-sidecar/0.log" Sep 07 12:53:17.600373 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.600343 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47fa88a2-f8dc-4529-8203-3837b983f491/kube-rbac-proxy-web/0.log" Sep 07 12:53:17.623914 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.623885 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47fa88a2-f8dc-4529-8203-3837b983f491/kube-rbac-proxy/0.log" Sep 07 12:53:17.648622 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.648596 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47fa88a2-f8dc-4529-8203-3837b983f491/kube-rbac-proxy-thanos/0.log" Sep 07 12:53:17.679627 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.679601 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_47fa88a2-f8dc-4529-8203-3837b983f491/init-config-reloader/0.log" Sep 07 12:53:17.755398 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.755322 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-j5tfp_cee705bc-786d-4d8b-9fe2-479bca2f2097/prometheus-operator-admission-webhook/0.log" Sep 07 12:53:17.786230 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.786195 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59fbc7df7b-wcjtt_fe2bc492-9fce-4904-91dc-085bff10caa0/telemeter-client/0.log" Sep 07 12:53:17.808552 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.808520 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59fbc7df7b-wcjtt_fe2bc492-9fce-4904-91dc-085bff10caa0/reload/0.log" Sep 07 12:53:17.831299 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:17.831268 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59fbc7df7b-wcjtt_fe2bc492-9fce-4904-91dc-085bff10caa0/kube-rbac-proxy/0.log" Sep 07 12:53:20.584460 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.584423 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt"] Sep 07 12:53:20.590679 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.590653 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:20.601875 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.601760 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt"] Sep 07 12:53:20.682776 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.682734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9aff8c7-3b78-4ff5-8852-8b7a6d363a87-lib-modules\") pod \"perf-node-gather-daemonset-scsbt\" (UID: \"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87\") " pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:20.682966 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.682792 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddjk4\" (UniqueName: \"kubernetes.io/projected/f9aff8c7-3b78-4ff5-8852-8b7a6d363a87-kube-api-access-ddjk4\") pod \"perf-node-gather-daemonset-scsbt\" (UID: \"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87\") " pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:20.682966 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.682876 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9aff8c7-3b78-4ff5-8852-8b7a6d363a87-sys\") pod \"perf-node-gather-daemonset-scsbt\" (UID: \"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87\") " pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:20.682966 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.682912 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f9aff8c7-3b78-4ff5-8852-8b7a6d363a87-proc\") pod \"perf-node-gather-daemonset-scsbt\" (UID: \"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87\") " pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:20.682966 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.682961 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f9aff8c7-3b78-4ff5-8852-8b7a6d363a87-podres\") pod \"perf-node-gather-daemonset-scsbt\" (UID: \"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87\") " pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:20.783690 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.783656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9aff8c7-3b78-4ff5-8852-8b7a6d363a87-sys\") pod \"perf-node-gather-daemonset-scsbt\" (UID: \"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87\") " pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:20.783690 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.783696 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f9aff8c7-3b78-4ff5-8852-8b7a6d363a87-proc\") pod \"perf-node-gather-daemonset-scsbt\" (UID: \"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87\") " pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:20.783917 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.783746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f9aff8c7-3b78-4ff5-8852-8b7a6d363a87-podres\") pod \"perf-node-gather-daemonset-scsbt\" (UID: \"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87\") " pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:20.783917 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.783788 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9aff8c7-3b78-4ff5-8852-8b7a6d363a87-sys\") pod \"perf-node-gather-daemonset-scsbt\" (UID: \"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87\") " pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:20.783917 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.783794 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9aff8c7-3b78-4ff5-8852-8b7a6d363a87-lib-modules\") pod \"perf-node-gather-daemonset-scsbt\" (UID: \"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87\") " pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:20.783917 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.783850 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f9aff8c7-3b78-4ff5-8852-8b7a6d363a87-proc\") pod \"perf-node-gather-daemonset-scsbt\" (UID: \"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87\") " pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:20.783917 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.783873 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9aff8c7-3b78-4ff5-8852-8b7a6d363a87-lib-modules\") pod \"perf-node-gather-daemonset-scsbt\" (UID: \"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87\") " pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:20.783917 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.783874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddjk4\" (UniqueName: \"kubernetes.io/projected/f9aff8c7-3b78-4ff5-8852-8b7a6d363a87-kube-api-access-ddjk4\") pod \"perf-node-gather-daemonset-scsbt\" (UID: \"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87\") " pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:20.783917 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.783891 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f9aff8c7-3b78-4ff5-8852-8b7a6d363a87-podres\") pod \"perf-node-gather-daemonset-scsbt\" (UID: \"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87\") " pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:20.793910 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.793840 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddjk4\" (UniqueName: \"kubernetes.io/projected/f9aff8c7-3b78-4ff5-8852-8b7a6d363a87-kube-api-access-ddjk4\") pod \"perf-node-gather-daemonset-scsbt\" (UID: \"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87\") " pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:20.907064 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:20.906785 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:21.195131 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:21.195102 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt"] Sep 07 12:53:21.196825 ip-10-0-139-78 kubenswrapper[2579]: W0907 12:53:21.196794 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf9aff8c7_3b78_4ff5_8852_8b7a6d363a87.slice/crio-be910c4cfba28a3904230e7c456c0f650e78a8b334f76691444ce60088b6aad8 WatchSource:0}: Error finding container be910c4cfba28a3904230e7c456c0f650e78a8b334f76691444ce60088b6aad8: Status 404 returned error can't find the container with id be910c4cfba28a3904230e7c456c0f650e78a8b334f76691444ce60088b6aad8 Sep 07 12:53:21.802326 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:21.802298 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q5khs_94474ca3-efb2-4757-ac88-a1687b8d459c/dns/0.log" Sep 07 12:53:21.814779 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:21.814745 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" event={"ID":"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87","Type":"ContainerStarted","Data":"9351316f0e3cdc819187add93ed277686684046deffd8418aca37bdefc77abc3"} Sep 07 12:53:21.814929 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:21.814824 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" event={"ID":"f9aff8c7-3b78-4ff5-8852-8b7a6d363a87","Type":"ContainerStarted","Data":"be910c4cfba28a3904230e7c456c0f650e78a8b334f76691444ce60088b6aad8"} Sep 07 12:53:21.814929 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:21.814854 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:21.844366 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:21.844340 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q5khs_94474ca3-efb2-4757-ac88-a1687b8d459c/kube-rbac-proxy/0.log" Sep 07 12:53:21.972214 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:21.972184 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mjfzt_0c201161-d05a-452a-806a-be74c902a26a/dns-node-resolver/0.log" Sep 07 12:53:22.469547 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:22.469521 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vppzn_dedaea8c-e647-441e-a4ae-2e728bf38f3b/node-ca/0.log" Sep 07 12:53:23.601451 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:23.601418 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vwcsk_19e142d3-1db3-4755-aef6-26dcad6265b4/serve-healthcheck-canary/0.log" Sep 07 12:53:23.932726 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:23.932686 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-jn4hz_070684d2-bd22-4f70-93a2-9dff87ad479d/insights-operator/0.log" Sep 07 12:53:23.933110 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:23.933092 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-jn4hz_070684d2-bd22-4f70-93a2-9dff87ad479d/insights-operator/1.log" Sep 07 12:53:24.048361 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:24.048330 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ttdqj_b14549b7-cb78-444b-a944-d9d90a1e8eed/kube-rbac-proxy/0.log" Sep 07 12:53:24.086049 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:24.086020 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ttdqj_b14549b7-cb78-444b-a944-d9d90a1e8eed/exporter/0.log" Sep 07 12:53:24.134717 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:24.134690 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ttdqj_b14549b7-cb78-444b-a944-d9d90a1e8eed/extractor/0.log" Sep 07 12:53:25.710506 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:25.710473 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-4vchg_c76dcd0d-4b78-42e0-9a2e-73e30d77baad/jobset-operator/0.log" Sep 07 12:53:27.833760 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:27.833730 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" Sep 07 12:53:27.859238 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:27.859179 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5qvf5/perf-node-gather-daemonset-scsbt" podStartSLOduration=7.859158187 podStartE2EDuration="7.859158187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:53:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:53:21.849544458 +0000 UTC m=+758.719287846" watchObservedRunningTime="2026-09-07 12:53:27.859158187 +0000 UTC m=+764.728901575" Sep 07 12:53:28.707309 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:28.707283 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-j9mft_d7213d2f-5a49-45c7-b695-c9219bff3ae9/migrator/0.log" Sep 07 12:53:28.726649 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:28.726620 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-j9mft_d7213d2f-5a49-45c7-b695-c9219bff3ae9/graceful-termination/0.log" Sep 07 12:53:30.256370 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:30.256300 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grn48_d641371d-23bb-4111-b530-8fd27ccff558/kube-multus-additional-cni-plugins/0.log" Sep 07 12:53:30.275346 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:30.275323 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grn48_d641371d-23bb-4111-b530-8fd27ccff558/egress-router-binary-copy/0.log" Sep 07 12:53:30.293922 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:30.293903 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grn48_d641371d-23bb-4111-b530-8fd27ccff558/cni-plugins/0.log" Sep 07 12:53:30.313999 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:30.313981 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grn48_d641371d-23bb-4111-b530-8fd27ccff558/bond-cni-plugin/0.log" Sep 07 12:53:30.334477 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:30.334457 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grn48_d641371d-23bb-4111-b530-8fd27ccff558/routeoverride-cni/0.log" Sep 07 12:53:30.355214 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:30.355196 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grn48_d641371d-23bb-4111-b530-8fd27ccff558/whereabouts-cni-bincopy/0.log" Sep 07 12:53:30.375740 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:30.375722 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-grn48_d641371d-23bb-4111-b530-8fd27ccff558/whereabouts-cni/0.log" Sep 07 12:53:30.559722 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:30.559657 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cq2dj_88c58f57-e0c6-4de1-bcc9-9a95451cc520/kube-multus/0.log" Sep 07 12:53:30.659884 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:30.659863 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9mbh5_bce0dedd-2b68-4c5d-8504-150a18723edd/network-metrics-daemon/0.log" Sep 07 12:53:30.678740 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:30.678722 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9mbh5_bce0dedd-2b68-4c5d-8504-150a18723edd/kube-rbac-proxy/0.log" Sep 07 12:53:31.776149 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:31.776088 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjzqr_3fefce99-6821-40e4-97e3-8348becf8079/ovn-controller/0.log" Sep 07 12:53:31.797765 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:31.797741 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjzqr_3fefce99-6821-40e4-97e3-8348becf8079/ovn-acl-logging/0.log" Sep 07 12:53:31.819958 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:31.819913 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjzqr_3fefce99-6821-40e4-97e3-8348becf8079/kube-rbac-proxy-node/0.log" Sep 07 12:53:31.842839 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:31.842789 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjzqr_3fefce99-6821-40e4-97e3-8348becf8079/kube-rbac-proxy-ovn-metrics/0.log" Sep 07 12:53:31.864900 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:31.864874 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjzqr_3fefce99-6821-40e4-97e3-8348becf8079/northd/0.log" Sep 07 12:53:31.884690 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:31.884665 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjzqr_3fefce99-6821-40e4-97e3-8348becf8079/nbdb/0.log" Sep 07 12:53:31.903350 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:31.903326 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjzqr_3fefce99-6821-40e4-97e3-8348becf8079/sbdb/0.log" Sep 07 12:53:31.937559 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:31.937472 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bjzqr_3fefce99-6821-40e4-97e3-8348becf8079/ovnkube-controller/0.log" Sep 07 12:53:33.095853 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:33.095820 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tsptp_7365e1ad-5b47-499b-ad6e-3748efd38d65/network-check-target-container/0.log" Sep 07 12:53:34.009626 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:34.009547 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-nwvg8_382b48ad-9f65-46b3-9403-fd3fae4b7325/iptables-alerter/0.log" Sep 07 12:53:34.685145 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:34.685117 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hc2g2_8ca94cce-1b24-4320-8849-8472c850f841/tuned/0.log" Sep 07 12:53:36.341213 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:36.341188 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-dckhr_3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8/cluster-samples-operator/0.log" Sep 07 12:53:36.356920 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:36.356896 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-dckhr_3eebd6b1-e0e7-4060-b4a5-e73a4aff4ac8/cluster-samples-operator-watch/0.log" Sep 07 12:53:36.618302 ip-10-0-139-78 kubenswrapper[2579]: I0907 12:53:36.618219 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8lhcw_8c7c1678-7feb-48ce-8e2b-cf787e607364/konnectivity-agent/0.log" limit=1024