Jul 20 16:07:17.982830 ip-10-0-138-156 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 20 16:07:17.982839 ip-10-0-138-156 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 20 16:07:17.982847 ip-10-0-138-156 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 20 16:07:17.983268 ip-10-0-138-156 systemd[1]: Failed to start Kubernetes Kubelet. Jul 20 16:07:28.002215 ip-10-0-138-156 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 20 16:07:28.002230 ip-10-0-138-156 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 129eebb1905b405aa488a92f58e662c0 -- Jul 20 16:09:27.689736 ip-10-0-138-156 systemd[1]: Starting Kubernetes Kubelet... Jul 20 16:09:28.137561 ip-10-0-138-156 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 16:09:28.137561 ip-10-0-138-156 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 16:09:28.137561 ip-10-0-138-156 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 16:09:28.137561 ip-10-0-138-156 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 16:09:28.137561 ip-10-0-138-156 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 16:09:28.139961 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.139839 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 16:09:28.146826 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146810 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:09:28.146826 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146826 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146830 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146834 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146837 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146840 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146843 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146846 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146850 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146853 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146856 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146858 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146861 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146864 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146866 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146869 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146871 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146874 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146877 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146879 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:09:28.146895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146889 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146892 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146894 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146897 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146900 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146903 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146906 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146909 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146911 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146914 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146917 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146919 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146921 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146925 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146927 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146930 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146932 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146935 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146937 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146941 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:09:28.147318 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146943 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146946 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146948 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146950 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146953 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146955 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146958 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146960 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146962 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146965 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146968 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146971 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146973 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146976 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146979 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146983 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146985 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146990 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146994 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:09:28.147817 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.146998 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147002 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147004 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147007 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147010 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147012 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147016 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147020 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147023 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147026 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147030 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147032 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147037 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147040 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147043 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147045 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147048 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147050 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147053 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:09:28.148281 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147055 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147058 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147061 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147063 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147067 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147069 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147072 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147075 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147078 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147081 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147084 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147086 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147089 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147091 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147094 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147096 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147098 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147101 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147103 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147106 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:09:28.148775 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.147109 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148500 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148507 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148511 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148514 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148517 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148521 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148524 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148526 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148529 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148532 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148535 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148538 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148541 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148544 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148546 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148549 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148552 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148554 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148557 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:09:28.149250 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148560 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148562 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148565 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148568 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148572 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148576 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148578 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148581 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148583 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148585 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148588 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148591 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148594 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148596 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148598 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148601 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148604 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148606 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148609 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:09:28.149743 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148612 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148614 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148617 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148620 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148623 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148627 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148631 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148634 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148637 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148639 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148642 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148645 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148648 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148650 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148653 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148656 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148658 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148661 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148664 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148666 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:09:28.150206 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148668 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148671 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148673 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148676 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148678 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148680 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148683 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148685 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148688 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148691 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148694 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148696 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148699 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148703 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148707 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148711 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148713 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148716 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148719 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:09:28.150708 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148722 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148725 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148728 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148730 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148733 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148735 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148738 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148740 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148743 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148746 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148748 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148751 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148753 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148756 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148758 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148761 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148763 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148765 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148768 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148773 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:09:28.151173 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148776 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.148778 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149160 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149165 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149168 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149171 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149175 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149177 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149180 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149183 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149185 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149188 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149191 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149193 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149196 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149199 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149201 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149204 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149206 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149209 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:09:28.151660 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149212 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149214 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149216 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149219 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149222 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149225 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149227 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149230 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149232 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149235 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149237 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149245 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149247 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149250 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149253 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149256 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149259 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149261 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149264 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149267 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:09:28.152128 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149270 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149272 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149275 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149277 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149280 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149283 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149285 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149288 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149291 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149293 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149295 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149298 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149301 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149303 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149306 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149308 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149311 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149313 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149316 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149318 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:09:28.152615 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149321 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149323 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149326 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149330 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149332 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149337 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149340 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149343 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149347 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149349 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149352 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149355 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149358 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149361 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149363 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149366 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149368 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149371 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:09:28.153101 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149373 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149377 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149381 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149383 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149386 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149389 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149391 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149394 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149397 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149400 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149402 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149405 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149408 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149410 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149413 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149415 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149418 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149434 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149437 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:09:28.153576 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149441 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149444 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149446 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.149449 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149517 2569 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149524 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149533 2569 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149540 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149547 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149552 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149557 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149561 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149564 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149567 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149571 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149574 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149577 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149580 2569 flags.go:64] FLAG: --cgroup-root="" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149583 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149586 2569 flags.go:64] FLAG: --client-ca-file="" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149589 2569 flags.go:64] FLAG: --cloud-provider="external" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149592 2569 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149596 2569 flags.go:64] FLAG: --cluster-domain="" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149599 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 16:09:28.154021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149602 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149605 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149609 2569 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149612 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149615 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149618 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149623 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149626 2569 flags.go:64] FLAG: --contention-profiling="false" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149630 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149633 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149636 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149639 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149643 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149646 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149649 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149652 2569 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149655 2569 flags.go:64] FLAG: --enable-server="true" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149658 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149663 2569 flags.go:64] FLAG: --event-burst="100" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149666 2569 flags.go:64] FLAG: --event-qps="50" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149669 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149672 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149675 2569 flags.go:64] FLAG: --eviction-hard="" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149678 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 16:09:28.154596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149681 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149684 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149687 2569 flags.go:64] FLAG: --eviction-soft="" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149689 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149692 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149695 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149698 2569 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149702 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149705 2569 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149707 2569 flags.go:64] FLAG: --feature-gates="" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149711 2569 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149714 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149717 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149720 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149725 2569 flags.go:64] FLAG: --healthz-port="10248" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149728 2569 flags.go:64] FLAG: --help="false" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149732 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-138-156.ec2.internal" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149735 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149738 2569 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149741 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149744 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149747 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149751 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 16:09:28.155176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149753 2569 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149757 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149760 2569 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149763 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149767 2569 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149770 2569 flags.go:64] FLAG: --kube-reserved="" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149773 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149775 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149778 2569 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149781 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149784 2569 flags.go:64] FLAG: --lock-file="" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149787 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149789 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149792 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149797 2569 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149800 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149803 2569 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149806 2569 flags.go:64] FLAG: --logging-format="text" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149808 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149812 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149814 2569 flags.go:64] FLAG: --manifest-url="" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149817 2569 flags.go:64] FLAG: --manifest-url-header="" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149821 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149825 2569 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149829 2569 flags.go:64] FLAG: --max-pods="110" Jul 20 16:09:28.155761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149833 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149836 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149839 2569 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149842 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149845 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149848 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149850 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149857 2569 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149860 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149863 2569 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149866 2569 flags.go:64] FLAG: --pod-cidr="" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149870 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149875 2569 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149878 2569 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149881 2569 flags.go:64] FLAG: --pods-per-core="0" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149884 2569 flags.go:64] FLAG: --port="10250" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149887 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149890 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00008b869c8a1f26e" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149893 2569 flags.go:64] FLAG: --qos-reserved="" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149896 2569 flags.go:64] FLAG: --read-only-port="10255" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149899 2569 flags.go:64] FLAG: --register-node="true" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149902 2569 flags.go:64] FLAG: --register-with-taints="" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149905 2569 flags.go:64] FLAG: --registry-burst="10" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149908 2569 flags.go:64] FLAG: --registry-qps="5" Jul 20 16:09:28.156390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149910 2569 flags.go:64] FLAG: --reserved-cpus="" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149913 2569 flags.go:64] FLAG: --reserved-memory="" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149917 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149920 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149923 2569 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149926 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149928 2569 flags.go:64] FLAG: --runonce="false" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149933 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149935 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149938 2569 flags.go:64] FLAG: --seccomp-default="false" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149941 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149944 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149947 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149950 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149953 2569 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149956 2569 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149959 2569 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149961 2569 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149964 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149967 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149971 2569 flags.go:64] FLAG: --system-cgroups="" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149973 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149979 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149982 2569 flags.go:64] FLAG: --tls-cert-file="" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149985 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 16:09:28.157021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149988 2569 flags.go:64] FLAG: --tls-min-version="" Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149991 2569 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149994 2569 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149997 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.149999 2569 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.150002 2569 flags.go:64] FLAG: --v="2" Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.150006 2569 flags.go:64] FLAG: --version="false" Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.150015 2569 flags.go:64] FLAG: --vmodule="" Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.150019 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.150022 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150162 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150166 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150170 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150174 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150179 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150182 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150185 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150188 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150191 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150193 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150196 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150198 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:09:28.157643 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150201 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150203 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150206 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150210 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150214 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150217 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150221 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150224 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150227 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150229 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150232 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150235 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150238 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150241 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150244 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150248 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150251 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150254 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150257 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:09:28.158274 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150259 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150262 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150264 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150267 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150269 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150273 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150276 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150278 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150281 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150283 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150286 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150288 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150291 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150293 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150295 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150298 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150301 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150303 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150306 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150308 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:09:28.158753 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150311 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150314 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150317 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150320 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150322 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150325 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150327 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150330 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150332 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150335 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150337 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150339 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150342 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150344 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150347 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150350 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150352 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150355 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150357 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150360 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:09:28.159229 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150363 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150365 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150367 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150370 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150372 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150375 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150377 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150380 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150382 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150384 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150387 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150389 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150392 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150394 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150398 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150401 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150403 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150406 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150408 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:09:28.159764 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150411 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:09:28.160465 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150414 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:09:28.160465 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150418 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:09:28.160465 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150436 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:09:28.160465 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150441 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:09:28.160465 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150445 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:09:28.160465 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150450 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:09:28.160465 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150453 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:09:28.160465 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.150455 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:09:28.160465 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.150460 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 16:09:28.160465 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.157253 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 16:09:28.160465 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.157268 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 16:09:28.160465 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.157289 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 16:09:28.160465 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.157295 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 16:09:28.160465 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157355 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157361 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157364 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157367 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157370 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157373 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157376 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157379 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157381 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157384 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157386 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157389 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157392 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157394 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157397 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157399 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157402 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157404 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157407 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157410 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:09:28.161031 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157412 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157415 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157417 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157433 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157436 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157439 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157442 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157445 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157447 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157452 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157455 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157457 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157460 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157463 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157465 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157470 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157474 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157478 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157481 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:09:28.161581 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157484 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157487 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157491 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157493 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157496 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157498 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157501 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157504 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157506 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157509 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157511 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157514 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157516 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157519 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157521 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157524 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157526 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157529 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157532 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157534 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:09:28.162044 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157537 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157539 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157543 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157546 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157549 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157551 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157554 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157556 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157560 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157564 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157567 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157569 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157572 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157575 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157578 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157580 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157583 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157586 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157588 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:09:28.162531 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157591 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157594 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157596 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157599 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157601 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157604 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157606 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157609 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157611 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157614 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157616 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157619 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157621 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157624 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157626 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157630 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157632 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157636 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157638 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157641 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:09:28.162994 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157643 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:09:28.163556 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.157648 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 16:09:28.163556 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157759 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 16:09:28.163556 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157765 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 16:09:28.163556 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157768 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 16:09:28.163556 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157771 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 16:09:28.163556 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157775 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 16:09:28.163556 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157778 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 16:09:28.163556 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157781 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 16:09:28.163556 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157786 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 16:09:28.163556 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157789 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 16:09:28.163556 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157792 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 16:09:28.163556 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157795 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 16:09:28.163556 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157798 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 16:09:28.163556 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157801 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157803 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157806 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157809 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157812 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157815 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157817 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157820 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157822 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157825 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157828 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157830 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157832 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157836 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157839 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157841 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157844 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157847 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157849 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157852 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 16:09:28.163895 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157855 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157857 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157860 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157862 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157865 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157868 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157870 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157873 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157875 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157878 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157880 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157883 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157885 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157888 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157891 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157894 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157896 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157899 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157901 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157904 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 16:09:28.164372 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157906 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157909 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157911 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157913 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157916 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157918 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157922 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157925 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157927 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157930 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157933 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157935 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157938 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157940 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157942 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157945 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157947 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157950 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157954 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157957 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 16:09:28.164953 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157959 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157962 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157965 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157968 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157970 2569 feature_gate.go:328] unrecognized feature gate: Example Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157973 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157975 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157978 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157980 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157983 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157985 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157987 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157990 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157993 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157995 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.157999 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.158002 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.158005 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.158008 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 16:09:28.165555 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.158011 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 16:09:28.166204 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.158014 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 16:09:28.166204 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.158016 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 16:09:28.166204 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.158019 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 16:09:28.166204 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.158022 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 16:09:28.166204 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.158024 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 16:09:28.166204 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.158027 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 16:09:28.166204 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:28.158029 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 16:09:28.166204 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.158034 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 16:09:28.166204 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.158152 2569 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 16:09:28.166204 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.160873 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 16:09:28.166204 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.162474 2569 server.go:1019] "Starting client certificate rotation" Jul 20 16:09:28.166204 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.162576 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 16:09:28.166204 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.162610 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 16:09:28.166204 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.164876 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 16:09:28.166557 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.165983 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 16:09:28.177607 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.177581 2569 log.go:25] "Validated CRI v1 runtime API" Jul 20 16:09:28.180234 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:28.180211 2569 log.go:25] "Validated CRI v1 image API" Jul 20 16:09:29.815616 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.815594 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 16:09:29.818369 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.818351 2569 fs.go:135] Filesystem UUIDs: map[071dd7ce-c59e-4cc0-9f95-a05b21848fb5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b1a209bf-9e38-407c-8706-2471122e34d6:/dev/nvme0n1p3] Jul 20 16:09:29.818428 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.818370 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 16:09:29.824207 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.824075 2569 manager.go:216] Machine: {Timestamp:2026-07-20 16:09:29.822818355 +0000 UTC m=+0.372117645 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3107586 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c3704b595ff9d8e284e5baade759d SystemUUID:ec2c3704-b595-ff9d-8e28-4e5baade759d BootID:129eebb1-905b-405a-a488-a92f58e662c0 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1c:81:5c:cc:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1c:81:5c:cc:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:a6:d8:2a:67:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 16:09:29.824207 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.824196 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 16:09:29.824359 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.824307 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 16:09:29.828061 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.828033 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 16:09:29.828206 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.828064 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-156.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 16:09:29.828455 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.828439 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 16:09:29.829391 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.829378 2569 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 16:09:29.829427 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.829394 2569 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 16:09:29.829427 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.829402 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 16:09:29.830107 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.830096 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 16:09:29.831373 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.831361 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 16:09:29.835118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.835105 2569 state_mem.go:36] "Initialized new in-memory state store" Jul 20 16:09:29.835275 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.835263 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 16:09:29.835308 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.835297 2569 kubelet.go:486] "Attempting to sync node with API server" Jul 20 16:09:29.835354 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.835322 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 16:09:29.835354 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.835341 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 16:09:29.835410 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.835355 2569 kubelet.go:398] "Adding apiserver pod source" Jul 20 16:09:29.835410 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.835367 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 16:09:29.835865 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.835849 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 16:09:29.835934 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.835875 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 16:09:29.838955 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.838931 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 16:09:29.841045 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.841028 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 16:09:29.841114 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.841060 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 16:09:29.842743 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.842730 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 16:09:29.842808 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.842748 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 16:09:29.842808 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.842754 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 16:09:29.842808 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.842760 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 16:09:29.842808 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.842768 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 16:09:29.842808 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.842774 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 16:09:29.842808 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.842782 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 16:09:29.842808 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.842787 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 16:09:29.842808 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.842794 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 16:09:29.842808 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.842808 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 16:09:29.843073 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.842818 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 16:09:29.843073 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.842824 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 16:09:29.843650 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.843639 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 16:09:29.843650 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.843649 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 16:09:29.846993 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.846977 2569 server.go:1268] "Started kubelet" Jul 20 16:09:29.847140 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.847082 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 16:09:29.847204 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.847136 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 16:09:29.847741 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.847169 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 16:09:29.847830 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:29.847778 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-156.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 16:09:29.847830 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.847781 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-156.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 20 16:09:29.847982 ip-10-0-138-156 systemd[1]: Started Kubernetes Kubelet. Jul 20 16:09:29.848072 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:29.848022 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 16:09:29.849402 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.849385 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 16:09:29.850119 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.850105 2569 server.go:310] "Adding debug handlers to kubelet server" Jul 20 16:09:29.853297 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:29.852162 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-156.ec2.internal.18c40b4b2cc26123 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-156.ec2.internal,UID:ip-10-0-138-156.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-156.ec2.internal,},FirstTimestamp:2026-07-20 16:09:29.846948131 +0000 UTC m=+0.396247421,LastTimestamp:2026-07-20 16:09:29.846948131 +0000 UTC m=+0.396247421,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-156.ec2.internal,}" Jul 20 16:09:29.854083 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:29.854064 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 16:09:29.857313 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.857293 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 16:09:29.857396 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.857300 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 16:09:29.857450 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:29.857394 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-156.ec2.internal\" not found" Jul 20 16:09:29.857795 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.857770 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7dr8d" Jul 20 16:09:29.857925 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.857912 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 16:09:29.858025 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.857915 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 16:09:29.858025 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.858026 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 16:09:29.858171 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.858096 2569 reconstruct.go:97] "Volume reconstruction finished" Jul 20 16:09:29.858171 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.858105 2569 reconciler.go:29] "Reconciler: start to sync state" Jul 20 16:09:29.858271 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.858174 2569 factory.go:55] Registering systemd factory Jul 20 16:09:29.858271 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.858189 2569 factory.go:223] Registration of the systemd container factory successfully Jul 20 16:09:29.858457 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.858428 2569 factory.go:153] Registering CRI-O factory Jul 20 16:09:29.858457 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.858444 2569 factory.go:223] Registration of the crio container factory successfully Jul 20 16:09:29.858531 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.858508 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 16:09:29.858729 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.858534 2569 factory.go:103] Registering Raw factory Jul 20 16:09:29.858729 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.858551 2569 manager.go:1196] Started watching for new ooms in manager Jul 20 16:09:29.859083 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.858975 2569 manager.go:349] Starting recovery of all containers Jul 20 16:09:29.863464 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:29.863436 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-156.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 20 16:09:29.863897 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:29.863852 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 20 16:09:29.866839 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.866816 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7dr8d" Jul 20 16:09:29.871657 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.871641 2569 manager.go:354] Recovery completed Jul 20 16:09:29.875892 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.875877 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:09:29.877570 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.877549 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:09:29.877624 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.877582 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:09:29.877624 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.877595 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:09:29.878131 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.878119 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 16:09:29.878131 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.878129 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 16:09:29.878218 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.878147 2569 state_mem.go:36] "Initialized new in-memory state store" Jul 20 16:09:29.878218 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.878131 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:09:29.878856 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.878840 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:09:29.878909 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.878864 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:09:29.878909 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.878875 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:09:29.879397 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.879385 2569 policy_none.go:49] "None policy: Start" Jul 20 16:09:29.879431 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.879402 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 16:09:29.879431 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.879412 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 16:09:29.880163 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:29.880099 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-156.ec2.internal.18c40b4b2e959f3e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-156.ec2.internal,UID:ip-10-0-138-156.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-156.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-156.ec2.internal,},FirstTimestamp:2026-07-20 16:09:29.877569342 +0000 UTC m=+0.426868635,LastTimestamp:2026-07-20 16:09:29.877569342 +0000 UTC m=+0.426868635,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-156.ec2.internal,}" Jul 20 16:09:29.880393 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.880381 2569 policy_none.go:47] "Start" Jul 20 16:09:29.913941 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.913778 2569 manager.go:337] "Starting Device Plugin manager" Jul 20 16:09:29.914021 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:29.913978 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 16:09:29.914021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.913995 2569 server.go:87] "Starting device plugin registration server" Jul 20 16:09:29.914262 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.914251 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 16:09:29.914294 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.914265 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 16:09:29.914515 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.914382 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 16:09:29.914515 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.914479 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 16:09:29.914515 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:29.914491 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 16:09:29.915034 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:29.915015 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 16:09:29.915105 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:29.915073 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-156.ec2.internal\" not found" Jul 20 16:09:30.014656 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.014630 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:09:30.015883 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.015556 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:09:30.015883 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.015585 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:09:30.015883 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.015595 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:09:30.015883 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.015620 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.021972 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.021932 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.021972 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:30.021956 2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-156.ec2.internal\": node \"ip-10-0-138-156.ec2.internal\" not found" Jul 20 16:09:30.034845 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:30.034825 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-156.ec2.internal\" not found" Jul 20 16:09:30.036979 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.036950 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 16:09:30.038226 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.038208 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 16:09:30.038346 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.038259 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 16:09:30.038346 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.038282 2569 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 16:09:30.038346 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:30.038328 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 16:09:30.040457 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.040436 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:09:30.135521 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:30.135474 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-156.ec2.internal\" not found" Jul 20 16:09:30.138605 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.138588 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-156.ec2.internal"] Jul 20 16:09:30.138697 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.138687 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:09:30.141418 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.141404 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:09:30.141480 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.141434 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:09:30.141480 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.141444 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:09:30.142738 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.142726 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:09:30.142852 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.142838 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.142892 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.142867 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:09:30.143566 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.143549 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:09:30.143566 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.143562 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:09:30.143683 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.143578 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:09:30.143683 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.143593 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:09:30.143683 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.143582 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:09:30.143683 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.143662 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:09:30.144962 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.144949 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.145016 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.144972 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 16:09:30.145680 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.145662 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasSufficientMemory" Jul 20 16:09:30.145788 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.145686 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 16:09:30.145788 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.145695 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeHasSufficientPID" Jul 20 16:09:30.159299 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.159284 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bd63e6417e0a2d05f51de44ace816aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal\" (UID: \"1bd63e6417e0a2d05f51de44ace816aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.159377 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.159305 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b679fc128ec345ad8c5a7680ba39ba5b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-156.ec2.internal\" (UID: \"b679fc128ec345ad8c5a7680ba39ba5b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.159377 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.159325 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1bd63e6417e0a2d05f51de44ace816aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal\" (UID: \"1bd63e6417e0a2d05f51de44ace816aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.164794 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:30.164778 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-156.ec2.internal\" not found" node="ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.168615 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:30.168599 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-156.ec2.internal\" not found" node="ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.240143 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:30.240119 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-156.ec2.internal\" not found" Jul 20 16:09:30.259458 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.259437 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1bd63e6417e0a2d05f51de44ace816aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal\" (UID: \"1bd63e6417e0a2d05f51de44ace816aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.259520 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.259476 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bd63e6417e0a2d05f51de44ace816aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal\" (UID: \"1bd63e6417e0a2d05f51de44ace816aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.259520 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.259495 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b679fc128ec345ad8c5a7680ba39ba5b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-156.ec2.internal\" (UID: \"b679fc128ec345ad8c5a7680ba39ba5b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.259586 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.259542 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b679fc128ec345ad8c5a7680ba39ba5b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-156.ec2.internal\" (UID: \"b679fc128ec345ad8c5a7680ba39ba5b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.259586 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.259546 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1bd63e6417e0a2d05f51de44ace816aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal\" (UID: \"1bd63e6417e0a2d05f51de44ace816aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.259586 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.259551 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bd63e6417e0a2d05f51de44ace816aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal\" (UID: \"1bd63e6417e0a2d05f51de44ace816aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.340795 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:30.340726 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-156.ec2.internal\" not found" Jul 20 16:09:30.441284 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:30.441211 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-156.ec2.internal\" not found" Jul 20 16:09:30.468678 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.468660 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.471328 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.471311 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.542168 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:30.542142 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-156.ec2.internal\" not found" Jul 20 16:09:30.642690 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:30.642628 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-156.ec2.internal\" not found" Jul 20 16:09:30.743288 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:30.743256 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-156.ec2.internal\" not found" Jul 20 16:09:30.756907 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.756889 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:09:30.795368 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.795350 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 16:09:30.795719 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.795462 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 16:09:30.795719 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.795495 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 16:09:30.843903 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:30.843874 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-156.ec2.internal\" not found" Jul 20 16:09:30.872608 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.872570 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 16:04:29 +0000 UTC" deadline="2028-04-22 13:16:42.61721895 +0000 UTC" Jul 20 16:09:30.872608 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.872599 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15405h7m11.744622378s" Jul 20 16:09:30.904667 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.904603 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:09:30.957607 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.957581 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.970080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.970056 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 16:09:30.971871 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.971852 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-156.ec2.internal" Jul 20 16:09:30.981334 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:30.981314 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 16:09:31.029640 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:31.029610 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb679fc128ec345ad8c5a7680ba39ba5b.slice/crio-82ee09ba06cf630319f106452d9b6ace7d608998ff1ee087e054f9ec72d6ce69 WatchSource:0}: Error finding container 82ee09ba06cf630319f106452d9b6ace7d608998ff1ee087e054f9ec72d6ce69: Status 404 returned error can't find the container with id 82ee09ba06cf630319f106452d9b6ace7d608998ff1ee087e054f9ec72d6ce69 Jul 20 16:09:31.029858 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:31.029839 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd63e6417e0a2d05f51de44ace816aa.slice/crio-98313b35cfd7c5a6646589e8250770feb6844252aaa8e5ef9d220b45f7234902 WatchSource:0}: Error finding container 98313b35cfd7c5a6646589e8250770feb6844252aaa8e5ef9d220b45f7234902: Status 404 returned error can't find the container with id 98313b35cfd7c5a6646589e8250770feb6844252aaa8e5ef9d220b45f7234902 Jul 20 16:09:31.034855 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.034841 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:09:31.041208 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.041167 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal" event={"ID":"1bd63e6417e0a2d05f51de44ace816aa","Type":"ContainerStarted","Data":"98313b35cfd7c5a6646589e8250770feb6844252aaa8e5ef9d220b45f7234902"} Jul 20 16:09:31.042262 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.042222 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-156.ec2.internal" event={"ID":"b679fc128ec345ad8c5a7680ba39ba5b","Type":"ContainerStarted","Data":"82ee09ba06cf630319f106452d9b6ace7d608998ff1ee087e054f9ec72d6ce69"} Jul 20 16:09:31.043274 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.043258 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:09:31.836519 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.836485 2569 apiserver.go:52] "Watching apiserver" Jul 20 16:09:31.845387 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.845182 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 16:09:31.845673 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.845642 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-fzrbx","openshift-dns/node-resolver-4t89d","openshift-multus/multus-additional-cni-plugins-fpvnh","openshift-multus/multus-cj8gg","openshift-network-diagnostics/network-check-target-62crl","openshift-network-operator/iptables-alerter-f96wb","openshift-ovn-kubernetes/ovnkube-node-j5x9t","kube-system/global-pull-secret-syncer-jn4lt","kube-system/konnectivity-agent-6c2ms","kube-system/kube-apiserver-proxy-ip-10-0-138-156.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv","openshift-cluster-node-tuning-operator/tuned-ppzkq","openshift-image-registry/node-ca-p8s8r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal"] Jul 20 16:09:31.847427 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.847397 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:31.847551 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:31.847481 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:09:31.849262 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.849220 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4t89d" Jul 20 16:09:31.850343 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.850319 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.851788 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.851771 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.852455 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.852436 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hk4bn\"" Jul 20 16:09:31.852657 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.852641 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 16:09:31.852861 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.852846 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 16:09:31.853284 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.853266 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 16:09:31.853435 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.853411 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 16:09:31.853520 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.853453 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 16:09:31.853520 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.853473 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sh65m\"" Jul 20 16:09:31.853520 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.853502 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 16:09:31.853676 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.853417 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 16:09:31.853676 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.853611 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:31.853676 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:31.853666 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:09:31.854325 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.854288 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 16:09:31.854685 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.854669 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fg2w7\"" Jul 20 16:09:31.854881 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.854858 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f96wb" Jul 20 16:09:31.856122 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.856104 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.857569 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.857549 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 16:09:31.857895 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.857851 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:31.857980 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:31.857908 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:09:31.858354 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.858115 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:09:31.858354 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.858146 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 16:09:31.858354 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.858203 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 16:09:31.858354 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.858260 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gdxnx\"" Jul 20 16:09:31.859710 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.859662 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6c2ms" Jul 20 16:09:31.861207 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.861172 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 16:09:31.861597 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.861581 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 16:09:31.861961 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.861942 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 16:09:31.862088 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.862063 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 16:09:31.862825 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.862796 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 16:09:31.862925 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.862847 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h7d5t\"" Jul 20 16:09:31.863930 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.863148 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 16:09:31.863930 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.863362 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 16:09:31.863930 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.863718 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v9lf7\"" Jul 20 16:09:31.863930 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.863773 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 16:09:31.864153 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.864048 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:31.866060 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.866039 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:31.867503 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867482 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p8s8r" Jul 20 16:09:31.867503 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867494 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 16:09:31.867644 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867519 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8dc04f1-d7ca-4632-98a7-086b49b0513a-system-cni-dir\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.867644 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867547 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8dc04f1-d7ca-4632-98a7-086b49b0513a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.867644 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867556 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 16:09:31.867644 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867571 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-system-cni-dir\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.867644 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867595 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-multus-conf-dir\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.867644 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867615 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 16:09:31.867644 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867620 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-systemd-units\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.867644 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867643 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c29c040-f0ab-430a-9996-4ea896634f6f-multus-daemon-config\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.868021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867665 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-multus-cni-dir\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.868021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867688 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-var-lib-cni-multus\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.868021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867728 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-var-lib-kubelet\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.868021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867784 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-node-log\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.868021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867810 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e49166de-d769-4f5b-8829-46cd62bd63dc-ovnkube-config\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.868021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867834 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e49166de-d769-4f5b-8829-46cd62bd63dc-env-overrides\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.868021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867856 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e116ef2-0fca-44f3-84c2-86b3bde42a78-kubelet-config\") pod \"global-pull-secret-syncer-jn4lt\" (UID: \"8e116ef2-0fca-44f3-84c2-86b3bde42a78\") " pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:31.868021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867879 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8cd0d1d-b1b3-4420-9430-667b02723ae5-agent-certs\") pod \"konnectivity-agent-6c2ms\" (UID: \"e8cd0d1d-b1b3-4420-9430-667b02723ae5\") " pod="kube-system/konnectivity-agent-6c2ms" Jul 20 16:09:31.868021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867901 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f8eb516-d99a-4adf-afdd-10ea8779634a-host-slash\") pod \"iptables-alerter-f96wb\" (UID: \"7f8eb516-d99a-4adf-afdd-10ea8779634a\") " pod="openshift-network-operator/iptables-alerter-f96wb" Jul 20 16:09:31.868021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867924 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-kubelet\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.868021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867902 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ng2tw\"" Jul 20 16:09:31.868021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867949 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e49166de-d769-4f5b-8829-46cd62bd63dc-ovnkube-script-lib\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.868021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.867981 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwbv5\" (UniqueName: \"kubernetes.io/projected/e8dc04f1-d7ca-4632-98a7-086b49b0513a-kube-api-access-qwbv5\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.868021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868024 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-hostroot\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.868668 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868050 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtfmn\" (UniqueName: \"kubernetes.io/projected/4c29c040-f0ab-430a-9996-4ea896634f6f-kube-api-access-dtfmn\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.868668 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868075 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqrh7\" (UniqueName: \"kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7\") pod \"network-check-target-62crl\" (UID: \"3f2af8e3-e9b2-492d-9b37-351d28c756a6\") " pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:31.868668 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868111 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6bxk\" (UniqueName: \"kubernetes.io/projected/7f8eb516-d99a-4adf-afdd-10ea8779634a-kube-api-access-g6bxk\") pod \"iptables-alerter-f96wb\" (UID: \"7f8eb516-d99a-4adf-afdd-10ea8779634a\") " pod="openshift-network-operator/iptables-alerter-f96wb" Jul 20 16:09:31.868668 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868138 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-run-openvswitch\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.868668 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868170 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8dc04f1-d7ca-4632-98a7-086b49b0513a-cni-binary-copy\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.868668 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868192 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-multus-socket-dir-parent\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.868668 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868208 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-etc-kubernetes\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.868668 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868242 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87285192-3790-4b9e-bd2b-dbec974fe2d4-tmp-dir\") pod \"node-resolver-4t89d\" (UID: \"87285192-3790-4b9e-bd2b-dbec974fe2d4\") " pod="openshift-dns/node-resolver-4t89d" Jul 20 16:09:31.868668 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868267 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8cd0d1d-b1b3-4420-9430-667b02723ae5-konnectivity-ca\") pod \"konnectivity-agent-6c2ms\" (UID: \"e8cd0d1d-b1b3-4420-9430-667b02723ae5\") " pod="kube-system/konnectivity-agent-6c2ms" Jul 20 16:09:31.868668 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868289 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e49166de-d769-4f5b-8829-46cd62bd63dc-ovn-node-metrics-cert\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.868668 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868308 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.868668 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868333 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8dc04f1-d7ca-4632-98a7-086b49b0513a-cnibin\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.868668 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868353 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8dc04f1-d7ca-4632-98a7-086b49b0513a-os-release\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.868668 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868369 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-run-k8s-cni-cncf-io\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.868668 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868406 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/87285192-3790-4b9e-bd2b-dbec974fe2d4-hosts-file\") pod \"node-resolver-4t89d\" (UID: \"87285192-3790-4b9e-bd2b-dbec974fe2d4\") " pod="openshift-dns/node-resolver-4t89d" Jul 20 16:09:31.868668 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868437 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-run-ovn\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868458 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs\") pod \"network-metrics-daemon-fzrbx\" (UID: \"586b30af-aafe-48c8-a1c9-cd97c9bcbeb7\") " pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868477 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-run-netns\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868542 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-cni-bin\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868567 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-cni-netd\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868589 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e116ef2-0fca-44f3-84c2-86b3bde42a78-dbus\") pod \"global-pull-secret-syncer-jn4lt\" (UID: \"8e116ef2-0fca-44f3-84c2-86b3bde42a78\") " pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868612 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtgd5\" (UniqueName: \"kubernetes.io/projected/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-kube-api-access-mtgd5\") pod \"network-metrics-daemon-fzrbx\" (UID: \"586b30af-aafe-48c8-a1c9-cd97c9bcbeb7\") " pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868636 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c29c040-f0ab-430a-9996-4ea896634f6f-cni-binary-copy\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868638 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868658 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75g99\" (UniqueName: \"kubernetes.io/projected/87285192-3790-4b9e-bd2b-dbec974fe2d4-kube-api-access-75g99\") pod \"node-resolver-4t89d\" (UID: \"87285192-3790-4b9e-bd2b-dbec974fe2d4\") " pod="openshift-dns/node-resolver-4t89d" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868737 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f8eb516-d99a-4adf-afdd-10ea8779634a-iptables-alerter-script\") pod \"iptables-alerter-f96wb\" (UID: \"7f8eb516-d99a-4adf-afdd-10ea8779634a\") " pod="openshift-network-operator/iptables-alerter-f96wb" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868761 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-run-systemd\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868785 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-var-lib-openvswitch\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868809 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psvvm\" (UniqueName: \"kubernetes.io/projected/e49166de-d769-4f5b-8829-46cd62bd63dc-kube-api-access-psvvm\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868831 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-var-lib-cni-bin\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868863 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8dc04f1-d7ca-4632-98a7-086b49b0513a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868889 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-log-socket\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.869370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868910 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-cnibin\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.870024 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868935 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-run-multus-certs\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.870024 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868959 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret\") pod \"global-pull-secret-syncer-jn4lt\" (UID: \"8e116ef2-0fca-44f3-84c2-86b3bde42a78\") " pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:31.870024 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868982 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-slash\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.870024 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.868986 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 16:09:31.870024 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.869002 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mpl55\"" Jul 20 16:09:31.870024 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.869003 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-run-netns\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.870024 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.869051 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-etc-openvswitch\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.870024 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.869085 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.870024 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.869130 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8dc04f1-d7ca-4632-98a7-086b49b0513a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.870024 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.869171 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-os-release\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.870024 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.870001 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 16:09:31.870542 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.870305 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 16:09:31.870542 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.870443 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 16:09:31.870542 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.870456 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zrhl7\"" Jul 20 16:09:31.870684 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.870542 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 16:09:31.891801 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.891762 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8zrnr" Jul 20 16:09:31.900611 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.900578 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8zrnr" Jul 20 16:09:31.926131 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.926100 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:09:31.958948 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.958922 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 16:09:31.969609 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.969582 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-cnibin\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.969765 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.969616 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-run-multus-certs\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.969765 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.969645 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-kubernetes\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:31.969765 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.969666 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-systemd\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:31.969765 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.969687 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-var-lib-kubelet\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:31.969765 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.969709 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-cnibin\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.969765 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.969709 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-run-multus-certs\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.969765 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.969712 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret\") pod \"global-pull-secret-syncer-jn4lt\" (UID: \"8e116ef2-0fca-44f3-84c2-86b3bde42a78\") " pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:31.970105 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.969774 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-sysconfig\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:31.970105 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.969801 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce16b1f2-4958-479c-b384-29b4d141a0ba-tmp\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:31.970105 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:31.969820 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:09:31.970105 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.969844 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-slash\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.970105 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.969824 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-slash\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.970105 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:31.969912 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret podName:8e116ef2-0fca-44f3-84c2-86b3bde42a78 nodeName:}" failed. No retries permitted until 2026-07-20 16:09:32.469881398 +0000 UTC m=+3.019180697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret") pod "global-pull-secret-syncer-jn4lt" (UID: "8e116ef2-0fca-44f3-84c2-86b3bde42a78") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:09:31.970105 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.969930 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-run-netns\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.970105 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.969957 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-etc-openvswitch\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.970105 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.969983 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.970105 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970005 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-run-netns\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.970105 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970026 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-etc-openvswitch\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.970105 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970037 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.970105 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970046 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8dc04f1-d7ca-4632-98a7-086b49b0513a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.970105 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970069 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-os-release\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.970105 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970086 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8dc04f1-d7ca-4632-98a7-086b49b0513a-system-cni-dir\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.970105 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970104 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8dc04f1-d7ca-4632-98a7-086b49b0513a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970154 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8dc04f1-d7ca-4632-98a7-086b49b0513a-system-cni-dir\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970166 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-os-release\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970188 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8dc04f1-d7ca-4632-98a7-086b49b0513a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970199 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-system-cni-dir\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970283 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-system-cni-dir\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970302 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-multus-conf-dir\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970331 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-socket-dir\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970337 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-multus-conf-dir\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970348 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-registration-dir\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970388 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-lib-modules\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970418 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-systemd-units\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970445 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c29c040-f0ab-430a-9996-4ea896634f6f-multus-daemon-config\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970470 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-sys-fs\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970484 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-systemd-units\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970494 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-multus-cni-dir\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970541 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-var-lib-cni-multus\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.970790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970568 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-var-lib-kubelet\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970592 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-node-log\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970620 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e49166de-d769-4f5b-8829-46cd62bd63dc-ovnkube-config\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970623 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8dc04f1-d7ca-4632-98a7-086b49b0513a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970644 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e49166de-d769-4f5b-8829-46cd62bd63dc-env-overrides\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970671 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e116ef2-0fca-44f3-84c2-86b3bde42a78-kubelet-config\") pod \"global-pull-secret-syncer-jn4lt\" (UID: \"8e116ef2-0fca-44f3-84c2-86b3bde42a78\") " pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970696 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8cd0d1d-b1b3-4420-9430-667b02723ae5-agent-certs\") pod \"konnectivity-agent-6c2ms\" (UID: \"e8cd0d1d-b1b3-4420-9430-667b02723ae5\") " pod="kube-system/konnectivity-agent-6c2ms" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970721 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f8eb516-d99a-4adf-afdd-10ea8779634a-host-slash\") pod \"iptables-alerter-f96wb\" (UID: \"7f8eb516-d99a-4adf-afdd-10ea8779634a\") " pod="openshift-network-operator/iptables-alerter-f96wb" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970734 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-multus-cni-dir\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970748 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-kubelet\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970745 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-var-lib-cni-multus\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970773 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e49166de-d769-4f5b-8829-46cd62bd63dc-ovnkube-script-lib\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970807 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwbv5\" (UniqueName: \"kubernetes.io/projected/e8dc04f1-d7ca-4632-98a7-086b49b0513a-kube-api-access-qwbv5\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970832 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-hostroot\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970899 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtfmn\" (UniqueName: \"kubernetes.io/projected/4c29c040-f0ab-430a-9996-4ea896634f6f-kube-api-access-dtfmn\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970927 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h85l\" (UniqueName: \"kubernetes.io/projected/285af9dc-62d9-4bd9-858c-9d8ccfcea829-kube-api-access-6h85l\") pod \"node-ca-p8s8r\" (UID: \"285af9dc-62d9-4bd9-858c-9d8ccfcea829\") " pod="openshift-image-registry/node-ca-p8s8r" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970951 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-device-dir\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:31.971645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970969 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-kubelet\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.970975 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-sys\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971028 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-hostroot\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971198 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-var-lib-kubelet\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971249 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e49166de-d769-4f5b-8829-46cd62bd63dc-ovnkube-config\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971321 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-node-log\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971044 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqrh7\" (UniqueName: \"kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7\") pod \"network-check-target-62crl\" (UID: \"3f2af8e3-e9b2-492d-9b37-351d28c756a6\") " pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971611 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e116ef2-0fca-44f3-84c2-86b3bde42a78-kubelet-config\") pod \"global-pull-secret-syncer-jn4lt\" (UID: \"8e116ef2-0fca-44f3-84c2-86b3bde42a78\") " pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971622 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6bxk\" (UniqueName: \"kubernetes.io/projected/7f8eb516-d99a-4adf-afdd-10ea8779634a-kube-api-access-g6bxk\") pod \"iptables-alerter-f96wb\" (UID: \"7f8eb516-d99a-4adf-afdd-10ea8779634a\") " pod="openshift-network-operator/iptables-alerter-f96wb" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971636 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c29c040-f0ab-430a-9996-4ea896634f6f-multus-daemon-config\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971658 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-run-openvswitch\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971684 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8dc04f1-d7ca-4632-98a7-086b49b0513a-cni-binary-copy\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971710 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-multus-socket-dir-parent\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971732 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-etc-kubernetes\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971758 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-modprobe-d\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971783 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-sysctl-conf\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971788 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-run-openvswitch\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.972419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971804 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e49166de-d769-4f5b-8829-46cd62bd63dc-ovnkube-script-lib\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971782 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e49166de-d769-4f5b-8829-46cd62bd63dc-env-overrides\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971811 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87285192-3790-4b9e-bd2b-dbec974fe2d4-tmp-dir\") pod \"node-resolver-4t89d\" (UID: \"87285192-3790-4b9e-bd2b-dbec974fe2d4\") " pod="openshift-dns/node-resolver-4t89d" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971848 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-etc-kubernetes\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971868 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8cd0d1d-b1b3-4420-9430-667b02723ae5-konnectivity-ca\") pod \"konnectivity-agent-6c2ms\" (UID: \"e8cd0d1d-b1b3-4420-9430-667b02723ae5\") " pod="kube-system/konnectivity-agent-6c2ms" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971875 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-multus-socket-dir-parent\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971896 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e49166de-d769-4f5b-8829-46cd62bd63dc-ovn-node-metrics-cert\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971923 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971948 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8dc04f1-d7ca-4632-98a7-086b49b0513a-cnibin\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.972011 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8dc04f1-d7ca-4632-98a7-086b49b0513a-cnibin\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.972319 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8dc04f1-d7ca-4632-98a7-086b49b0513a-os-release\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.972881 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-run-k8s-cni-cncf-io\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.972701 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.971921 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f8eb516-d99a-4adf-afdd-10ea8779634a-host-slash\") pod \"iptables-alerter-f96wb\" (UID: \"7f8eb516-d99a-4adf-afdd-10ea8779634a\") " pod="openshift-network-operator/iptables-alerter-f96wb" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.972915 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/285af9dc-62d9-4bd9-858c-9d8ccfcea829-host\") pod \"node-ca-p8s8r\" (UID: \"285af9dc-62d9-4bd9-858c-9d8ccfcea829\") " pod="openshift-image-registry/node-ca-p8s8r" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.972823 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87285192-3790-4b9e-bd2b-dbec974fe2d4-tmp-dir\") pod \"node-resolver-4t89d\" (UID: \"87285192-3790-4b9e-bd2b-dbec974fe2d4\") " pod="openshift-dns/node-resolver-4t89d" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.972739 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8cd0d1d-b1b3-4420-9430-667b02723ae5-konnectivity-ca\") pod \"konnectivity-agent-6c2ms\" (UID: \"e8cd0d1d-b1b3-4420-9430-667b02723ae5\") " pod="kube-system/konnectivity-agent-6c2ms" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.972838 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 16:09:31.973165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.972776 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8dc04f1-d7ca-4632-98a7-086b49b0513a-cni-binary-copy\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.972971 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-sysctl-d\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973003 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-run-k8s-cni-cncf-io\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973089 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8dc04f1-d7ca-4632-98a7-086b49b0513a-os-release\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973201 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-host\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973264 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/87285192-3790-4b9e-bd2b-dbec974fe2d4-hosts-file\") pod \"node-resolver-4t89d\" (UID: \"87285192-3790-4b9e-bd2b-dbec974fe2d4\") " pod="openshift-dns/node-resolver-4t89d" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973292 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-run-ovn\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973324 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs\") pod \"network-metrics-daemon-fzrbx\" (UID: \"586b30af-aafe-48c8-a1c9-cd97c9bcbeb7\") " pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973356 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-run-netns\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973388 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-etc-selinux\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973415 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-tuned\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973448 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz8b2\" (UniqueName: \"kubernetes.io/projected/ce16b1f2-4958-479c-b384-29b4d141a0ba-kube-api-access-fz8b2\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973483 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-cni-bin\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973514 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-cni-netd\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973551 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e116ef2-0fca-44f3-84c2-86b3bde42a78-dbus\") pod \"global-pull-secret-syncer-jn4lt\" (UID: \"8e116ef2-0fca-44f3-84c2-86b3bde42a78\") " pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973580 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtgd5\" (UniqueName: \"kubernetes.io/projected/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-kube-api-access-mtgd5\") pod \"network-metrics-daemon-fzrbx\" (UID: \"586b30af-aafe-48c8-a1c9-cd97c9bcbeb7\") " pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973614 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c29c040-f0ab-430a-9996-4ea896634f6f-cni-binary-copy\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973668 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q882\" (UniqueName: \"kubernetes.io/projected/16873ea8-9a09-40e6-b5fd-324b65fe693b-kube-api-access-9q882\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:31.974080 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:31.973769 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:31.973837 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs podName:586b30af-aafe-48c8-a1c9-cd97c9bcbeb7 nodeName:}" failed. No retries permitted until 2026-07-20 16:09:32.47381905 +0000 UTC m=+3.023118344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs") pod "network-metrics-daemon-fzrbx" (UID: "586b30af-aafe-48c8-a1c9-cd97c9bcbeb7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973900 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-run-ovn\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.973941 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-run-netns\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.974009 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e116ef2-0fca-44f3-84c2-86b3bde42a78-dbus\") pod \"global-pull-secret-syncer-jn4lt\" (UID: \"8e116ef2-0fca-44f3-84c2-86b3bde42a78\") " pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.974066 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-cni-bin\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.974105 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-host-cni-netd\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.974134 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c29c040-f0ab-430a-9996-4ea896634f6f-cni-binary-copy\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.974157 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75g99\" (UniqueName: \"kubernetes.io/projected/87285192-3790-4b9e-bd2b-dbec974fe2d4-kube-api-access-75g99\") pod \"node-resolver-4t89d\" (UID: \"87285192-3790-4b9e-bd2b-dbec974fe2d4\") " pod="openshift-dns/node-resolver-4t89d" Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.974247 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/87285192-3790-4b9e-bd2b-dbec974fe2d4-hosts-file\") pod \"node-resolver-4t89d\" (UID: \"87285192-3790-4b9e-bd2b-dbec974fe2d4\") " pod="openshift-dns/node-resolver-4t89d" Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.974619 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f8eb516-d99a-4adf-afdd-10ea8779634a-iptables-alerter-script\") pod \"iptables-alerter-f96wb\" (UID: \"7f8eb516-d99a-4adf-afdd-10ea8779634a\") " pod="openshift-network-operator/iptables-alerter-f96wb" Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.974652 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-run-systemd\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.974688 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-var-lib-openvswitch\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.974720 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psvvm\" (UniqueName: \"kubernetes.io/projected/e49166de-d769-4f5b-8829-46cd62bd63dc-kube-api-access-psvvm\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.974759 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-run\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.974792 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-var-lib-cni-bin\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.974839 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8dc04f1-d7ca-4632-98a7-086b49b0513a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.974944 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.974872 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/285af9dc-62d9-4bd9-858c-9d8ccfcea829-serviceca\") pod \"node-ca-p8s8r\" (UID: \"285af9dc-62d9-4bd9-858c-9d8ccfcea829\") " pod="openshift-image-registry/node-ca-p8s8r" Jul 20 16:09:31.975804 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.974903 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:31.975804 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.974940 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-log-socket\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.975804 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.975048 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-log-socket\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.975804 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.975543 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-run-systemd\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.975804 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.975596 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e49166de-d769-4f5b-8829-46cd62bd63dc-var-lib-openvswitch\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.975804 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.975639 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f8eb516-d99a-4adf-afdd-10ea8779634a-iptables-alerter-script\") pod \"iptables-alerter-f96wb\" (UID: \"7f8eb516-d99a-4adf-afdd-10ea8779634a\") " pod="openshift-network-operator/iptables-alerter-f96wb" Jul 20 16:09:31.975804 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.975718 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c29c040-f0ab-430a-9996-4ea896634f6f-host-var-lib-cni-bin\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.976820 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.976183 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8dc04f1-d7ca-4632-98a7-086b49b0513a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.976820 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.976764 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e49166de-d769-4f5b-8829-46cd62bd63dc-ovn-node-metrics-cert\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.976957 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.976905 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8cd0d1d-b1b3-4420-9430-667b02723ae5-agent-certs\") pod \"konnectivity-agent-6c2ms\" (UID: \"e8cd0d1d-b1b3-4420-9430-667b02723ae5\") " pod="kube-system/konnectivity-agent-6c2ms" Jul 20 16:09:31.978622 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:31.978601 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:09:31.978746 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:31.978626 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:09:31.978746 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:31.978640 2569 projected.go:196] Error preparing data for projected volume kube-api-access-sqrh7 for pod openshift-network-diagnostics/network-check-target-62crl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:09:31.978877 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:31.978817 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7 podName:3f2af8e3-e9b2-492d-9b37-351d28c756a6 nodeName:}" failed. No retries permitted until 2026-07-20 16:09:32.478790093 +0000 UTC m=+3.028089389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sqrh7" (UniqueName: "kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7") pod "network-check-target-62crl" (UID: "3f2af8e3-e9b2-492d-9b37-351d28c756a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:09:31.981102 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.981079 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtfmn\" (UniqueName: \"kubernetes.io/projected/4c29c040-f0ab-430a-9996-4ea896634f6f-kube-api-access-dtfmn\") pod \"multus-cj8gg\" (UID: \"4c29c040-f0ab-430a-9996-4ea896634f6f\") " pod="openshift-multus/multus-cj8gg" Jul 20 16:09:31.981195 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.981126 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwbv5\" (UniqueName: \"kubernetes.io/projected/e8dc04f1-d7ca-4632-98a7-086b49b0513a-kube-api-access-qwbv5\") pod \"multus-additional-cni-plugins-fpvnh\" (UID: \"e8dc04f1-d7ca-4632-98a7-086b49b0513a\") " pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:31.981195 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.981145 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6bxk\" (UniqueName: \"kubernetes.io/projected/7f8eb516-d99a-4adf-afdd-10ea8779634a-kube-api-access-g6bxk\") pod \"iptables-alerter-f96wb\" (UID: \"7f8eb516-d99a-4adf-afdd-10ea8779634a\") " pod="openshift-network-operator/iptables-alerter-f96wb" Jul 20 16:09:31.987820 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.987789 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtgd5\" (UniqueName: \"kubernetes.io/projected/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-kube-api-access-mtgd5\") pod \"network-metrics-daemon-fzrbx\" (UID: \"586b30af-aafe-48c8-a1c9-cd97c9bcbeb7\") " pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:31.987951 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.987903 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psvvm\" (UniqueName: \"kubernetes.io/projected/e49166de-d769-4f5b-8829-46cd62bd63dc-kube-api-access-psvvm\") pod \"ovnkube-node-j5x9t\" (UID: \"e49166de-d769-4f5b-8829-46cd62bd63dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:31.988092 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:31.988065 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75g99\" (UniqueName: \"kubernetes.io/projected/87285192-3790-4b9e-bd2b-dbec974fe2d4-kube-api-access-75g99\") pod \"node-resolver-4t89d\" (UID: \"87285192-3790-4b9e-bd2b-dbec974fe2d4\") " pod="openshift-dns/node-resolver-4t89d" Jul 20 16:09:32.076211 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076178 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-modprobe-d\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076211 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076211 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-sysctl-conf\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076471 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076243 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/285af9dc-62d9-4bd9-858c-9d8ccfcea829-host\") pod \"node-ca-p8s8r\" (UID: \"285af9dc-62d9-4bd9-858c-9d8ccfcea829\") " pod="openshift-image-registry/node-ca-p8s8r" Jul 20 16:09:32.076471 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076265 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-sysctl-d\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076471 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076308 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-host\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076471 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076344 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-etc-selinux\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:32.076471 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076365 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-tuned\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076471 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076387 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz8b2\" (UniqueName: \"kubernetes.io/projected/ce16b1f2-4958-479c-b384-29b4d141a0ba-kube-api-access-fz8b2\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076471 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076390 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-modprobe-d\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076471 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076413 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q882\" (UniqueName: \"kubernetes.io/projected/16873ea8-9a09-40e6-b5fd-324b65fe693b-kube-api-access-9q882\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:32.076471 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076439 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-run\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076471 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076456 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-host\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076471 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076459 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/285af9dc-62d9-4bd9-858c-9d8ccfcea829-serviceca\") pod \"node-ca-p8s8r\" (UID: \"285af9dc-62d9-4bd9-858c-9d8ccfcea829\") " pod="openshift-image-registry/node-ca-p8s8r" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076501 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076527 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-kubernetes\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076530 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/285af9dc-62d9-4bd9-858c-9d8ccfcea829-host\") pod \"node-ca-p8s8r\" (UID: \"285af9dc-62d9-4bd9-858c-9d8ccfcea829\") " pod="openshift-image-registry/node-ca-p8s8r" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076544 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-systemd\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076567 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-var-lib-kubelet\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076609 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-sysconfig\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076626 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce16b1f2-4958-479c-b384-29b4d141a0ba-tmp\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076649 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-socket-dir\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076652 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-etc-selinux\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076674 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-registration-dir\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076698 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-lib-modules\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076724 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-sys-fs\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076758 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h85l\" (UniqueName: \"kubernetes.io/projected/285af9dc-62d9-4bd9-858c-9d8ccfcea829-kube-api-access-6h85l\") pod \"node-ca-p8s8r\" (UID: \"285af9dc-62d9-4bd9-858c-9d8ccfcea829\") " pod="openshift-image-registry/node-ca-p8s8r" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076773 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-device-dir\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076786 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-sys\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076884 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-sys\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.076990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076936 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:32.077880 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076502 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-sysctl-d\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.077880 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076990 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-kubernetes\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.077880 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076992 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/285af9dc-62d9-4bd9-858c-9d8ccfcea829-serviceca\") pod \"node-ca-p8s8r\" (UID: \"285af9dc-62d9-4bd9-858c-9d8ccfcea829\") " pod="openshift-image-registry/node-ca-p8s8r" Jul 20 16:09:32.077880 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.076397 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-sysctl-conf\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.077880 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.077022 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-var-lib-kubelet\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.077880 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.077064 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-run\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.077880 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.077105 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-sysconfig\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.077880 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.077278 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-systemd\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.077880 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.077413 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce16b1f2-4958-479c-b384-29b4d141a0ba-lib-modules\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.077880 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.077510 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-sys-fs\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:32.077880 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.077525 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-socket-dir\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:32.077880 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.077578 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-device-dir\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:32.077880 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.077582 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16873ea8-9a09-40e6-b5fd-324b65fe693b-registration-dir\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:32.079441 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.079416 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce16b1f2-4958-479c-b384-29b4d141a0ba-tmp\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.079639 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.079620 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce16b1f2-4958-479c-b384-29b4d141a0ba-etc-tuned\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.086920 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.086861 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h85l\" (UniqueName: \"kubernetes.io/projected/285af9dc-62d9-4bd9-858c-9d8ccfcea829-kube-api-access-6h85l\") pod \"node-ca-p8s8r\" (UID: \"285af9dc-62d9-4bd9-858c-9d8ccfcea829\") " pod="openshift-image-registry/node-ca-p8s8r" Jul 20 16:09:32.087146 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.087129 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q882\" (UniqueName: \"kubernetes.io/projected/16873ea8-9a09-40e6-b5fd-324b65fe693b-kube-api-access-9q882\") pod \"aws-ebs-csi-driver-node-c2qdv\" (UID: \"16873ea8-9a09-40e6-b5fd-324b65fe693b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:32.087214 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.087157 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz8b2\" (UniqueName: \"kubernetes.io/projected/ce16b1f2-4958-479c-b384-29b4d141a0ba-kube-api-access-fz8b2\") pod \"tuned-ppzkq\" (UID: \"ce16b1f2-4958-479c-b384-29b4d141a0ba\") " pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.163095 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.163056 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4t89d" Jul 20 16:09:32.171298 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.171276 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fpvnh" Jul 20 16:09:32.180305 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.180281 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cj8gg" Jul 20 16:09:32.189126 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.189106 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f96wb" Jul 20 16:09:32.197881 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.197861 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:32.208542 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.208520 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6c2ms" Jul 20 16:09:32.225403 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.225365 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" Jul 20 16:09:32.232342 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.232312 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" Jul 20 16:09:32.240109 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.240085 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p8s8r" Jul 20 16:09:32.479696 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.479612 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqrh7\" (UniqueName: \"kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7\") pod \"network-check-target-62crl\" (UID: \"3f2af8e3-e9b2-492d-9b37-351d28c756a6\") " pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:32.479696 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.479663 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs\") pod \"network-metrics-daemon-fzrbx\" (UID: \"586b30af-aafe-48c8-a1c9-cd97c9bcbeb7\") " pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:32.479912 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.479706 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret\") pod \"global-pull-secret-syncer-jn4lt\" (UID: \"8e116ef2-0fca-44f3-84c2-86b3bde42a78\") " pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:32.479912 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:32.479789 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:09:32.479912 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:32.479810 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:09:32.479912 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:32.479824 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:09:32.479912 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:32.479813 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:09:32.479912 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:32.479882 2569 projected.go:196] Error preparing data for projected volume kube-api-access-sqrh7 for pod openshift-network-diagnostics/network-check-target-62crl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:09:32.479912 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:32.479867 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret podName:8e116ef2-0fca-44f3-84c2-86b3bde42a78 nodeName:}" failed. No retries permitted until 2026-07-20 16:09:33.479849122 +0000 UTC m=+4.029148400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret") pod "global-pull-secret-syncer-jn4lt" (UID: "8e116ef2-0fca-44f3-84c2-86b3bde42a78") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:09:32.480204 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:32.479938 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs podName:586b30af-aafe-48c8-a1c9-cd97c9bcbeb7 nodeName:}" failed. No retries permitted until 2026-07-20 16:09:33.479921334 +0000 UTC m=+4.029220612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs") pod "network-metrics-daemon-fzrbx" (UID: "586b30af-aafe-48c8-a1c9-cd97c9bcbeb7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:09:32.480204 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:32.479954 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7 podName:3f2af8e3-e9b2-492d-9b37-351d28c756a6 nodeName:}" failed. No retries permitted until 2026-07-20 16:09:33.479945313 +0000 UTC m=+4.029244593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sqrh7" (UniqueName: "kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7") pod "network-check-target-62crl" (UID: "3f2af8e3-e9b2-492d-9b37-351d28c756a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:09:32.903632 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.903600 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 16:04:31 +0000 UTC" deadline="2028-03-08 06:44:22.651026809 +0000 UTC" Jul 20 16:09:32.903632 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:32.903631 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14318h34m49.747399973s" Jul 20 16:09:32.920856 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:32.920816 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87285192_3790_4b9e_bd2b_dbec974fe2d4.slice/crio-324e9c47c8e62687926e3488e92d1b3846bc690261bd0f33b243308380a8fc5d WatchSource:0}: Error finding container 324e9c47c8e62687926e3488e92d1b3846bc690261bd0f33b243308380a8fc5d: Status 404 returned error can't find the container with id 324e9c47c8e62687926e3488e92d1b3846bc690261bd0f33b243308380a8fc5d Jul 20 16:09:32.925960 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:32.925876 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce16b1f2_4958_479c_b384_29b4d141a0ba.slice/crio-b702508f32a06a49054d520ceb1e5389118590a2e276966b0003a1ef8db16272 WatchSource:0}: Error finding container b702508f32a06a49054d520ceb1e5389118590a2e276966b0003a1ef8db16272: Status 404 returned error can't find the container with id b702508f32a06a49054d520ceb1e5389118590a2e276966b0003a1ef8db16272 Jul 20 16:09:32.927625 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:32.927524 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16873ea8_9a09_40e6_b5fd_324b65fe693b.slice/crio-3515cb7aa56d2b80af7423e1e81fee613d535619107d9a51b74db9cb8294a648 WatchSource:0}: Error finding container 3515cb7aa56d2b80af7423e1e81fee613d535619107d9a51b74db9cb8294a648: Status 404 returned error can't find the container with id 3515cb7aa56d2b80af7423e1e81fee613d535619107d9a51b74db9cb8294a648 Jul 20 16:09:32.929801 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:32.929731 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c29c040_f0ab_430a_9996_4ea896634f6f.slice/crio-3dd1ccd802a4d9c9cbbee6d94b46db7610b933f063dfb3f68f249d6cbe224a4e WatchSource:0}: Error finding container 3dd1ccd802a4d9c9cbbee6d94b46db7610b933f063dfb3f68f249d6cbe224a4e: Status 404 returned error can't find the container with id 3dd1ccd802a4d9c9cbbee6d94b46db7610b933f063dfb3f68f249d6cbe224a4e Jul 20 16:09:32.930811 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:32.930733 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode49166de_d769_4f5b_8829_46cd62bd63dc.slice/crio-7a9e6e8aea0bee585717183d3a643988f3198de5f456c9ba08409cce55055a0d WatchSource:0}: Error finding container 7a9e6e8aea0bee585717183d3a643988f3198de5f456c9ba08409cce55055a0d: Status 404 returned error can't find the container with id 7a9e6e8aea0bee585717183d3a643988f3198de5f456c9ba08409cce55055a0d Jul 20 16:09:32.931737 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:32.931709 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8dc04f1_d7ca_4632_98a7_086b49b0513a.slice/crio-b00ae619ce91d51e661b46a9061b339d2dee1e4297f9673c42a7ddb0c170e7c7 WatchSource:0}: Error finding container b00ae619ce91d51e661b46a9061b339d2dee1e4297f9673c42a7ddb0c170e7c7: Status 404 returned error can't find the container with id b00ae619ce91d51e661b46a9061b339d2dee1e4297f9673c42a7ddb0c170e7c7 Jul 20 16:09:32.940057 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:32.940035 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285af9dc_62d9_4bd9_858c_9d8ccfcea829.slice/crio-89ef5d6a487c71d15a9bda3d382dd790199eb4d7b009373791149eba75924b7d WatchSource:0}: Error finding container 89ef5d6a487c71d15a9bda3d382dd790199eb4d7b009373791149eba75924b7d: Status 404 returned error can't find the container with id 89ef5d6a487c71d15a9bda3d382dd790199eb4d7b009373791149eba75924b7d Jul 20 16:09:32.941471 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:32.941424 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8eb516_d99a_4adf_afdd_10ea8779634a.slice/crio-9417fe07e90aa72a191e16a38fbdd8a2789c3a47b2c3d28536419f725adae827 WatchSource:0}: Error finding container 9417fe07e90aa72a191e16a38fbdd8a2789c3a47b2c3d28536419f725adae827: Status 404 returned error can't find the container with id 9417fe07e90aa72a191e16a38fbdd8a2789c3a47b2c3d28536419f725adae827 Jul 20 16:09:32.943171 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:09:32.943104 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8cd0d1d_b1b3_4420_9430_667b02723ae5.slice/crio-f66ccd1e1cc362edbba04b0f8ef48d4510258ed66f6ad56954b0f0ff92ed45ca WatchSource:0}: Error finding container f66ccd1e1cc362edbba04b0f8ef48d4510258ed66f6ad56954b0f0ff92ed45ca: Status 404 returned error can't find the container with id f66ccd1e1cc362edbba04b0f8ef48d4510258ed66f6ad56954b0f0ff92ed45ca Jul 20 16:09:33.039355 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.039327 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:33.039490 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:33.039441 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:09:33.046614 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.046573 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-156.ec2.internal" event={"ID":"b679fc128ec345ad8c5a7680ba39ba5b","Type":"ContainerStarted","Data":"c92ec844c406200c5e0ed22163e6a5867d317e314fb204b04d12aaad803eaf52"} Jul 20 16:09:33.047758 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.047726 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6c2ms" event={"ID":"e8cd0d1d-b1b3-4420-9430-667b02723ae5","Type":"ContainerStarted","Data":"f66ccd1e1cc362edbba04b0f8ef48d4510258ed66f6ad56954b0f0ff92ed45ca"} Jul 20 16:09:33.048918 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.048894 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f96wb" event={"ID":"7f8eb516-d99a-4adf-afdd-10ea8779634a","Type":"ContainerStarted","Data":"9417fe07e90aa72a191e16a38fbdd8a2789c3a47b2c3d28536419f725adae827"} Jul 20 16:09:33.050149 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.050094 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p8s8r" event={"ID":"285af9dc-62d9-4bd9-858c-9d8ccfcea829","Type":"ContainerStarted","Data":"89ef5d6a487c71d15a9bda3d382dd790199eb4d7b009373791149eba75924b7d"} Jul 20 16:09:33.051277 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.051256 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" event={"ID":"e49166de-d769-4f5b-8829-46cd62bd63dc","Type":"ContainerStarted","Data":"7a9e6e8aea0bee585717183d3a643988f3198de5f456c9ba08409cce55055a0d"} Jul 20 16:09:33.052334 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.052309 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpvnh" event={"ID":"e8dc04f1-d7ca-4632-98a7-086b49b0513a","Type":"ContainerStarted","Data":"b00ae619ce91d51e661b46a9061b339d2dee1e4297f9673c42a7ddb0c170e7c7"} Jul 20 16:09:33.053402 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.053376 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cj8gg" event={"ID":"4c29c040-f0ab-430a-9996-4ea896634f6f","Type":"ContainerStarted","Data":"3dd1ccd802a4d9c9cbbee6d94b46db7610b933f063dfb3f68f249d6cbe224a4e"} Jul 20 16:09:33.054553 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.054532 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" event={"ID":"16873ea8-9a09-40e6-b5fd-324b65fe693b","Type":"ContainerStarted","Data":"3515cb7aa56d2b80af7423e1e81fee613d535619107d9a51b74db9cb8294a648"} Jul 20 16:09:33.055627 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.055607 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" event={"ID":"ce16b1f2-4958-479c-b384-29b4d141a0ba","Type":"ContainerStarted","Data":"b702508f32a06a49054d520ceb1e5389118590a2e276966b0003a1ef8db16272"} Jul 20 16:09:33.056629 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.056606 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4t89d" event={"ID":"87285192-3790-4b9e-bd2b-dbec974fe2d4","Type":"ContainerStarted","Data":"324e9c47c8e62687926e3488e92d1b3846bc690261bd0f33b243308380a8fc5d"} Jul 20 16:09:33.061329 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.061284 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-156.ec2.internal" podStartSLOduration=3.061269993 podStartE2EDuration="3.061269993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:09:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:09:33.061086278 +0000 UTC m=+3.610385576" watchObservedRunningTime="2026-07-20 16:09:33.061269993 +0000 UTC m=+3.610569292" Jul 20 16:09:33.485677 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.485378 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret\") pod \"global-pull-secret-syncer-jn4lt\" (UID: \"8e116ef2-0fca-44f3-84c2-86b3bde42a78\") " pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:33.485677 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:33.485655 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:09:33.485901 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.485687 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqrh7\" (UniqueName: \"kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7\") pod \"network-check-target-62crl\" (UID: \"3f2af8e3-e9b2-492d-9b37-351d28c756a6\") " pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:33.485901 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:33.485716 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret podName:8e116ef2-0fca-44f3-84c2-86b3bde42a78 nodeName:}" failed. No retries permitted until 2026-07-20 16:09:35.485699334 +0000 UTC m=+6.034998629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret") pod "global-pull-secret-syncer-jn4lt" (UID: "8e116ef2-0fca-44f3-84c2-86b3bde42a78") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:09:33.485901 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.485758 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs\") pod \"network-metrics-daemon-fzrbx\" (UID: \"586b30af-aafe-48c8-a1c9-cd97c9bcbeb7\") " pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:33.485901 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:33.485777 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:09:33.485901 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:33.485791 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:09:33.485901 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:33.485803 2569 projected.go:196] Error preparing data for projected volume kube-api-access-sqrh7 for pod openshift-network-diagnostics/network-check-target-62crl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:09:33.485901 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:33.485840 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7 podName:3f2af8e3-e9b2-492d-9b37-351d28c756a6 nodeName:}" failed. No retries permitted until 2026-07-20 16:09:35.485827912 +0000 UTC m=+6.035127196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sqrh7" (UniqueName: "kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7") pod "network-check-target-62crl" (UID: "3f2af8e3-e9b2-492d-9b37-351d28c756a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:09:33.485901 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:33.485845 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:09:33.485901 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:33.485876 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs podName:586b30af-aafe-48c8-a1c9-cd97c9bcbeb7 nodeName:}" failed. No retries permitted until 2026-07-20 16:09:35.485867773 +0000 UTC m=+6.035167055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs") pod "network-metrics-daemon-fzrbx" (UID: "586b30af-aafe-48c8-a1c9-cd97c9bcbeb7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:09:33.684267 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.684216 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 16:09:33.904656 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.904541 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 16:04:31 +0000 UTC" deadline="2028-05-07 08:39:59.472377324 +0000 UTC" Jul 20 16:09:33.904656 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:33.904604 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15760h30m25.567777647s" Jul 20 16:09:34.039879 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:34.039367 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:34.039879 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:34.039503 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:09:34.040665 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:34.040380 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:34.040665 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:34.040484 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:09:34.080199 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:34.079874 2569 generic.go:356] "Generic (PLEG): container finished" podID="1bd63e6417e0a2d05f51de44ace816aa" containerID="2ae38c0cec38375c959d56b8d26b8509b0059b35ac6a7673f60e7fde590cf4af" exitCode=0 Jul 20 16:09:34.080199 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:34.079977 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal" event={"ID":"1bd63e6417e0a2d05f51de44ace816aa","Type":"ContainerDied","Data":"2ae38c0cec38375c959d56b8d26b8509b0059b35ac6a7673f60e7fde590cf4af"} Jul 20 16:09:35.039377 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:35.038863 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:35.039377 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:35.038998 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:09:35.092064 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:35.092027 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal" event={"ID":"1bd63e6417e0a2d05f51de44ace816aa","Type":"ContainerStarted","Data":"cea32c6332bf66be6aa770ea1e7860808f53113bf6bdbb3514d5e036135b6eec"} Jul 20 16:09:35.502804 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:35.501833 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs\") pod \"network-metrics-daemon-fzrbx\" (UID: \"586b30af-aafe-48c8-a1c9-cd97c9bcbeb7\") " pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:35.502804 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:35.501892 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret\") pod \"global-pull-secret-syncer-jn4lt\" (UID: \"8e116ef2-0fca-44f3-84c2-86b3bde42a78\") " pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:35.502804 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:35.501938 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqrh7\" (UniqueName: \"kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7\") pod \"network-check-target-62crl\" (UID: \"3f2af8e3-e9b2-492d-9b37-351d28c756a6\") " pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:35.502804 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:35.502071 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:09:35.502804 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:35.502090 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:09:35.502804 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:35.502102 2569 projected.go:196] Error preparing data for projected volume kube-api-access-sqrh7 for pod openshift-network-diagnostics/network-check-target-62crl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:09:35.502804 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:35.502157 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7 podName:3f2af8e3-e9b2-492d-9b37-351d28c756a6 nodeName:}" failed. No retries permitted until 2026-07-20 16:09:39.502138329 +0000 UTC m=+10.051437614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sqrh7" (UniqueName: "kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7") pod "network-check-target-62crl" (UID: "3f2af8e3-e9b2-492d-9b37-351d28c756a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:09:35.502804 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:35.502541 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:09:35.502804 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:35.502588 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs podName:586b30af-aafe-48c8-a1c9-cd97c9bcbeb7 nodeName:}" failed. No retries permitted until 2026-07-20 16:09:39.502571993 +0000 UTC m=+10.051871277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs") pod "network-metrics-daemon-fzrbx" (UID: "586b30af-aafe-48c8-a1c9-cd97c9bcbeb7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:09:35.502804 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:35.502645 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:09:35.502804 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:35.502677 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret podName:8e116ef2-0fca-44f3-84c2-86b3bde42a78 nodeName:}" failed. No retries permitted until 2026-07-20 16:09:39.502665948 +0000 UTC m=+10.051965229 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret") pod "global-pull-secret-syncer-jn4lt" (UID: "8e116ef2-0fca-44f3-84c2-86b3bde42a78") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:09:36.041177 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:36.041142 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:36.041671 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:36.041308 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:09:36.041734 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:36.041679 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:36.041791 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:36.041765 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:09:37.039422 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:37.039389 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:37.039624 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:37.039525 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:09:38.038876 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:38.038788 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:38.039329 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:38.038916 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:09:38.039329 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:38.039257 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:38.039444 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:38.039379 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:09:39.038698 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:39.038487 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:39.038698 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:39.038612 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:09:39.537456 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:39.537337 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs\") pod \"network-metrics-daemon-fzrbx\" (UID: \"586b30af-aafe-48c8-a1c9-cd97c9bcbeb7\") " pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:39.537456 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:39.537406 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret\") pod \"global-pull-secret-syncer-jn4lt\" (UID: \"8e116ef2-0fca-44f3-84c2-86b3bde42a78\") " pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:39.537673 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:39.537462 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqrh7\" (UniqueName: \"kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7\") pod \"network-check-target-62crl\" (UID: \"3f2af8e3-e9b2-492d-9b37-351d28c756a6\") " pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:39.537673 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:39.537602 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:09:39.537673 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:39.537623 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:09:39.537673 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:39.537637 2569 projected.go:196] Error preparing data for projected volume kube-api-access-sqrh7 for pod openshift-network-diagnostics/network-check-target-62crl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:09:39.537851 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:39.537696 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7 podName:3f2af8e3-e9b2-492d-9b37-351d28c756a6 nodeName:}" failed. No retries permitted until 2026-07-20 16:09:47.537677461 +0000 UTC m=+18.086976758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sqrh7" (UniqueName: "kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7") pod "network-check-target-62crl" (UID: "3f2af8e3-e9b2-492d-9b37-351d28c756a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:09:39.538119 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:39.538022 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:09:39.538119 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:39.538039 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:09:39.538119 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:39.538083 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret podName:8e116ef2-0fca-44f3-84c2-86b3bde42a78 nodeName:}" failed. No retries permitted until 2026-07-20 16:09:47.538066064 +0000 UTC m=+18.087365354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret") pod "global-pull-secret-syncer-jn4lt" (UID: "8e116ef2-0fca-44f3-84c2-86b3bde42a78") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:09:39.538119 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:39.538102 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs podName:586b30af-aafe-48c8-a1c9-cd97c9bcbeb7 nodeName:}" failed. No retries permitted until 2026-07-20 16:09:47.538092582 +0000 UTC m=+18.087391873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs") pod "network-metrics-daemon-fzrbx" (UID: "586b30af-aafe-48c8-a1c9-cd97c9bcbeb7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:09:40.040049 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:40.040010 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:40.040526 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:40.040129 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:09:40.040526 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:40.040206 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:40.040526 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:40.040322 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:09:41.039243 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:41.039147 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:41.039405 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:41.039305 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:09:42.038903 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:42.038871 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:42.039339 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:42.038872 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:42.039339 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:42.038986 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:09:42.039339 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:42.039084 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:09:43.039332 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:43.039304 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:43.039725 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:43.039401 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:09:44.038723 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:44.038685 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:44.038914 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:44.038729 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:44.038914 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:44.038849 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:09:44.039028 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:44.038978 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:09:45.038770 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:45.038732 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:45.039226 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:45.038857 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:09:46.039531 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:46.039494 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:46.040015 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:46.039494 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:46.040015 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:46.039678 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:09:46.040015 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:46.039805 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:09:47.039159 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:47.039119 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:47.039361 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:47.039224 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:09:47.597527 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:47.597491 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret\") pod \"global-pull-secret-syncer-jn4lt\" (UID: \"8e116ef2-0fca-44f3-84c2-86b3bde42a78\") " pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:47.597968 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:47.597552 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqrh7\" (UniqueName: \"kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7\") pod \"network-check-target-62crl\" (UID: \"3f2af8e3-e9b2-492d-9b37-351d28c756a6\") " pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:47.597968 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:47.597593 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs\") pod \"network-metrics-daemon-fzrbx\" (UID: \"586b30af-aafe-48c8-a1c9-cd97c9bcbeb7\") " pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:47.597968 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:47.597671 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:09:47.597968 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:47.597686 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:09:47.597968 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:47.597717 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:09:47.597968 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:47.597736 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:09:47.597968 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:47.597749 2569 projected.go:196] Error preparing data for projected volume kube-api-access-sqrh7 for pod openshift-network-diagnostics/network-check-target-62crl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:09:47.597968 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:47.597751 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret podName:8e116ef2-0fca-44f3-84c2-86b3bde42a78 nodeName:}" failed. No retries permitted until 2026-07-20 16:10:03.59772808 +0000 UTC m=+34.147027373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret") pod "global-pull-secret-syncer-jn4lt" (UID: "8e116ef2-0fca-44f3-84c2-86b3bde42a78") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:09:47.597968 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:47.597793 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs podName:586b30af-aafe-48c8-a1c9-cd97c9bcbeb7 nodeName:}" failed. No retries permitted until 2026-07-20 16:10:03.597784487 +0000 UTC m=+34.147083767 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs") pod "network-metrics-daemon-fzrbx" (UID: "586b30af-aafe-48c8-a1c9-cd97c9bcbeb7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:09:47.597968 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:47.597803 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7 podName:3f2af8e3-e9b2-492d-9b37-351d28c756a6 nodeName:}" failed. No retries permitted until 2026-07-20 16:10:03.597797533 +0000 UTC m=+34.147096809 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sqrh7" (UniqueName: "kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7") pod "network-check-target-62crl" (UID: "3f2af8e3-e9b2-492d-9b37-351d28c756a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:09:48.039296 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:48.039198 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:48.039450 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:48.039207 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:48.039450 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:48.039350 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:09:48.039450 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:48.039435 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:09:49.039349 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:49.039310 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:49.039812 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:49.039441 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:09:50.040249 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:50.040199 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:50.040710 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:50.040338 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:09:50.040710 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:50.040404 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:50.040710 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:50.040622 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:09:51.039282 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:51.039249 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:51.039470 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:51.039361 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:09:52.038885 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.038474 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:52.039504 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.038505 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:52.039504 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:52.038971 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:09:52.039504 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:52.039065 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:09:52.129919 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.129882 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6c2ms" event={"ID":"e8cd0d1d-b1b3-4420-9430-667b02723ae5","Type":"ContainerStarted","Data":"926cf4e214f72a6f8ea23b7cb4670ff5a9f7ce92a8324d256e24b749b2adc93e"} Jul 20 16:09:52.131342 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.131316 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p8s8r" event={"ID":"285af9dc-62d9-4bd9-858c-9d8ccfcea829","Type":"ContainerStarted","Data":"7329f39513cacdb972be0f07fb4c10b77afb2ec694fb6d248ee9a4c4900f91df"} Jul 20 16:09:52.133599 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.133580 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" event={"ID":"e49166de-d769-4f5b-8829-46cd62bd63dc","Type":"ContainerStarted","Data":"f46e099cedf716f2c94e503db3f049429bc2efda913be6fc1a569a4143229d5d"} Jul 20 16:09:52.133714 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.133639 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" event={"ID":"e49166de-d769-4f5b-8829-46cd62bd63dc","Type":"ContainerStarted","Data":"78ca069991bf11926fb9007f4fd0b61ea9772cddb60c21eb017fac9fb6bdbf1f"} Jul 20 16:09:52.133714 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.133669 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" event={"ID":"e49166de-d769-4f5b-8829-46cd62bd63dc","Type":"ContainerStarted","Data":"f3cc0c5cdae511a8838f9e2512539c98ecc50af21dbe62443a6663d3c2ca8d9f"} Jul 20 16:09:52.133714 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.133700 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" event={"ID":"e49166de-d769-4f5b-8829-46cd62bd63dc","Type":"ContainerStarted","Data":"42d333c339bf819f640666f376e9c1b6e9c6fb873f2c927cd73039bd0d7a8aa3"} Jul 20 16:09:52.133932 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.133735 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" event={"ID":"e49166de-d769-4f5b-8829-46cd62bd63dc","Type":"ContainerStarted","Data":"fc2217d19786fd833126452672e6ec9a91b75046be8849bc7e9047d8a408a0c0"} Jul 20 16:09:52.134942 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.134919 2569 generic.go:356] "Generic (PLEG): container finished" podID="e8dc04f1-d7ca-4632-98a7-086b49b0513a" containerID="c6c8638c85f65bebc5209b1ea2175b721d7fc9f36e2787965573e0da1c71742e" exitCode=0 Jul 20 16:09:52.135023 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.134980 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpvnh" event={"ID":"e8dc04f1-d7ca-4632-98a7-086b49b0513a","Type":"ContainerDied","Data":"c6c8638c85f65bebc5209b1ea2175b721d7fc9f36e2787965573e0da1c71742e"} Jul 20 16:09:52.136430 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.136399 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cj8gg" event={"ID":"4c29c040-f0ab-430a-9996-4ea896634f6f","Type":"ContainerStarted","Data":"6768f73337db5e4f9690c5243929a57da9bd89fc63c0a2be2e8cd9d06605706e"} Jul 20 16:09:52.137743 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.137720 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" event={"ID":"16873ea8-9a09-40e6-b5fd-324b65fe693b","Type":"ContainerStarted","Data":"04ea6f8b64a191b906864acf64eb75d02eec33df1a81384779aaf93b67b69280"} Jul 20 16:09:52.139007 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.138990 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" event={"ID":"ce16b1f2-4958-479c-b384-29b4d141a0ba","Type":"ContainerStarted","Data":"ceca8c3bcfb7fa53de4b32efdc9d2437b57b960d5e400bca6648f9130e4ba8a4"} Jul 20 16:09:52.140324 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.140294 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4t89d" event={"ID":"87285192-3790-4b9e-bd2b-dbec974fe2d4","Type":"ContainerStarted","Data":"23bddf9816a0d148f7e0bdd78a09a9cb7b50ee15010837ce5461d6c6f0790510"} Jul 20 16:09:52.146873 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.146830 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-156.ec2.internal" podStartSLOduration=22.146818728 podStartE2EDuration="22.146818728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:09:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:09:35.10894707 +0000 UTC m=+5.658246370" watchObservedRunningTime="2026-07-20 16:09:52.146818728 +0000 UTC m=+22.696118027" Jul 20 16:09:52.147306 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.147277 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6c2ms" podStartSLOduration=8.031682455 podStartE2EDuration="22.147267413s" totalImagesPullingTime="14.115584958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:09:52.146592619 +0000 UTC m=+22.695891912" watchObservedRunningTime="2026-07-20 16:09:52.147267413 +0000 UTC m=+22.696566712" Jul 20 16:09:52.163509 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.163455 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cj8gg" podStartSLOduration=3.617508052 podStartE2EDuration="22.163435579s" totalImagesPullingTime="18.545927527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:09:52.163143639 +0000 UTC m=+22.712442940" watchObservedRunningTime="2026-07-20 16:09:52.163435579 +0000 UTC m=+22.712734880" Jul 20 16:09:52.177842 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.177788 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4t89d" podStartSLOduration=3.680590503 podStartE2EDuration="22.177767835s" totalImagesPullingTime="18.497177332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:09:52.177439414 +0000 UTC m=+22.726738714" watchObservedRunningTime="2026-07-20 16:09:52.177767835 +0000 UTC m=+22.727067136" Jul 20 16:09:52.221499 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.221449 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ppzkq" podStartSLOduration=3.7248217649999997 podStartE2EDuration="22.221433773s" totalImagesPullingTime="18.496612008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:09:52.221082343 +0000 UTC m=+22.770381642" watchObservedRunningTime="2026-07-20 16:09:52.221433773 +0000 UTC m=+22.770733072" Jul 20 16:09:52.241075 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.241017 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p8s8r" podStartSLOduration=3.759576395 podStartE2EDuration="22.240996491s" totalImagesPullingTime="18.481420096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:09:52.240049173 +0000 UTC m=+22.789348476" watchObservedRunningTime="2026-07-20 16:09:52.240996491 +0000 UTC m=+22.790295791" Jul 20 16:09:52.279630 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.279582 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:52.353531 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:52.353455 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:53.039240 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:53.039172 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:53.039651 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:53.039294 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:09:53.111243 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:53.111197 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 16:09:53.145076 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:53.145041 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" event={"ID":"16873ea8-9a09-40e6-b5fd-324b65fe693b","Type":"ContainerStarted","Data":"13ff6171998e38eee7041b9cc75f41ecb258e18bde6f9405c01fe25b39ce7528"} Jul 20 16:09:53.146760 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:53.146733 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f96wb" event={"ID":"7f8eb516-d99a-4adf-afdd-10ea8779634a","Type":"ContainerStarted","Data":"1ecc6cdb135a1908550334771fd56efb61305a3be9e67a5b1d7013556aff0f85"} Jul 20 16:09:53.150177 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:53.150130 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" event={"ID":"e49166de-d769-4f5b-8829-46cd62bd63dc","Type":"ContainerStarted","Data":"93019f04ebb0b83d176eb4687a6041a8412a782d95a1556f4985c91e8b178b5d"} Jul 20 16:09:53.162134 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:53.162091 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f96wb" podStartSLOduration=4.682365274 podStartE2EDuration="23.162076103s" totalImagesPullingTime="18.479710829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:09:53.161654926 +0000 UTC m=+23.710954229" watchObservedRunningTime="2026-07-20 16:09:53.162076103 +0000 UTC m=+23.711375402" Jul 20 16:09:53.281149 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:53.281091 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:53.336121 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:53.336044 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:53.539248 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:53.539199 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6c2ms" Jul 20 16:09:53.539922 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:53.539902 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6c2ms" Jul 20 16:09:53.926574 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:53.926451 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T16:09:53.111221436Z","UUID":"1b6f8a54-dd6b-45b0-ba62-91f66000d6ed","Handler":null,"Name":"","Endpoint":""} Jul 20 16:09:53.928843 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:53.928681 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 16:09:53.928843 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:53.928727 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 16:09:54.039506 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:54.039469 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:54.040029 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:54.039607 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:09:54.040029 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:54.039669 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:54.040029 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:54.039777 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:09:54.152679 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:54.152448 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6c2ms" Jul 20 16:09:54.152859 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:54.152838 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6c2ms" Jul 20 16:09:54.264035 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:54.263961 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:54.366181 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:54.366152 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:54.465698 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:54.465628 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:55.038839 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:55.038815 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:55.039004 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:55.038909 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:09:55.158157 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:55.158121 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" event={"ID":"e49166de-d769-4f5b-8829-46cd62bd63dc","Type":"ContainerStarted","Data":"80827c45f474c2fd64fcb8a86bc72ca815937bd8ed717f8375abb39128c23aaf"} Jul 20 16:09:55.160623 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:55.160582 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" event={"ID":"16873ea8-9a09-40e6-b5fd-324b65fe693b","Type":"ContainerStarted","Data":"5294ab8159100272659ce4ed740d7c866ec3171818877c12b0c052c0e0b68792"} Jul 20 16:09:55.179574 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:55.179525 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c2qdv" podStartSLOduration=4.32097008 podStartE2EDuration="25.179505796s" totalImagesPullingTime="20.858535716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:09:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:09:55.178073232 +0000 UTC m=+25.727372533" watchObservedRunningTime="2026-07-20 16:09:55.179505796 +0000 UTC m=+25.728805094" Jul 20 16:09:56.038852 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:56.038817 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:56.039048 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:56.038817 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:56.039048 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:56.038934 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:09:56.039048 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:56.039035 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:09:56.891695 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:56.891517 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:56.991550 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:56.991458 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:57.038525 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:57.038499 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:57.038630 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:57.038601 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:09:57.155193 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:57.155158 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:57.167654 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:57.167624 2569 generic.go:356] "Generic (PLEG): container finished" podID="e8dc04f1-d7ca-4632-98a7-086b49b0513a" containerID="04bb8d2e2a03d45e964a29bb39cc60bec4f76931a775b3be77ca28c5c6ab84bb" exitCode=0 Jul 20 16:09:57.167842 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:57.167678 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpvnh" event={"ID":"e8dc04f1-d7ca-4632-98a7-086b49b0513a","Type":"ContainerDied","Data":"04bb8d2e2a03d45e964a29bb39cc60bec4f76931a775b3be77ca28c5c6ab84bb"} Jul 20 16:09:57.172259 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:57.172169 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" event={"ID":"e49166de-d769-4f5b-8829-46cd62bd63dc","Type":"ContainerStarted","Data":"1669843e85257e224c35af461903af05d4d8179911acc4d516edb4c85a5dbc71"} Jul 20 16:09:57.172659 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:57.172524 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:57.172659 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:57.172595 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:57.188912 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:57.188891 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:57.214664 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:57.214622 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" podStartSLOduration=8.652716447 podStartE2EDuration="27.214610371s" totalImagesPullingTime="18.561893924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:09:57.213847176 +0000 UTC m=+27.763146474" watchObservedRunningTime="2026-07-20 16:09:57.214610371 +0000 UTC m=+27.763909670" Jul 20 16:09:57.215422 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:57.215398 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:57.477761 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:57.477709 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:57.537418 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:57.537383 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:57.866863 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:57.866639 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:57.968046 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:57.967991 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:58.039270 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:58.039213 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:58.039428 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:58.039391 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:09:58.039477 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:58.039426 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:58.039545 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:58.039528 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:09:58.175219 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:58.175131 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:58.189939 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:58.189913 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:09:58.841180 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:58.841107 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jn4lt"] Jul 20 16:09:58.841417 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:58.841259 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:09:58.841417 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:58.841339 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:09:58.845267 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:58.845220 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-62crl"] Jul 20 16:09:58.845403 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:58.845353 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:09:58.845502 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:58.845470 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:09:58.845854 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:58.845834 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fzrbx"] Jul 20 16:09:58.845952 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:58.845940 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:09:58.846062 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:09:58.846030 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:09:59.178543 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:59.178507 2569 generic.go:356] "Generic (PLEG): container finished" podID="e8dc04f1-d7ca-4632-98a7-086b49b0513a" containerID="689d6d0ced43215c63f92b5ae98288b26f75793139805d9760d6fd5ef211a9ea" exitCode=0 Jul 20 16:09:59.179059 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:59.178597 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpvnh" event={"ID":"e8dc04f1-d7ca-4632-98a7-086b49b0513a","Type":"ContainerDied","Data":"689d6d0ced43215c63f92b5ae98288b26f75793139805d9760d6fd5ef211a9ea"} Jul 20 16:09:59.497737 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:59.497642 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:59.549167 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:59.549120 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:09:59.632151 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:09:59.632127 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4t89d_87285192-3790-4b9e-bd2b-dbec974fe2d4/dns-node-resolver/0.log" Jul 20 16:10:00.504216 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:00.501987 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:00.632628 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:00.632461 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p8s8r_285af9dc-62d9-4bd9-858c-9d8ccfcea829/node-ca/0.log" Jul 20 16:10:01.039390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:01.039362 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:10:01.039543 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:01.039402 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:10:01.039543 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:01.039490 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:10:01.039543 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:01.039520 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:10:01.039661 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:01.039574 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:10:01.039700 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:01.039662 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:10:01.185674 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:01.185594 2569 generic.go:356] "Generic (PLEG): container finished" podID="e8dc04f1-d7ca-4632-98a7-086b49b0513a" containerID="b52ee8039b34b0c1796267bf518ab0cd148b01f363980d0a4a43753c07993ecb" exitCode=0 Jul 20 16:10:01.185674 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:01.185642 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpvnh" event={"ID":"e8dc04f1-d7ca-4632-98a7-086b49b0513a","Type":"ContainerDied","Data":"b52ee8039b34b0c1796267bf518ab0cd148b01f363980d0a4a43753c07993ecb"} Jul 20 16:10:02.680294 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:02.680266 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:03.038729 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:03.038634 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:10:03.038945 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:03.038783 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:10:03.038945 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:03.038854 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:10:03.038945 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:03.038876 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:10:03.039119 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:03.038976 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:10:03.039119 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:03.039045 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:10:03.336291 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:03.336194 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:03.445935 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:03.445892 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:03.546449 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:03.546397 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:03.617086 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:03.617055 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqrh7\" (UniqueName: \"kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7\") pod \"network-check-target-62crl\" (UID: \"3f2af8e3-e9b2-492d-9b37-351d28c756a6\") " pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:10:03.617299 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:03.617099 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs\") pod \"network-metrics-daemon-fzrbx\" (UID: \"586b30af-aafe-48c8-a1c9-cd97c9bcbeb7\") " pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:10:03.617299 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:03.617125 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret\") pod \"global-pull-secret-syncer-jn4lt\" (UID: \"8e116ef2-0fca-44f3-84c2-86b3bde42a78\") " pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:10:03.617299 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:03.617219 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:10:03.617299 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:03.617253 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 16:10:03.617299 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:03.617286 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 16:10:03.617299 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:03.617296 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs podName:586b30af-aafe-48c8-a1c9-cd97c9bcbeb7 nodeName:}" failed. No retries permitted until 2026-07-20 16:10:35.617281288 +0000 UTC m=+66.166580568 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs") pod "network-metrics-daemon-fzrbx" (UID: "586b30af-aafe-48c8-a1c9-cd97c9bcbeb7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 16:10:03.617299 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:03.617299 2569 projected.go:196] Error preparing data for projected volume kube-api-access-sqrh7 for pod openshift-network-diagnostics/network-check-target-62crl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:10:03.617673 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:03.617219 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 16:10:03.617673 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:03.617355 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7 podName:3f2af8e3-e9b2-492d-9b37-351d28c756a6 nodeName:}" failed. No retries permitted until 2026-07-20 16:10:35.617336724 +0000 UTC m=+66.166636002 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sqrh7" (UniqueName: "kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7") pod "network-check-target-62crl" (UID: "3f2af8e3-e9b2-492d-9b37-351d28c756a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 16:10:03.617673 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:03.617387 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret podName:8e116ef2-0fca-44f3-84c2-86b3bde42a78 nodeName:}" failed. No retries permitted until 2026-07-20 16:10:35.617369362 +0000 UTC m=+66.166668657 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret") pod "global-pull-secret-syncer-jn4lt" (UID: "8e116ef2-0fca-44f3-84c2-86b3bde42a78") : object "kube-system"/"original-pull-secret" not registered Jul 20 16:10:03.668104 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:03.668065 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:03.755082 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:03.755040 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:04.236482 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:04.236448 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:04.840763 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:04.840729 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:05.039172 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:05.039131 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:10:05.039172 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:05.039171 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:10:05.039426 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:05.039131 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:10:05.039426 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:05.039290 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:10:05.039534 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:05.039420 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:10:05.039534 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:05.039508 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:10:05.437765 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:05.437725 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:05.634351 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:05.634317 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:06.032468 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:06.032430 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:06.133978 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:06.133942 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:06.199249 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:06.199204 2569 generic.go:356] "Generic (PLEG): container finished" podID="e8dc04f1-d7ca-4632-98a7-086b49b0513a" containerID="a4507c6672ab58730f47bbcb943471296d0a837a14042b60a5c2dd7cd08c580c" exitCode=0 Jul 20 16:10:06.199385 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:06.199265 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpvnh" event={"ID":"e8dc04f1-d7ca-4632-98a7-086b49b0513a","Type":"ContainerDied","Data":"a4507c6672ab58730f47bbcb943471296d0a837a14042b60a5c2dd7cd08c580c"} Jul 20 16:10:06.237457 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:06.237357 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:06.636972 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:06.636936 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:07.031262 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:07.031168 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:07.038840 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:07.038815 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:10:07.038840 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:07.038840 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:10:07.039330 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:07.038842 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:10:07.039330 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:07.038944 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:10:07.039330 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:07.038978 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:10:07.039330 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:07.039071 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:10:07.131633 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:07.131595 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:07.204220 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:07.204186 2569 generic.go:356] "Generic (PLEG): container finished" podID="e8dc04f1-d7ca-4632-98a7-086b49b0513a" containerID="59b3ec72c64a6aba141c0555b1899ce2cfb38b763972b951b8292457863f0900" exitCode=0 Jul 20 16:10:07.204220 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:07.204224 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpvnh" event={"ID":"e8dc04f1-d7ca-4632-98a7-086b49b0513a","Type":"ContainerDied","Data":"59b3ec72c64a6aba141c0555b1899ce2cfb38b763972b951b8292457863f0900"} Jul 20 16:10:07.231293 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:07.231252 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:07.563462 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:07.563344 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:07.662618 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:07.662584 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:07.837580 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:07.837500 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:07.938618 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:07.938589 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:08.210077 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:08.210041 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fpvnh" event={"ID":"e8dc04f1-d7ca-4632-98a7-086b49b0513a","Type":"ContainerStarted","Data":"edbbae359f50f0198c864e11130ffacd07d9e24499a84ff4780a6d484b8bbdb2"} Jul 20 16:10:08.232722 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:08.232668 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fpvnh" podStartSLOduration=8.356886564 podStartE2EDuration="38.23265226s" totalImagesPullingTime="29.875765696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:09:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:08.232575015 +0000 UTC m=+38.781874317" watchObservedRunningTime="2026-07-20 16:10:08.23265226 +0000 UTC m=+38.781951559" Jul 20 16:10:08.233890 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:08.233845 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:08.288162 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:08.288123 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:08.389097 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:08.389062 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:08.492637 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:08.492557 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:08.837140 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:08.837045 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:09.039415 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:09.039363 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:10:09.039609 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:09.039479 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:10:09.039609 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:09.039363 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:10:09.039609 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:09.039363 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:10:09.039609 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:09.039574 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:10:09.039786 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:09.039710 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:10:09.463963 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:09.463928 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:09.636837 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:09.636806 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:09.736887 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:09.736807 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:09.833933 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:09.833899 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:10.232363 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:10.232306 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:10.436248 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:10.436201 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:11.039117 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:11.039080 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:10:11.039534 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:11.039080 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:10:11.039534 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:11.039190 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:10:11.039534 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:11.039080 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:10:11.039534 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:11.039286 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:10:11.039534 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:11.039333 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:10:11.807118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:11.807082 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:11.978430 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:11.978396 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:12.080169 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:12.080084 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:12.218014 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:12.217954 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:12.273205 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:12.273173 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:12.431185 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:12.431152 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:13.038949 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:13.038911 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:10:13.038949 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:13.038945 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:10:13.039173 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:13.038952 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:10:13.039173 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:13.039020 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:10:13.039173 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:13.039097 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:10:13.039173 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:13.039158 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:10:13.433780 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:13.433745 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:13.638105 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:13.638073 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:13.837996 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:13.837907 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:14.031158 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:14.031109 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:15.038527 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:15.038497 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:10:15.038527 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:15.038533 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:10:15.039011 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:15.038602 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:10:15.039011 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:15.038618 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:10:15.039011 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:15.038672 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:10:15.039011 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:15.038724 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:10:15.602777 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:15.602731 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:15.704617 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:15.704577 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:15.885931 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:15.885898 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:16.057038 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:16.056990 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:16.111221 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:16.111188 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:16.701910 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:16.701873 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:16.757201 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:16.757162 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:16.892144 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:16.892107 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:17.039171 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:17.039095 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:10:17.039171 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:17.039119 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:10:17.039171 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:17.039119 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:10:17.039400 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:17.039258 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:10:17.039400 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:17.039305 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:10:17.039400 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:17.039363 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:10:17.108140 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:17.108101 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:17.162106 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:17.162074 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:17.462344 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:17.462305 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:17.794025 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:17.793939 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:17.894947 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:17.894912 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:18.345779 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:18.345740 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:18.447184 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:18.447151 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:18.550000 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:18.549968 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:18.651465 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:18.651435 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:18.738493 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:18.738445 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:19.038877 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.038843 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:10:19.038877 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.038881 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:10:19.039083 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:19.038947 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62crl" podUID="3f2af8e3-e9b2-492d-9b37-351d28c756a6" Jul 20 16:10:19.039083 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.038971 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:10:19.039083 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:19.039063 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fzrbx" podUID="586b30af-aafe-48c8-a1c9-cd97c9bcbeb7" Jul 20 16:10:19.039201 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:19.039183 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jn4lt" podUID="8e116ef2-0fca-44f3-84c2-86b3bde42a78" Jul 20 16:10:19.302689 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.302607 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-156.ec2.internal" event="NodeReady" Jul 20 16:10:19.302844 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.302728 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 16:10:19.347598 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.347567 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lc4ht"] Jul 20 16:10:19.355354 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.355330 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5w42m"] Jul 20 16:10:19.355510 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.355459 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lc4ht" Jul 20 16:10:19.358360 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.358303 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k5vc7\"" Jul 20 16:10:19.359189 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.359056 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 16:10:19.359189 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.359099 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 16:10:19.365873 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.365847 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lc4ht"] Jul 20 16:10:19.365981 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.365884 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5w42m"] Jul 20 16:10:19.365981 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.365936 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.368793 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.368772 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 16:10:19.368947 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.368931 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 16:10:19.369038 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.368974 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 16:10:19.369038 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.368980 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lmm6k\"" Jul 20 16:10:19.369174 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.369156 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 16:10:19.448928 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.448899 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7fz44"] Jul 20 16:10:19.460352 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.460323 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7fz44"] Jul 20 16:10:19.460468 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.460419 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7fz44" Jul 20 16:10:19.463390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.463367 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 16:10:19.463531 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.463408 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 16:10:19.463596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.463528 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 16:10:19.463596 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.463537 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j66tg\"" Jul 20 16:10:19.470067 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.470041 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:19.524715 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.524687 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:19.535110 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.535090 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/03a5a004-f663-40e4-b550-7a2adefefc49-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5w42m\" (UID: \"03a5a004-f663-40e4-b550-7a2adefefc49\") " pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.535250 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.535119 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/03a5a004-f663-40e4-b550-7a2adefefc49-data-volume\") pod \"insights-runtime-extractor-5w42m\" (UID: \"03a5a004-f663-40e4-b550-7a2adefefc49\") " pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.535250 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.535140 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/03a5a004-f663-40e4-b550-7a2adefefc49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5w42m\" (UID: \"03a5a004-f663-40e4-b550-7a2adefefc49\") " pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.535250 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.535166 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e067d9c1-b358-4fc6-a1ca-a274208f01da-metrics-tls\") pod \"dns-default-lc4ht\" (UID: \"e067d9c1-b358-4fc6-a1ca-a274208f01da\") " pod="openshift-dns/dns-default-lc4ht" Jul 20 16:10:19.535250 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.535212 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e067d9c1-b358-4fc6-a1ca-a274208f01da-tmp-dir\") pod \"dns-default-lc4ht\" (UID: \"e067d9c1-b358-4fc6-a1ca-a274208f01da\") " pod="openshift-dns/dns-default-lc4ht" Jul 20 16:10:19.535473 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.535279 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2kdh\" (UniqueName: \"kubernetes.io/projected/03a5a004-f663-40e4-b550-7a2adefefc49-kube-api-access-l2kdh\") pod \"insights-runtime-extractor-5w42m\" (UID: \"03a5a004-f663-40e4-b550-7a2adefefc49\") " pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.535473 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.535347 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/03a5a004-f663-40e4-b550-7a2adefefc49-crio-socket\") pod \"insights-runtime-extractor-5w42m\" (UID: \"03a5a004-f663-40e4-b550-7a2adefefc49\") " pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.535473 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.535374 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfh7v\" (UniqueName: \"kubernetes.io/projected/e067d9c1-b358-4fc6-a1ca-a274208f01da-kube-api-access-mfh7v\") pod \"dns-default-lc4ht\" (UID: \"e067d9c1-b358-4fc6-a1ca-a274208f01da\") " pod="openshift-dns/dns-default-lc4ht" Jul 20 16:10:19.535473 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.535412 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e067d9c1-b358-4fc6-a1ca-a274208f01da-config-volume\") pod \"dns-default-lc4ht\" (UID: \"e067d9c1-b358-4fc6-a1ca-a274208f01da\") " pod="openshift-dns/dns-default-lc4ht" Jul 20 16:10:19.635941 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.635919 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xl49\" (UniqueName: \"kubernetes.io/projected/bf72da65-d94d-43d6-a122-d5a372ead7b5-kube-api-access-8xl49\") pod \"ingress-canary-7fz44\" (UID: \"bf72da65-d94d-43d6-a122-d5a372ead7b5\") " pod="openshift-ingress-canary/ingress-canary-7fz44" Jul 20 16:10:19.636101 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.635968 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/03a5a004-f663-40e4-b550-7a2adefefc49-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5w42m\" (UID: \"03a5a004-f663-40e4-b550-7a2adefefc49\") " pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.636101 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.635991 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/03a5a004-f663-40e4-b550-7a2adefefc49-data-volume\") pod \"insights-runtime-extractor-5w42m\" (UID: \"03a5a004-f663-40e4-b550-7a2adefefc49\") " pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.636101 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.636035 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/03a5a004-f663-40e4-b550-7a2adefefc49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5w42m\" (UID: \"03a5a004-f663-40e4-b550-7a2adefefc49\") " pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.636101 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.636067 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e067d9c1-b358-4fc6-a1ca-a274208f01da-metrics-tls\") pod \"dns-default-lc4ht\" (UID: \"e067d9c1-b358-4fc6-a1ca-a274208f01da\") " pod="openshift-dns/dns-default-lc4ht" Jul 20 16:10:19.636101 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.636085 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e067d9c1-b358-4fc6-a1ca-a274208f01da-tmp-dir\") pod \"dns-default-lc4ht\" (UID: \"e067d9c1-b358-4fc6-a1ca-a274208f01da\") " pod="openshift-dns/dns-default-lc4ht" Jul 20 16:10:19.636376 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.636120 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2kdh\" (UniqueName: \"kubernetes.io/projected/03a5a004-f663-40e4-b550-7a2adefefc49-kube-api-access-l2kdh\") pod \"insights-runtime-extractor-5w42m\" (UID: \"03a5a004-f663-40e4-b550-7a2adefefc49\") " pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.636376 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.636159 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/03a5a004-f663-40e4-b550-7a2adefefc49-crio-socket\") pod \"insights-runtime-extractor-5w42m\" (UID: \"03a5a004-f663-40e4-b550-7a2adefefc49\") " pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.636376 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.636181 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfh7v\" (UniqueName: \"kubernetes.io/projected/e067d9c1-b358-4fc6-a1ca-a274208f01da-kube-api-access-mfh7v\") pod \"dns-default-lc4ht\" (UID: \"e067d9c1-b358-4fc6-a1ca-a274208f01da\") " pod="openshift-dns/dns-default-lc4ht" Jul 20 16:10:19.636376 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.636218 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf72da65-d94d-43d6-a122-d5a372ead7b5-cert\") pod \"ingress-canary-7fz44\" (UID: \"bf72da65-d94d-43d6-a122-d5a372ead7b5\") " pod="openshift-ingress-canary/ingress-canary-7fz44" Jul 20 16:10:19.636376 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.636262 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e067d9c1-b358-4fc6-a1ca-a274208f01da-config-volume\") pod \"dns-default-lc4ht\" (UID: \"e067d9c1-b358-4fc6-a1ca-a274208f01da\") " pod="openshift-dns/dns-default-lc4ht" Jul 20 16:10:19.636600 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.636378 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/03a5a004-f663-40e4-b550-7a2adefefc49-data-volume\") pod \"insights-runtime-extractor-5w42m\" (UID: \"03a5a004-f663-40e4-b550-7a2adefefc49\") " pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.636600 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.636459 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e067d9c1-b358-4fc6-a1ca-a274208f01da-tmp-dir\") pod \"dns-default-lc4ht\" (UID: \"e067d9c1-b358-4fc6-a1ca-a274208f01da\") " pod="openshift-dns/dns-default-lc4ht" Jul 20 16:10:19.636600 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.636577 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/03a5a004-f663-40e4-b550-7a2adefefc49-crio-socket\") pod \"insights-runtime-extractor-5w42m\" (UID: \"03a5a004-f663-40e4-b550-7a2adefefc49\") " pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.636740 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.636668 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/03a5a004-f663-40e4-b550-7a2adefefc49-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5w42m\" (UID: \"03a5a004-f663-40e4-b550-7a2adefefc49\") " pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.640214 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.640194 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/03a5a004-f663-40e4-b550-7a2adefefc49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5w42m\" (UID: \"03a5a004-f663-40e4-b550-7a2adefefc49\") " pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.643670 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.643646 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2kdh\" (UniqueName: \"kubernetes.io/projected/03a5a004-f663-40e4-b550-7a2adefefc49-kube-api-access-l2kdh\") pod \"insights-runtime-extractor-5w42m\" (UID: \"03a5a004-f663-40e4-b550-7a2adefefc49\") " pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.644399 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.644375 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e067d9c1-b358-4fc6-a1ca-a274208f01da-config-volume\") pod \"dns-default-lc4ht\" (UID: \"e067d9c1-b358-4fc6-a1ca-a274208f01da\") " pod="openshift-dns/dns-default-lc4ht" Jul 20 16:10:19.645798 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.645781 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e067d9c1-b358-4fc6-a1ca-a274208f01da-metrics-tls\") pod \"dns-default-lc4ht\" (UID: \"e067d9c1-b358-4fc6-a1ca-a274208f01da\") " pod="openshift-dns/dns-default-lc4ht" Jul 20 16:10:19.646135 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.646118 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfh7v\" (UniqueName: \"kubernetes.io/projected/e067d9c1-b358-4fc6-a1ca-a274208f01da-kube-api-access-mfh7v\") pod \"dns-default-lc4ht\" (UID: \"e067d9c1-b358-4fc6-a1ca-a274208f01da\") " pod="openshift-dns/dns-default-lc4ht" Jul 20 16:10:19.670099 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.670079 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lc4ht" Jul 20 16:10:19.676224 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.676205 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5w42m" Jul 20 16:10:19.736728 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.736675 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf72da65-d94d-43d6-a122-d5a372ead7b5-cert\") pod \"ingress-canary-7fz44\" (UID: \"bf72da65-d94d-43d6-a122-d5a372ead7b5\") " pod="openshift-ingress-canary/ingress-canary-7fz44" Jul 20 16:10:19.736914 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.736749 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xl49\" (UniqueName: \"kubernetes.io/projected/bf72da65-d94d-43d6-a122-d5a372ead7b5-kube-api-access-8xl49\") pod \"ingress-canary-7fz44\" (UID: \"bf72da65-d94d-43d6-a122-d5a372ead7b5\") " pod="openshift-ingress-canary/ingress-canary-7fz44" Jul 20 16:10:19.739452 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.739430 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf72da65-d94d-43d6-a122-d5a372ead7b5-cert\") pod \"ingress-canary-7fz44\" (UID: \"bf72da65-d94d-43d6-a122-d5a372ead7b5\") " pod="openshift-ingress-canary/ingress-canary-7fz44" Jul 20 16:10:19.744492 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.744474 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xl49\" (UniqueName: \"kubernetes.io/projected/bf72da65-d94d-43d6-a122-d5a372ead7b5-kube-api-access-8xl49\") pod \"ingress-canary-7fz44\" (UID: \"bf72da65-d94d-43d6-a122-d5a372ead7b5\") " pod="openshift-ingress-canary/ingress-canary-7fz44" Jul 20 16:10:19.769423 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.769396 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7fz44" Jul 20 16:10:19.847108 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.846790 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lc4ht"] Jul 20 16:10:19.882362 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.882255 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5w42m"] Jul 20 16:10:19.884984 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:19.884954 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a5a004_f663_40e4_b550_7a2adefefc49.slice/crio-0e7443db199e98edf2feca3445d743399e780214dfc3d93ec44fd4f3d7a0af79 WatchSource:0}: Error finding container 0e7443db199e98edf2feca3445d743399e780214dfc3d93ec44fd4f3d7a0af79: Status 404 returned error can't find the container with id 0e7443db199e98edf2feca3445d743399e780214dfc3d93ec44fd4f3d7a0af79 Jul 20 16:10:19.922551 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:19.922518 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7fz44"] Jul 20 16:10:19.928515 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:19.928320 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf72da65_d94d_43d6_a122_d5a372ead7b5.slice/crio-ba4c27b60e2766c0bc1eef2fe5c5c27cd3cf7e617eac3db1b5d174bcfdfc968d WatchSource:0}: Error finding container ba4c27b60e2766c0bc1eef2fe5c5c27cd3cf7e617eac3db1b5d174bcfdfc968d: Status 404 returned error can't find the container with id ba4c27b60e2766c0bc1eef2fe5c5c27cd3cf7e617eac3db1b5d174bcfdfc968d Jul 20 16:10:20.238343 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:20.238257 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7fz44" event={"ID":"bf72da65-d94d-43d6-a122-d5a372ead7b5","Type":"ContainerStarted","Data":"ba4c27b60e2766c0bc1eef2fe5c5c27cd3cf7e617eac3db1b5d174bcfdfc968d"} Jul 20 16:10:20.239270 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:20.239247 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lc4ht" event={"ID":"e067d9c1-b358-4fc6-a1ca-a274208f01da","Type":"ContainerStarted","Data":"f185e530bd17f1f411d81440be851252ca4dbeb3d03e5a376ed86fd5f9f6fe78"} Jul 20 16:10:20.240134 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:20.240111 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5w42m" event={"ID":"03a5a004-f663-40e4-b550-7a2adefefc49","Type":"ContainerStarted","Data":"0e7443db199e98edf2feca3445d743399e780214dfc3d93ec44fd4f3d7a0af79"} Jul 20 16:10:21.039025 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:21.038986 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:10:21.039527 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:21.039142 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:10:21.039643 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:21.038992 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:10:21.042432 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:21.042409 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 16:10:21.044840 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:21.044028 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k42tf\"" Jul 20 16:10:21.044840 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:21.044380 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 16:10:21.044840 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:21.044400 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 16:10:21.044840 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:21.044695 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 16:10:21.045092 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:21.044904 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rx9t8\"" Jul 20 16:10:24.118338 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:24.118304 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:24.291298 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:24.291261 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:25.030459 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:25.030412 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:25.148935 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:25.148905 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:27.269287 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:27.269256 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7fz44" event={"ID":"bf72da65-d94d-43d6-a122-d5a372ead7b5","Type":"ContainerStarted","Data":"dbb0ea7caf78ee13ee46509340750c5b21e5652ad297b764556a71c503777ead"} Jul 20 16:10:27.271086 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:27.271064 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lc4ht" event={"ID":"e067d9c1-b358-4fc6-a1ca-a274208f01da","Type":"ContainerStarted","Data":"0ca1b711ccf0f02ad371982595830def742b4d1b41288c03251c167f804dfefc"} Jul 20 16:10:27.271175 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:27.271105 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lc4ht" event={"ID":"e067d9c1-b358-4fc6-a1ca-a274208f01da","Type":"ContainerStarted","Data":"f93a0fa0d6fd50705977fa474884016444fdcae185778807985ff05c00ce12b0"} Jul 20 16:10:27.271175 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:27.271168 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lc4ht" Jul 20 16:10:27.272679 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:27.272643 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5w42m" event={"ID":"03a5a004-f663-40e4-b550-7a2adefefc49","Type":"ContainerStarted","Data":"67a065b6a457d645d5d534ca7c2e859478e56ce6ea9f9eb6e1b5ecde018ae7f2"} Jul 20 16:10:27.288362 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:27.288286 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7fz44" podStartSLOduration=1.447390149 podStartE2EDuration="8.288273433s" totalImagesPullingTime="6.840883284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:27.287680123 +0000 UTC m=+57.836979421" watchObservedRunningTime="2026-07-20 16:10:27.288273433 +0000 UTC m=+57.837572726" Jul 20 16:10:27.307041 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:27.306993 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lc4ht" podStartSLOduration=1.3942419099999999 podStartE2EDuration="8.30697932s" totalImagesPullingTime="6.91273741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:27.306697507 +0000 UTC m=+57.855996803" watchObservedRunningTime="2026-07-20 16:10:27.30697932 +0000 UTC m=+57.856278597" Jul 20 16:10:30.192362 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:30.192336 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j5x9t" Jul 20 16:10:30.313210 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:30.313175 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:30.414582 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:30.414546 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:30.651713 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:30.651653 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:30.752542 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:30.752500 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:31.285631 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:31.285598 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5w42m" event={"ID":"03a5a004-f663-40e4-b550-7a2adefefc49","Type":"ContainerStarted","Data":"5e44973b9dc47cfdb26dfaaf4ef1fc413c38a75ee6e57321a9e1f7ab3c47266c"} Jul 20 16:10:31.357883 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:31.357835 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:31.459728 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:31.459647 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:31.724370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:31.724337 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:31.827957 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:31.827926 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:31.894142 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:31.894100 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:31.896694 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:31.896668 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dkmvc"] Jul 20 16:10:31.898746 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:31.898723 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dkmvc" Jul 20 16:10:31.901554 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:31.901531 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gqgrw\"" Jul 20 16:10:31.901682 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:31.901532 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 20 16:10:31.909581 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:31.909555 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dkmvc"] Jul 20 16:10:31.927127 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:31.927096 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b1a3a88a-96be-4d9b-a629-40cbd96b9c15-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-dkmvc\" (UID: \"b1a3a88a-96be-4d9b-a629-40cbd96b9c15\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dkmvc" Jul 20 16:10:32.027588 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:32.027497 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b1a3a88a-96be-4d9b-a629-40cbd96b9c15-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-dkmvc\" (UID: \"b1a3a88a-96be-4d9b-a629-40cbd96b9c15\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dkmvc" Jul 20 16:10:32.027741 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:32.027636 2569 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 20 16:10:32.027741 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:32.027708 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1a3a88a-96be-4d9b-a629-40cbd96b9c15-tls-certificates podName:b1a3a88a-96be-4d9b-a629-40cbd96b9c15 nodeName:}" failed. No retries permitted until 2026-07-20 16:10:32.527691107 +0000 UTC m=+63.076990384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/b1a3a88a-96be-4d9b-a629-40cbd96b9c15-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-dkmvc" (UID: "b1a3a88a-96be-4d9b-a629-40cbd96b9c15") : secret "prometheus-operator-admission-webhook-tls" not found Jul 20 16:10:32.305036 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:32.304947 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:32.530903 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:32.530869 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b1a3a88a-96be-4d9b-a629-40cbd96b9c15-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-dkmvc\" (UID: \"b1a3a88a-96be-4d9b-a629-40cbd96b9c15\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dkmvc" Jul 20 16:10:32.533691 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:32.533665 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b1a3a88a-96be-4d9b-a629-40cbd96b9c15-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-dkmvc\" (UID: \"b1a3a88a-96be-4d9b-a629-40cbd96b9c15\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dkmvc" Jul 20 16:10:32.810245 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:32.810193 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dkmvc" Jul 20 16:10:33.001203 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.001145 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:33.103553 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.103461 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:33.694700 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.694662 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86f79857d9-7pvck"] Jul 20 16:10:33.707187 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.707151 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.708120 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.708095 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f79857d9-7pvck"] Jul 20 16:10:33.710166 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.710135 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 20 16:10:33.710306 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.710251 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 20 16:10:33.710306 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.710266 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 20 16:10:33.710414 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.710305 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 20 16:10:33.711514 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.711489 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 20 16:10:33.711514 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.711511 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 20 16:10:33.711669 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.711520 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 20 16:10:33.711669 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.711525 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-njsmv\"" Jul 20 16:10:33.740052 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.740024 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-config\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.740222 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.740079 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-serving-cert\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.740222 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.740126 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-oauth-config\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.740222 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.740193 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lggj\" (UniqueName: \"kubernetes.io/projected/6fef9227-64ad-4226-b591-fe869e9e5f7c-kube-api-access-7lggj\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.740397 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.740265 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-service-ca\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.740397 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.740307 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-oauth-serving-cert\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.840728 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.840697 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-config\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.840907 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.840751 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-serving-cert\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.840907 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.840883 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-oauth-config\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.841016 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.840937 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lggj\" (UniqueName: \"kubernetes.io/projected/6fef9227-64ad-4226-b591-fe869e9e5f7c-kube-api-access-7lggj\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.841016 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.840965 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-service-ca\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.841016 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.840990 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-oauth-serving-cert\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.841582 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.841539 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-config\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.841700 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.841674 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-service-ca\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.841773 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.841674 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-oauth-serving-cert\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.843576 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.843552 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-oauth-config\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.843709 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.843595 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-serving-cert\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:33.850262 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:33.850217 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lggj\" (UniqueName: \"kubernetes.io/projected/6fef9227-64ad-4226-b591-fe869e9e5f7c-kube-api-access-7lggj\") pod \"console-86f79857d9-7pvck\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:34.018984 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:34.018897 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:34.421412 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:34.421380 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f79857d9-7pvck"] Jul 20 16:10:34.424990 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:34.424963 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fef9227_64ad_4226_b591_fe869e9e5f7c.slice/crio-5aa1de25242bab96af3a0f7675f5f975d708f4e86dd55a69b0ceb31f385fd0d5 WatchSource:0}: Error finding container 5aa1de25242bab96af3a0f7675f5f975d708f4e86dd55a69b0ceb31f385fd0d5: Status 404 returned error can't find the container with id 5aa1de25242bab96af3a0f7675f5f975d708f4e86dd55a69b0ceb31f385fd0d5 Jul 20 16:10:34.434549 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:34.434524 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dkmvc"] Jul 20 16:10:34.437212 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:34.437189 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1a3a88a_96be_4d9b_a629_40cbd96b9c15.slice/crio-e535e708a81c752d5b3d08ba525535af3992c73d5994d25992a23d59a568acb6 WatchSource:0}: Error finding container e535e708a81c752d5b3d08ba525535af3992c73d5994d25992a23d59a568acb6: Status 404 returned error can't find the container with id e535e708a81c752d5b3d08ba525535af3992c73d5994d25992a23d59a568acb6 Jul 20 16:10:35.115647 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.115574 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:35.216192 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.216125 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:35.300492 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.300416 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dkmvc" event={"ID":"b1a3a88a-96be-4d9b-a629-40cbd96b9c15","Type":"ContainerStarted","Data":"e535e708a81c752d5b3d08ba525535af3992c73d5994d25992a23d59a568acb6"} Jul 20 16:10:35.303309 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.303277 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5w42m" event={"ID":"03a5a004-f663-40e4-b550-7a2adefefc49","Type":"ContainerStarted","Data":"4d28d5d438a657edddb00b383d1af35ca329e32a92818be51282f4ed99efd815"} Jul 20 16:10:35.305211 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.305161 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f79857d9-7pvck" event={"ID":"6fef9227-64ad-4226-b591-fe869e9e5f7c","Type":"ContainerStarted","Data":"5aa1de25242bab96af3a0f7675f5f975d708f4e86dd55a69b0ceb31f385fd0d5"} Jul 20 16:10:35.324878 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.324815 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5w42m" podStartSLOduration=2.064572503 podStartE2EDuration="16.324791003s" totalImagesPullingTime="14.2602185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:10:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:35.324281039 +0000 UTC m=+65.873580339" watchObservedRunningTime="2026-07-20 16:10:35.324791003 +0000 UTC m=+65.874090307" Jul 20 16:10:35.657347 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.657308 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqrh7\" (UniqueName: \"kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7\") pod \"network-check-target-62crl\" (UID: \"3f2af8e3-e9b2-492d-9b37-351d28c756a6\") " pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:10:35.657583 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.657363 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs\") pod \"network-metrics-daemon-fzrbx\" (UID: \"586b30af-aafe-48c8-a1c9-cd97c9bcbeb7\") " pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:10:35.657583 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.657413 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret\") pod \"global-pull-secret-syncer-jn4lt\" (UID: \"8e116ef2-0fca-44f3-84c2-86b3bde42a78\") " pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:10:35.660538 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.660513 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 16:10:35.660758 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.660742 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 16:10:35.660889 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.660868 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 16:10:35.670999 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.670976 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 16:10:35.671108 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.671027 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/586b30af-aafe-48c8-a1c9-cd97c9bcbeb7-metrics-certs\") pod \"network-metrics-daemon-fzrbx\" (UID: \"586b30af-aafe-48c8-a1c9-cd97c9bcbeb7\") " pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:10:35.671108 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.671084 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e116ef2-0fca-44f3-84c2-86b3bde42a78-original-pull-secret\") pod \"global-pull-secret-syncer-jn4lt\" (UID: \"8e116ef2-0fca-44f3-84c2-86b3bde42a78\") " pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:10:35.681958 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.681939 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqrh7\" (UniqueName: \"kubernetes.io/projected/3f2af8e3-e9b2-492d-9b37-351d28c756a6-kube-api-access-sqrh7\") pod \"network-check-target-62crl\" (UID: \"3f2af8e3-e9b2-492d-9b37-351d28c756a6\") " pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:10:35.758672 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.758647 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k42tf\"" Jul 20 16:10:35.766284 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.766254 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:10:35.767983 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.767959 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rx9t8\"" Jul 20 16:10:35.775328 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.775305 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fzrbx" Jul 20 16:10:35.775427 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.775314 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jn4lt" Jul 20 16:10:35.956590 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:35.956562 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jn4lt"] Jul 20 16:10:35.960693 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:35.960665 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e116ef2_0fca_44f3_84c2_86b3bde42a78.slice/crio-81b1273e723827474ddb03370f55bd6c7ab725a9a9a9d1112b85bd99e86aae53 WatchSource:0}: Error finding container 81b1273e723827474ddb03370f55bd6c7ab725a9a9a9d1112b85bd99e86aae53: Status 404 returned error can't find the container with id 81b1273e723827474ddb03370f55bd6c7ab725a9a9a9d1112b85bd99e86aae53 Jul 20 16:10:36.178127 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.178053 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fzrbx"] Jul 20 16:10:36.180959 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.180936 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-62crl"] Jul 20 16:10:36.309919 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.309882 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dkmvc" event={"ID":"b1a3a88a-96be-4d9b-a629-40cbd96b9c15","Type":"ContainerStarted","Data":"97c1fc01b3d88c4aab65759cca4988e3ef8f3a3fb49de6a80f3d87c9ff029e86"} Jul 20 16:10:36.310120 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.310060 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dkmvc" Jul 20 16:10:36.311532 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.311477 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jn4lt" event={"ID":"8e116ef2-0fca-44f3-84c2-86b3bde42a78","Type":"ContainerStarted","Data":"81b1273e723827474ddb03370f55bd6c7ab725a9a9a9d1112b85bd99e86aae53"} Jul 20 16:10:36.315523 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.315499 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dkmvc" Jul 20 16:10:36.326505 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.326466 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dkmvc" podStartSLOduration=3.970651262 podStartE2EDuration="5.326448749s" totalImagesPullingTime="1.355797487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:36.326060383 +0000 UTC m=+66.875359686" watchObservedRunningTime="2026-07-20 16:10:36.326448749 +0000 UTC m=+66.875748051" Jul 20 16:10:36.942348 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.942296 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:36.976196 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.976166 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl"] Jul 20 16:10:36.982243 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.982201 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" Jul 20 16:10:36.986508 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.986486 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 20 16:10:36.986655 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.986566 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 16:10:36.986655 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.986592 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 16:10:36.986773 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.986673 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wtp97\"" Jul 20 16:10:36.986773 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.986714 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 20 16:10:36.986889 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.986857 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 16:10:36.993262 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:36.989736 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl"] Jul 20 16:10:37.042593 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.042554 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:37.068811 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.068776 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz428\" (UniqueName: \"kubernetes.io/projected/e017ebdb-ff50-4aa2-925b-91ec7dd188ab-kube-api-access-gz428\") pod \"prometheus-operator-5945b5cfd-tq8wl\" (UID: \"e017ebdb-ff50-4aa2-925b-91ec7dd188ab\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" Jul 20 16:10:37.068984 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.068839 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e017ebdb-ff50-4aa2-925b-91ec7dd188ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tq8wl\" (UID: \"e017ebdb-ff50-4aa2-925b-91ec7dd188ab\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" Jul 20 16:10:37.068984 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.068880 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e017ebdb-ff50-4aa2-925b-91ec7dd188ab-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tq8wl\" (UID: \"e017ebdb-ff50-4aa2-925b-91ec7dd188ab\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" Jul 20 16:10:37.068984 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.068920 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e017ebdb-ff50-4aa2-925b-91ec7dd188ab-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tq8wl\" (UID: \"e017ebdb-ff50-4aa2-925b-91ec7dd188ab\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" Jul 20 16:10:37.127928 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:37.127896 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586b30af_aafe_48c8_a1c9_cd97c9bcbeb7.slice/crio-324ee9eeaa8d457c58115fd16d6ada3e08d68d9128a8ffd39bfcbd10b7288ea0 WatchSource:0}: Error finding container 324ee9eeaa8d457c58115fd16d6ada3e08d68d9128a8ffd39bfcbd10b7288ea0: Status 404 returned error can't find the container with id 324ee9eeaa8d457c58115fd16d6ada3e08d68d9128a8ffd39bfcbd10b7288ea0 Jul 20 16:10:37.129063 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:37.129043 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2af8e3_e9b2_492d_9b37_351d28c756a6.slice/crio-7cd88c28f6d7425e99f494fdf815dd446f5e655c27530acbacc999f337000028 WatchSource:0}: Error finding container 7cd88c28f6d7425e99f494fdf815dd446f5e655c27530acbacc999f337000028: Status 404 returned error can't find the container with id 7cd88c28f6d7425e99f494fdf815dd446f5e655c27530acbacc999f337000028 Jul 20 16:10:37.169191 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.169166 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e017ebdb-ff50-4aa2-925b-91ec7dd188ab-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tq8wl\" (UID: \"e017ebdb-ff50-4aa2-925b-91ec7dd188ab\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" Jul 20 16:10:37.169294 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.169210 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz428\" (UniqueName: \"kubernetes.io/projected/e017ebdb-ff50-4aa2-925b-91ec7dd188ab-kube-api-access-gz428\") pod \"prometheus-operator-5945b5cfd-tq8wl\" (UID: \"e017ebdb-ff50-4aa2-925b-91ec7dd188ab\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" Jul 20 16:10:37.169294 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.169265 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e017ebdb-ff50-4aa2-925b-91ec7dd188ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tq8wl\" (UID: \"e017ebdb-ff50-4aa2-925b-91ec7dd188ab\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" Jul 20 16:10:37.169417 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.169295 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e017ebdb-ff50-4aa2-925b-91ec7dd188ab-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tq8wl\" (UID: \"e017ebdb-ff50-4aa2-925b-91ec7dd188ab\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" Jul 20 16:10:37.169417 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:37.169398 2569 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 20 16:10:37.169505 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:37.169467 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e017ebdb-ff50-4aa2-925b-91ec7dd188ab-prometheus-operator-tls podName:e017ebdb-ff50-4aa2-925b-91ec7dd188ab nodeName:}" failed. No retries permitted until 2026-07-20 16:10:37.669446189 +0000 UTC m=+68.218745466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e017ebdb-ff50-4aa2-925b-91ec7dd188ab-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-tq8wl" (UID: "e017ebdb-ff50-4aa2-925b-91ec7dd188ab") : secret "prometheus-operator-tls" not found Jul 20 16:10:37.169906 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.169887 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e017ebdb-ff50-4aa2-925b-91ec7dd188ab-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-tq8wl\" (UID: \"e017ebdb-ff50-4aa2-925b-91ec7dd188ab\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" Jul 20 16:10:37.171643 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.171623 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e017ebdb-ff50-4aa2-925b-91ec7dd188ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-tq8wl\" (UID: \"e017ebdb-ff50-4aa2-925b-91ec7dd188ab\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" Jul 20 16:10:37.178266 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.178246 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz428\" (UniqueName: \"kubernetes.io/projected/e017ebdb-ff50-4aa2-925b-91ec7dd188ab-kube-api-access-gz428\") pod \"prometheus-operator-5945b5cfd-tq8wl\" (UID: \"e017ebdb-ff50-4aa2-925b-91ec7dd188ab\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" Jul 20 16:10:37.261069 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.261035 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:37.278936 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.278911 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lc4ht" Jul 20 16:10:37.318174 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.318139 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f79857d9-7pvck" event={"ID":"6fef9227-64ad-4226-b591-fe869e9e5f7c","Type":"ContainerStarted","Data":"41b68709a5ee551e9540564f5a107784e0b24ac85a0a38698e4c30d89767de49"} Jul 20 16:10:37.319980 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.319950 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fzrbx" event={"ID":"586b30af-aafe-48c8-a1c9-cd97c9bcbeb7","Type":"ContainerStarted","Data":"324ee9eeaa8d457c58115fd16d6ada3e08d68d9128a8ffd39bfcbd10b7288ea0"} Jul 20 16:10:37.321375 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.321339 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-62crl" event={"ID":"3f2af8e3-e9b2-492d-9b37-351d28c756a6","Type":"ContainerStarted","Data":"7cd88c28f6d7425e99f494fdf815dd446f5e655c27530acbacc999f337000028"} Jul 20 16:10:37.336158 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.335894 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86f79857d9-7pvck" podStartSLOduration=1.60440884 podStartE2EDuration="4.335872604s" totalImagesPullingTime="2.731463764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:37.335017407 +0000 UTC m=+67.884316707" watchObservedRunningTime="2026-07-20 16:10:37.335872604 +0000 UTC m=+67.885171904" Jul 20 16:10:37.406473 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.406435 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:37.503051 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.502955 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:37.673769 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.673736 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e017ebdb-ff50-4aa2-925b-91ec7dd188ab-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tq8wl\" (UID: \"e017ebdb-ff50-4aa2-925b-91ec7dd188ab\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" Jul 20 16:10:37.677406 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.677379 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e017ebdb-ff50-4aa2-925b-91ec7dd188ab-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-tq8wl\" (UID: \"e017ebdb-ff50-4aa2-925b-91ec7dd188ab\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" Jul 20 16:10:37.691950 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.691016 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bc96cd8c4-964rr"] Jul 20 16:10:37.693402 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.693377 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.702473 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.702446 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 20 16:10:37.705032 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.704985 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bc96cd8c4-964rr"] Jul 20 16:10:37.774951 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.774872 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-trusted-ca-bundle\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.774951 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.774919 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-oauth-serving-cert\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.775159 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.774960 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-serving-cert\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.775159 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.775014 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-oauth-config\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.775159 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.775035 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbqtc\" (UniqueName: \"kubernetes.io/projected/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-kube-api-access-gbqtc\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.775159 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.775057 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-service-ca\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.775159 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.775090 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-config\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.876033 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.875987 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-oauth-config\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.876327 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.876036 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbqtc\" (UniqueName: \"kubernetes.io/projected/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-kube-api-access-gbqtc\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.876327 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.876067 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-service-ca\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.876327 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.876096 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-config\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.876327 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.876155 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-trusted-ca-bundle\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.876327 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.876183 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-oauth-serving-cert\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.876327 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.876216 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-serving-cert\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.878408 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.877916 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-service-ca\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.878553 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.878467 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-oauth-serving-cert\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.878618 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.878560 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-config\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.879509 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.879454 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-trusted-ca-bundle\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.880196 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.880153 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-oauth-config\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.881680 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.881651 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-serving-cert\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.890475 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.890407 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbqtc\" (UniqueName: \"kubernetes.io/projected/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-kube-api-access-gbqtc\") pod \"console-bc96cd8c4-964rr\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:37.897059 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:37.897023 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" Jul 20 16:10:38.005035 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:38.005003 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:38.078558 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:38.078482 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl"] Jul 20 16:10:38.080218 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:38.080151 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode017ebdb_ff50_4aa2_925b_91ec7dd188ab.slice/crio-4e8dfab5191130e7ec99b84c5870bf2efa2082d705fdbd174f84b7dfae0fd011 WatchSource:0}: Error finding container 4e8dfab5191130e7ec99b84c5870bf2efa2082d705fdbd174f84b7dfae0fd011: Status 404 returned error can't find the container with id 4e8dfab5191130e7ec99b84c5870bf2efa2082d705fdbd174f84b7dfae0fd011 Jul 20 16:10:38.171976 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:38.171922 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bc96cd8c4-964rr"] Jul 20 16:10:38.175940 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:38.175910 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc37ebd_886e_4b76_a71f_a67c0cbe05e2.slice/crio-da3f5485eee6db26dd0ab9429403946948a664caf04fc5f0d541c8aa73e17c2b WatchSource:0}: Error finding container da3f5485eee6db26dd0ab9429403946948a664caf04fc5f0d541c8aa73e17c2b: Status 404 returned error can't find the container with id da3f5485eee6db26dd0ab9429403946948a664caf04fc5f0d541c8aa73e17c2b Jul 20 16:10:38.306884 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:38.306765 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:38.327457 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:38.327338 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" event={"ID":"e017ebdb-ff50-4aa2-925b-91ec7dd188ab","Type":"ContainerStarted","Data":"4e8dfab5191130e7ec99b84c5870bf2efa2082d705fdbd174f84b7dfae0fd011"} Jul 20 16:10:38.328802 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:38.328760 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc96cd8c4-964rr" event={"ID":"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2","Type":"ContainerStarted","Data":"da3f5485eee6db26dd0ab9429403946948a664caf04fc5f0d541c8aa73e17c2b"} Jul 20 16:10:38.402759 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:38.402677 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:39.336088 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:39.335895 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc96cd8c4-964rr" event={"ID":"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2","Type":"ContainerStarted","Data":"01da4e69028e345ebfa0396494a7b8d0b7110f0ed48915441452414392c0165f"} Jul 20 16:10:39.340086 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:39.340049 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fzrbx" event={"ID":"586b30af-aafe-48c8-a1c9-cd97c9bcbeb7","Type":"ContainerStarted","Data":"2efa2a80fb4ca9e5433aef2572a18f702526841542abf653f307eeea120fdbf6"} Jul 20 16:10:39.340249 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:39.340111 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fzrbx" event={"ID":"586b30af-aafe-48c8-a1c9-cd97c9bcbeb7","Type":"ContainerStarted","Data":"633a95d90890888baf0cecb341e29582f939bf1ab006d1b01eac99e14f966702"} Jul 20 16:10:39.355247 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:39.354924 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bc96cd8c4-964rr" podStartSLOduration=2.354878448 podStartE2EDuration="2.354878448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:39.354369685 +0000 UTC m=+69.903668994" watchObservedRunningTime="2026-07-20 16:10:39.354878448 +0000 UTC m=+69.904177748" Jul 20 16:10:39.373266 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:39.372888 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fzrbx" podStartSLOduration=67.611152482 podStartE2EDuration="1m9.372862787s" totalImagesPullingTime="1.761710305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:39.371502534 +0000 UTC m=+69.920801836" watchObservedRunningTime="2026-07-20 16:10:39.372862787 +0000 UTC m=+69.922162090" Jul 20 16:10:39.479631 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:39.479541 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:39.579160 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:39.579123 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:40.437018 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:40.436982 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:40.539790 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:40.539731 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:40.999882 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:40.999840 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:41.105059 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:41.105030 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:41.201849 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:41.201803 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:41.301362 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:41.301270 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:42.221800 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:42.221761 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:42.324192 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:42.324160 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:42.841322 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:42.841284 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:43.358798 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:43.358760 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jn4lt" event={"ID":"8e116ef2-0fca-44f3-84c2-86b3bde42a78","Type":"ContainerStarted","Data":"08453ba59881f6e9f13261b5594451595447b69ec2cb023779eeb2fa75551924"} Jul 20 16:10:43.360732 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:43.360697 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" event={"ID":"e017ebdb-ff50-4aa2-925b-91ec7dd188ab","Type":"ContainerStarted","Data":"78a849abc53e12f7aa1a845837a346abf8fef0413ed951bc0e5a2e965967bd22"} Jul 20 16:10:43.360881 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:43.360762 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" event={"ID":"e017ebdb-ff50-4aa2-925b-91ec7dd188ab","Type":"ContainerStarted","Data":"91d965349329d7194292724e03c8356a86b251558e3f99eecc195fc22726fe76"} Jul 20 16:10:43.362059 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:43.362040 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-62crl" event={"ID":"3f2af8e3-e9b2-492d-9b37-351d28c756a6","Type":"ContainerStarted","Data":"346cdd82c6787a135e79d33fb2b22360fdcdf9c2bd553aa75554ddc277cd2d67"} Jul 20 16:10:43.362222 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:43.362209 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:10:43.374921 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:43.374873 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jn4lt" podStartSLOduration=67.032376045 podStartE2EDuration="1m13.374856774s" totalImagesPullingTime="6.342480729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:43.37413449 +0000 UTC m=+73.923433793" watchObservedRunningTime="2026-07-20 16:10:43.374856774 +0000 UTC m=+73.924156051" Jul 20 16:10:43.388881 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:43.388843 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-62crl" podStartSLOduration=68.214253277 podStartE2EDuration="1m13.388831172s" totalImagesPullingTime="5.174577895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:43.388500449 +0000 UTC m=+73.937799761" watchObservedRunningTime="2026-07-20 16:10:43.388831172 +0000 UTC m=+73.938130471" Jul 20 16:10:43.406526 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:43.406484 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-tq8wl" podStartSLOduration=3.196656051 podStartE2EDuration="7.406469805s" totalImagesPullingTime="4.209813754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:43.405985241 +0000 UTC m=+73.955284541" watchObservedRunningTime="2026-07-20 16:10:43.406469805 +0000 UTC m=+73.955769104" Jul 20 16:10:44.019409 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:44.019369 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:44.019582 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:44.019443 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:44.024207 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:44.024182 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:44.369032 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:44.369009 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:10:44.501117 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:44.501077 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:44.603992 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:44.603955 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:45.080116 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.080082 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:45.198022 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.197986 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:45.299334 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.299290 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:45.324766 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.324731 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh"] Jul 20 16:10:45.327062 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.327041 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" Jul 20 16:10:45.330048 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.330026 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 20 16:10:45.330323 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.330275 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 20 16:10:45.330436 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.330418 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-flqdr\"" Jul 20 16:10:45.337026 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.337006 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh"] Jul 20 16:10:45.354715 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.354692 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-bp5ll"] Jul 20 16:10:45.356613 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.356598 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.359570 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.359544 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-r449b\"" Jul 20 16:10:45.359665 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.359581 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 20 16:10:45.359665 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.359611 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 20 16:10:45.360007 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.359994 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 20 16:10:45.361592 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.361569 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7wswx"] Jul 20 16:10:45.363990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.363973 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.366943 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.366905 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 16:10:45.366943 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.366932 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 16:10:45.367099 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.366958 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 16:10:45.367617 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.367601 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-86hrx\"" Jul 20 16:10:45.373674 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.373655 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-bp5ll"] Jul 20 16:10:45.404924 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.404893 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:45.439998 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.439966 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59b1d78a-f8ff-428e-a304-57f3fb9f320f-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.439998 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.439995 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59b1d78a-f8ff-428e-a304-57f3fb9f320f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.440254 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440017 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv8sm\" (UniqueName: \"kubernetes.io/projected/532f72f2-1c23-4349-a854-f246a8c9a343-kube-api-access-rv8sm\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.440254 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440035 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/532f72f2-1c23-4349-a854-f246a8c9a343-sys\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.440254 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440057 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/532f72f2-1c23-4349-a854-f246a8c9a343-root\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.440254 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440121 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r24wq\" (UniqueName: \"kubernetes.io/projected/17c3339c-dff7-4d9d-aa5b-5da1faf6f5be-kube-api-access-r24wq\") pod \"openshift-state-metrics-79f6958cdf-xqhxh\" (UID: \"17c3339c-dff7-4d9d-aa5b-5da1faf6f5be\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" Jul 20 16:10:45.440254 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440145 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd5zh\" (UniqueName: \"kubernetes.io/projected/59b1d78a-f8ff-428e-a304-57f3fb9f320f-kube-api-access-sd5zh\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.440254 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440169 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-accelerators-collector-config\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.440254 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440208 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-tls\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.440254 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440252 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/532f72f2-1c23-4349-a854-f246a8c9a343-metrics-client-ca\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.440568 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440307 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17c3339c-dff7-4d9d-aa5b-5da1faf6f5be-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-xqhxh\" (UID: \"17c3339c-dff7-4d9d-aa5b-5da1faf6f5be\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" Jul 20 16:10:45.440568 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440372 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59b1d78a-f8ff-428e-a304-57f3fb9f320f-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.440568 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440434 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/59b1d78a-f8ff-428e-a304-57f3fb9f320f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.440706 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440579 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17c3339c-dff7-4d9d-aa5b-5da1faf6f5be-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-xqhxh\" (UID: \"17c3339c-dff7-4d9d-aa5b-5da1faf6f5be\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" Jul 20 16:10:45.440706 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440617 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-textfile\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.440706 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440651 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.440706 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440689 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/59b1d78a-f8ff-428e-a304-57f3fb9f320f-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.440706 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440706 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-wtmp\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.440909 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.440738 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17c3339c-dff7-4d9d-aa5b-5da1faf6f5be-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-xqhxh\" (UID: \"17c3339c-dff7-4d9d-aa5b-5da1faf6f5be\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" Jul 20 16:10:45.498913 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.498880 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:45.542116 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542090 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59b1d78a-f8ff-428e-a304-57f3fb9f320f-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.542309 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542120 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/59b1d78a-f8ff-428e-a304-57f3fb9f320f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.542309 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542146 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17c3339c-dff7-4d9d-aa5b-5da1faf6f5be-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-xqhxh\" (UID: \"17c3339c-dff7-4d9d-aa5b-5da1faf6f5be\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" Jul 20 16:10:45.542309 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542170 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-textfile\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.542309 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542199 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.542309 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542225 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/59b1d78a-f8ff-428e-a304-57f3fb9f320f-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.542309 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542274 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-wtmp\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.542309 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542304 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17c3339c-dff7-4d9d-aa5b-5da1faf6f5be-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-xqhxh\" (UID: \"17c3339c-dff7-4d9d-aa5b-5da1faf6f5be\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" Jul 20 16:10:45.542309 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:45.542310 2569 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 20 16:10:45.542786 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542343 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59b1d78a-f8ff-428e-a304-57f3fb9f320f-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.542786 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:45.542381 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b1d78a-f8ff-428e-a304-57f3fb9f320f-kube-state-metrics-tls podName:59b1d78a-f8ff-428e-a304-57f3fb9f320f nodeName:}" failed. No retries permitted until 2026-07-20 16:10:46.042358184 +0000 UTC m=+76.591657466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/59b1d78a-f8ff-428e-a304-57f3fb9f320f-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-bp5ll" (UID: "59b1d78a-f8ff-428e-a304-57f3fb9f320f") : secret "kube-state-metrics-tls" not found Jul 20 16:10:45.542786 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542408 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59b1d78a-f8ff-428e-a304-57f3fb9f320f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.542786 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542446 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv8sm\" (UniqueName: \"kubernetes.io/projected/532f72f2-1c23-4349-a854-f246a8c9a343-kube-api-access-rv8sm\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.542786 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542476 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/532f72f2-1c23-4349-a854-f246a8c9a343-sys\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.542786 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542504 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/532f72f2-1c23-4349-a854-f246a8c9a343-root\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.542786 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542541 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r24wq\" (UniqueName: \"kubernetes.io/projected/17c3339c-dff7-4d9d-aa5b-5da1faf6f5be-kube-api-access-r24wq\") pod \"openshift-state-metrics-79f6958cdf-xqhxh\" (UID: \"17c3339c-dff7-4d9d-aa5b-5da1faf6f5be\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" Jul 20 16:10:45.542786 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542566 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd5zh\" (UniqueName: \"kubernetes.io/projected/59b1d78a-f8ff-428e-a304-57f3fb9f320f-kube-api-access-sd5zh\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.542786 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542591 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-accelerators-collector-config\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.542786 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542622 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-tls\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.542786 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542629 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-textfile\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.542786 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542644 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/532f72f2-1c23-4349-a854-f246a8c9a343-metrics-client-ca\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.542786 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542668 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17c3339c-dff7-4d9d-aa5b-5da1faf6f5be-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-xqhxh\" (UID: \"17c3339c-dff7-4d9d-aa5b-5da1faf6f5be\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" Jul 20 16:10:45.542786 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542719 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/532f72f2-1c23-4349-a854-f246a8c9a343-root\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.542786 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.542735 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/59b1d78a-f8ff-428e-a304-57f3fb9f320f-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.543577 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.543075 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/59b1d78a-f8ff-428e-a304-57f3fb9f320f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.543577 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.543104 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59b1d78a-f8ff-428e-a304-57f3fb9f320f-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.543577 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:45.543200 2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 20 16:10:45.543577 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:45.543275 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-tls podName:532f72f2-1c23-4349-a854-f246a8c9a343 nodeName:}" failed. No retries permitted until 2026-07-20 16:10:46.043257293 +0000 UTC m=+76.592556574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-tls") pod "node-exporter-7wswx" (UID: "532f72f2-1c23-4349-a854-f246a8c9a343") : secret "node-exporter-tls" not found Jul 20 16:10:45.543577 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.543195 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-wtmp\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.543577 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.543470 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17c3339c-dff7-4d9d-aa5b-5da1faf6f5be-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-xqhxh\" (UID: \"17c3339c-dff7-4d9d-aa5b-5da1faf6f5be\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" Jul 20 16:10:45.543577 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.543537 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/532f72f2-1c23-4349-a854-f246a8c9a343-sys\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.543903 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.543588 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-accelerators-collector-config\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.543903 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.543643 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/532f72f2-1c23-4349-a854-f246a8c9a343-metrics-client-ca\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.545286 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.545262 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17c3339c-dff7-4d9d-aa5b-5da1faf6f5be-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-xqhxh\" (UID: \"17c3339c-dff7-4d9d-aa5b-5da1faf6f5be\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" Jul 20 16:10:45.545395 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.545268 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.545736 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.545718 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17c3339c-dff7-4d9d-aa5b-5da1faf6f5be-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-xqhxh\" (UID: \"17c3339c-dff7-4d9d-aa5b-5da1faf6f5be\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" Jul 20 16:10:45.546005 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.545984 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59b1d78a-f8ff-428e-a304-57f3fb9f320f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.551748 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.551726 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd5zh\" (UniqueName: \"kubernetes.io/projected/59b1d78a-f8ff-428e-a304-57f3fb9f320f-kube-api-access-sd5zh\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:45.551933 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.551918 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv8sm\" (UniqueName: \"kubernetes.io/projected/532f72f2-1c23-4349-a854-f246a8c9a343-kube-api-access-rv8sm\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:45.552386 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.552372 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r24wq\" (UniqueName: \"kubernetes.io/projected/17c3339c-dff7-4d9d-aa5b-5da1faf6f5be-kube-api-access-r24wq\") pod \"openshift-state-metrics-79f6958cdf-xqhxh\" (UID: \"17c3339c-dff7-4d9d-aa5b-5da1faf6f5be\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" Jul 20 16:10:45.636158 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.636120 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" Jul 20 16:10:45.759012 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.758977 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh"] Jul 20 16:10:45.763111 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:45.763070 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c3339c_dff7_4d9d_aa5b_5da1faf6f5be.slice/crio-6642c1c825da765b1420bbb57973e0b7f18c65efeccd48e57bf8fb41b1714d96 WatchSource:0}: Error finding container 6642c1c825da765b1420bbb57973e0b7f18c65efeccd48e57bf8fb41b1714d96: Status 404 returned error can't find the container with id 6642c1c825da765b1420bbb57973e0b7f18c65efeccd48e57bf8fb41b1714d96 Jul 20 16:10:45.906434 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:45.906349 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:46.005904 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.005862 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:46.046353 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.046321 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59b1d78a-f8ff-428e-a304-57f3fb9f320f-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:46.046496 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.046384 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-tls\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:46.048575 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.048555 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/532f72f2-1c23-4349-a854-f246a8c9a343-node-exporter-tls\") pod \"node-exporter-7wswx\" (UID: \"532f72f2-1c23-4349-a854-f246a8c9a343\") " pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:46.048682 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.048667 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/59b1d78a-f8ff-428e-a304-57f3fb9f320f-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-bp5ll\" (UID: \"59b1d78a-f8ff-428e-a304-57f3fb9f320f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:46.152319 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.152285 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:46.265545 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.265470 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" Jul 20 16:10:46.273392 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.273374 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7wswx" Jul 20 16:10:46.282746 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:46.282720 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod532f72f2_1c23_4349_a854_f246a8c9a343.slice/crio-d35662f17c33522f1b6216108bf4579dc8a558bcd9b84a02c818ced36981b506 WatchSource:0}: Error finding container d35662f17c33522f1b6216108bf4579dc8a558bcd9b84a02c818ced36981b506: Status 404 returned error can't find the container with id d35662f17c33522f1b6216108bf4579dc8a558bcd9b84a02c818ced36981b506 Jul 20 16:10:46.326203 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.326178 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:46.375802 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.375755 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" event={"ID":"17c3339c-dff7-4d9d-aa5b-5da1faf6f5be","Type":"ContainerStarted","Data":"1ba8b6e33a6bc9662afeb0bde584ed3a86bf784e4263209ecd81e3a8f17915a8"} Jul 20 16:10:46.376346 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.375832 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" event={"ID":"17c3339c-dff7-4d9d-aa5b-5da1faf6f5be","Type":"ContainerStarted","Data":"5eb450f49c14633843b9e8bd1e8dccbbcb0b50fb4ada2f8050e3f9a06719d63d"} Jul 20 16:10:46.376346 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.375863 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" event={"ID":"17c3339c-dff7-4d9d-aa5b-5da1faf6f5be","Type":"ContainerStarted","Data":"6642c1c825da765b1420bbb57973e0b7f18c65efeccd48e57bf8fb41b1714d96"} Jul 20 16:10:46.377281 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.377214 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7wswx" event={"ID":"532f72f2-1c23-4349-a854-f246a8c9a343","Type":"ContainerStarted","Data":"d35662f17c33522f1b6216108bf4579dc8a558bcd9b84a02c818ced36981b506"} Jul 20 16:10:46.401915 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.401892 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-bp5ll"] Jul 20 16:10:46.404297 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:46.404265 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b1d78a_f8ff_428e_a304_57f3fb9f320f.slice/crio-fa9883c734d552f1fa73fcdfaef04dbd40570396c465703a9764a557d39fc431 WatchSource:0}: Error finding container fa9883c734d552f1fa73fcdfaef04dbd40570396c465703a9764a557d39fc431: Status 404 returned error can't find the container with id fa9883c734d552f1fa73fcdfaef04dbd40570396c465703a9764a557d39fc431 Jul 20 16:10:46.406413 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.406365 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:46.413151 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.413127 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:10:46.416483 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.416459 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.419863 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.419531 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 20 16:10:46.419863 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.419606 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 20 16:10:46.419863 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.419531 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 20 16:10:46.420096 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.419940 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 20 16:10:46.420096 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.419969 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 20 16:10:46.420096 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.420077 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l2vs4\"" Jul 20 16:10:46.420315 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.419988 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 20 16:10:46.420315 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.420025 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 20 16:10:46.421860 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.421806 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 20 16:10:46.421976 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.421878 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 20 16:10:46.432836 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.432816 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:10:46.449603 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.449577 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-config-volume\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.449729 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.449617 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.449729 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.449634 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f2kw\" (UniqueName: \"kubernetes.io/projected/4952e8c6-ad49-4d28-a266-a7a6e879ac30-kube-api-access-5f2kw\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.449729 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.449699 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-web-config\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.449892 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.449737 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4952e8c6-ad49-4d28-a266-a7a6e879ac30-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.449892 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.449804 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4952e8c6-ad49-4d28-a266-a7a6e879ac30-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.449892 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.449846 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4952e8c6-ad49-4d28-a266-a7a6e879ac30-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.449892 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.449869 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4952e8c6-ad49-4d28-a266-a7a6e879ac30-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.450088 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.449897 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4952e8c6-ad49-4d28-a266-a7a6e879ac30-config-out\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.450088 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.449958 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.450088 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.449982 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.450088 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.450040 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.450327 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.450078 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.526300 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.526191 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:46.551193 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.551167 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4952e8c6-ad49-4d28-a266-a7a6e879ac30-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.551382 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.551209 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4952e8c6-ad49-4d28-a266-a7a6e879ac30-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.551382 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.551255 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4952e8c6-ad49-4d28-a266-a7a6e879ac30-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.551382 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.551290 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4952e8c6-ad49-4d28-a266-a7a6e879ac30-config-out\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.551382 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.551322 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.551382 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.551351 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.551630 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:10:46.551396 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4952e8c6-ad49-4d28-a266-a7a6e879ac30-alertmanager-trusted-ca-bundle podName:4952e8c6-ad49-4d28-a266-a7a6e879ac30 nodeName:}" failed. No retries permitted until 2026-07-20 16:10:47.051372779 +0000 UTC m=+77.600672074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/4952e8c6-ad49-4d28-a266-a7a6e879ac30-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "4952e8c6-ad49-4d28-a266-a7a6e879ac30") : configmap references non-existent config key: ca-bundle.crt Jul 20 16:10:46.551630 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.551447 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.551630 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.551489 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.551630 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.551524 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-config-volume\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.551630 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.551553 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.551630 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.551577 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f2kw\" (UniqueName: \"kubernetes.io/projected/4952e8c6-ad49-4d28-a266-a7a6e879ac30-kube-api-access-5f2kw\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.551630 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.551616 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-web-config\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.551978 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.551645 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4952e8c6-ad49-4d28-a266-a7a6e879ac30-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.551978 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.551660 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4952e8c6-ad49-4d28-a266-a7a6e879ac30-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.552400 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.552346 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4952e8c6-ad49-4d28-a266-a7a6e879ac30-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.554872 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.554851 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4952e8c6-ad49-4d28-a266-a7a6e879ac30-config-out\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.555021 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.554968 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.555136 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.554983 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.556398 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.555884 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.556398 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.556357 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4952e8c6-ad49-4d28-a266-a7a6e879ac30-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.556555 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.556447 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.556924 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.556901 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-config-volume\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.557141 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.557121 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-web-config\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.557357 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.557341 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:46.560846 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:46.560825 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f2kw\" (UniqueName: \"kubernetes.io/projected/4952e8c6-ad49-4d28-a266-a7a6e879ac30-kube-api-access-5f2kw\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:47.056252 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.056182 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4952e8c6-ad49-4d28-a266-a7a6e879ac30-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:47.057334 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.057303 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4952e8c6-ad49-4d28-a266-a7a6e879ac30-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:47.325162 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.325082 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d"] Jul 20 16:10:47.328569 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.328539 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.328712 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.328590 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:10:47.332758 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.332734 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 20 16:10:47.332875 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.332734 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 20 16:10:47.332992 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.332943 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 20 16:10:47.333044 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.332946 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-chf4v\"" Jul 20 16:10:47.333148 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.333133 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 20 16:10:47.333285 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.333269 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6i67ki2hcliis\"" Jul 20 16:10:47.333499 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.333413 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 20 16:10:47.349050 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.349023 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d"] Jul 20 16:10:47.359812 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.359784 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-thanos-querier-tls\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.359937 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.359849 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.359937 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.359887 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69hrn\" (UniqueName: \"kubernetes.io/projected/76c64832-22b5-48e5-a40d-17067c3f4c3c-kube-api-access-69hrn\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.359937 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.359918 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.360098 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.359981 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.360098 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.360029 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76c64832-22b5-48e5-a40d-17067c3f4c3c-metrics-client-ca\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.360098 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.360064 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-grpc-tls\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.360267 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.360118 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.383364 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.383331 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" event={"ID":"17c3339c-dff7-4d9d-aa5b-5da1faf6f5be","Type":"ContainerStarted","Data":"cf86d66ec4ddf1b4e4cb109867eff8aefa1b141de6143ff906e2f05d5fe434ae"} Jul 20 16:10:47.385110 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.385082 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" event={"ID":"59b1d78a-f8ff-428e-a304-57f3fb9f320f","Type":"ContainerStarted","Data":"fa9883c734d552f1fa73fcdfaef04dbd40570396c465703a9764a557d39fc431"} Jul 20 16:10:47.405891 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.405842 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xqhxh" podStartSLOduration=1.414937836 podStartE2EDuration="2.405825253s" totalImagesPullingTime="990.887417ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:47.404484596 +0000 UTC m=+77.953783895" watchObservedRunningTime="2026-07-20 16:10:47.405825253 +0000 UTC m=+77.955124553" Jul 20 16:10:47.461031 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.460997 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.461267 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.461042 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69hrn\" (UniqueName: \"kubernetes.io/projected/76c64832-22b5-48e5-a40d-17067c3f4c3c-kube-api-access-69hrn\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.461267 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.461083 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.461267 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.461124 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.461267 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.461178 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76c64832-22b5-48e5-a40d-17067c3f4c3c-metrics-client-ca\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.461267 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.461213 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-grpc-tls\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.461267 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.461264 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.461514 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.461314 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-thanos-querier-tls\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.462371 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.462346 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76c64832-22b5-48e5-a40d-17067c3f4c3c-metrics-client-ca\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.464430 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.464244 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.464678 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.464654 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-thanos-querier-tls\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.464923 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.464903 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.465080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.465062 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.465337 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.465318 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-grpc-tls\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.465540 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.465516 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/76c64832-22b5-48e5-a40d-17067c3f4c3c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.469165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.469143 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69hrn\" (UniqueName: \"kubernetes.io/projected/76c64832-22b5-48e5-a40d-17067c3f4c3c-kube-api-access-69hrn\") pod \"thanos-querier-66f7f9c89f-2tl8d\" (UID: \"76c64832-22b5-48e5-a40d-17067c3f4c3c\") " pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.640767 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.640731 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:47.894999 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.894902 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d"] Jul 20 16:10:47.898038 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:47.897980 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c64832_22b5_48e5_a40d_17067c3f4c3c.slice/crio-dee7f16a2e3b3fd5dfc89c467660bf537ee1a1cd502b75b758bdcadb90f3dc53 WatchSource:0}: Error finding container dee7f16a2e3b3fd5dfc89c467660bf537ee1a1cd502b75b758bdcadb90f3dc53: Status 404 returned error can't find the container with id dee7f16a2e3b3fd5dfc89c467660bf537ee1a1cd502b75b758bdcadb90f3dc53 Jul 20 16:10:47.917595 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:47.917485 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:10:47.922002 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:47.921933 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4952e8c6_ad49_4d28_a266_a7a6e879ac30.slice/crio-3b84ca0d94422fbddec0f9c45c17c01db207b59d3f0ae35ba8988d3bb7455731 WatchSource:0}: Error finding container 3b84ca0d94422fbddec0f9c45c17c01db207b59d3f0ae35ba8988d3bb7455731: Status 404 returned error can't find the container with id 3b84ca0d94422fbddec0f9c45c17c01db207b59d3f0ae35ba8988d3bb7455731 Jul 20 16:10:48.006188 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.006162 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:48.006372 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.006222 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:48.011817 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.011789 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:48.311686 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.311606 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:48.393953 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.393919 2569 generic.go:356] "Generic (PLEG): container finished" podID="532f72f2-1c23-4349-a854-f246a8c9a343" containerID="3191289c9f1655fc820d71c3465b694fa22567943be715acc22d4a67c65a1aeb" exitCode=0 Jul 20 16:10:48.394376 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.394003 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7wswx" event={"ID":"532f72f2-1c23-4349-a854-f246a8c9a343","Type":"ContainerDied","Data":"3191289c9f1655fc820d71c3465b694fa22567943be715acc22d4a67c65a1aeb"} Jul 20 16:10:48.395347 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.395321 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" event={"ID":"76c64832-22b5-48e5-a40d-17067c3f4c3c","Type":"ContainerStarted","Data":"dee7f16a2e3b3fd5dfc89c467660bf537ee1a1cd502b75b758bdcadb90f3dc53"} Jul 20 16:10:48.397544 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.397515 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" event={"ID":"59b1d78a-f8ff-428e-a304-57f3fb9f320f","Type":"ContainerStarted","Data":"0b1bd2e81674185bb3b53072db9cf1cca9fdb986a0410a0a7744d37f915d1bce"} Jul 20 16:10:48.397674 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.397564 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" event={"ID":"59b1d78a-f8ff-428e-a304-57f3fb9f320f","Type":"ContainerStarted","Data":"7004c7a2373cad6b5c3860ab94f0a457ddd1d74407b9e936a7146663364d42aa"} Jul 20 16:10:48.397674 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.397584 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" event={"ID":"59b1d78a-f8ff-428e-a304-57f3fb9f320f","Type":"ContainerStarted","Data":"7172142b1b05efa1cd78125b53f6d29f639e0865616286abf7ce0bc877bdbbe3"} Jul 20 16:10:48.398783 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.398758 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4952e8c6-ad49-4d28-a266-a7a6e879ac30","Type":"ContainerStarted","Data":"3b84ca0d94422fbddec0f9c45c17c01db207b59d3f0ae35ba8988d3bb7455731"} Jul 20 16:10:48.403102 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.403078 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:10:48.413152 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.413122 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:48.451414 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.451373 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-bp5ll" podStartSLOduration=2.105831392 podStartE2EDuration="3.45135291s" totalImagesPullingTime="1.345521518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:48.449888891 +0000 UTC m=+78.999188190" watchObservedRunningTime="2026-07-20 16:10:48.45135291 +0000 UTC m=+79.000652407" Jul 20 16:10:48.461325 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.461300 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f79857d9-7pvck"] Jul 20 16:10:48.558016 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.557983 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:48.659297 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.659264 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:48.759917 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.759865 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:48.860409 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:48.860317 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:49.236755 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.236701 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:49.337363 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.337287 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:49.405446 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.405412 2569 generic.go:356] "Generic (PLEG): container finished" podID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerID="498f29c5540b86f492f98bc8655de2cf3e15281351f767ecbc2b9f88b4843984" exitCode=0 Jul 20 16:10:49.405896 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.405497 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4952e8c6-ad49-4d28-a266-a7a6e879ac30","Type":"ContainerDied","Data":"498f29c5540b86f492f98bc8655de2cf3e15281351f767ecbc2b9f88b4843984"} Jul 20 16:10:49.408373 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.408348 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7wswx" event={"ID":"532f72f2-1c23-4349-a854-f246a8c9a343","Type":"ContainerStarted","Data":"fb235b4dcf12e020328e89f09a963be8b7efaced65b30e9add0ca30053ae1a70"} Jul 20 16:10:49.408485 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.408399 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7wswx" event={"ID":"532f72f2-1c23-4349-a854-f246a8c9a343","Type":"ContainerStarted","Data":"71dbf5b4e0d41d41b83264be22a3d14044378be7dc9f996c76ccbd93c7047eaa"} Jul 20 16:10:49.438496 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.438454 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:49.456042 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.455993 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7wswx" podStartSLOduration=2.9000907270000003 podStartE2EDuration="4.455977827s" totalImagesPullingTime="1.464994786s" totalInitContainerRuntime="90.892314ms" isStatefulPod=true podCreationTimestamp="2026-07-20 16:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:49.455354795 +0000 UTC m=+80.004654093" watchObservedRunningTime="2026-07-20 16:10:49.455977827 +0000 UTC m=+80.005277125" Jul 20 16:10:49.861056 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.861027 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-64b98f67c8-8x5pg"] Jul 20 16:10:49.864206 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.864188 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:49.867404 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.867382 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c4p4l9jp6las6\"" Jul 20 16:10:49.867527 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.867407 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 20 16:10:49.867527 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.867384 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 20 16:10:49.867527 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.867387 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 20 16:10:49.868615 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.868597 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wtnqd\"" Jul 20 16:10:49.868873 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.868849 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 20 16:10:49.874609 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.874589 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64b98f67c8-8x5pg"] Jul 20 16:10:49.985597 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.985565 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/639210ba-deb2-435d-b2fa-d1e519cc62d5-secret-metrics-server-tls\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:49.985726 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.985602 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639210ba-deb2-435d-b2fa-d1e519cc62d5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:49.985726 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.985634 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/639210ba-deb2-435d-b2fa-d1e519cc62d5-secret-metrics-server-client-certs\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:49.985726 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.985694 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/639210ba-deb2-435d-b2fa-d1e519cc62d5-audit-log\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:49.985904 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.985737 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/639210ba-deb2-435d-b2fa-d1e519cc62d5-client-ca-bundle\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:49.985904 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.985775 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpbzm\" (UniqueName: \"kubernetes.io/projected/639210ba-deb2-435d-b2fa-d1e519cc62d5-kube-api-access-gpbzm\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:49.985904 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:49.985857 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/639210ba-deb2-435d-b2fa-d1e519cc62d5-metrics-server-audit-profiles\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:50.087268 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.087218 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpbzm\" (UniqueName: \"kubernetes.io/projected/639210ba-deb2-435d-b2fa-d1e519cc62d5-kube-api-access-gpbzm\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:50.087432 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.087306 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/639210ba-deb2-435d-b2fa-d1e519cc62d5-metrics-server-audit-profiles\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:50.087432 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.087370 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/639210ba-deb2-435d-b2fa-d1e519cc62d5-secret-metrics-server-tls\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:50.087432 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.087387 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639210ba-deb2-435d-b2fa-d1e519cc62d5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:50.087432 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.087428 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/639210ba-deb2-435d-b2fa-d1e519cc62d5-secret-metrics-server-client-certs\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:50.087648 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.087454 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/639210ba-deb2-435d-b2fa-d1e519cc62d5-audit-log\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:50.087648 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.087475 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/639210ba-deb2-435d-b2fa-d1e519cc62d5-client-ca-bundle\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:50.087927 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.087892 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/639210ba-deb2-435d-b2fa-d1e519cc62d5-audit-log\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:50.088460 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.088435 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639210ba-deb2-435d-b2fa-d1e519cc62d5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:50.089493 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.089468 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/639210ba-deb2-435d-b2fa-d1e519cc62d5-metrics-server-audit-profiles\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:50.090654 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.090627 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/639210ba-deb2-435d-b2fa-d1e519cc62d5-secret-metrics-server-client-certs\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:50.091048 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.091025 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/639210ba-deb2-435d-b2fa-d1e519cc62d5-client-ca-bundle\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:50.091185 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.091123 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/639210ba-deb2-435d-b2fa-d1e519cc62d5-secret-metrics-server-tls\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:50.096121 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.096096 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpbzm\" (UniqueName: \"kubernetes.io/projected/639210ba-deb2-435d-b2fa-d1e519cc62d5-kube-api-access-gpbzm\") pod \"metrics-server-64b98f67c8-8x5pg\" (UID: \"639210ba-deb2-435d-b2fa-d1e519cc62d5\") " pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:50.114252 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.114062 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:50.130465 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.130419 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g9xwq"] Jul 20 16:10:50.134119 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.134096 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g9xwq" Jul 20 16:10:50.138333 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.138298 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 20 16:10:50.138471 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.138356 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rnc5w\"" Jul 20 16:10:50.142640 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.142617 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g9xwq"] Jul 20 16:10:50.174757 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.174727 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:10:50.188932 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.188896 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fq2t\" (UniqueName: \"kubernetes.io/projected/26392dce-f311-485e-b7b0-871bc9797a26-kube-api-access-2fq2t\") pod \"monitoring-plugin-7b7b7bc8bf-g9xwq\" (UID: \"26392dce-f311-485e-b7b0-871bc9797a26\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g9xwq" Jul 20 16:10:50.189049 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.188957 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26392dce-f311-485e-b7b0-871bc9797a26-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-g9xwq\" (UID: \"26392dce-f311-485e-b7b0-871bc9797a26\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g9xwq" Jul 20 16:10:50.219087 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.218988 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:50.279953 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.279920 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:50.289705 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.289671 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fq2t\" (UniqueName: \"kubernetes.io/projected/26392dce-f311-485e-b7b0-871bc9797a26-kube-api-access-2fq2t\") pod \"monitoring-plugin-7b7b7bc8bf-g9xwq\" (UID: \"26392dce-f311-485e-b7b0-871bc9797a26\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g9xwq" Jul 20 16:10:50.289909 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.289748 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26392dce-f311-485e-b7b0-871bc9797a26-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-g9xwq\" (UID: \"26392dce-f311-485e-b7b0-871bc9797a26\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g9xwq" Jul 20 16:10:50.292597 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.292574 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26392dce-f311-485e-b7b0-871bc9797a26-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-g9xwq\" (UID: \"26392dce-f311-485e-b7b0-871bc9797a26\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g9xwq" Jul 20 16:10:50.299621 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.299592 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fq2t\" (UniqueName: \"kubernetes.io/projected/26392dce-f311-485e-b7b0-871bc9797a26-kube-api-access-2fq2t\") pod \"monitoring-plugin-7b7b7bc8bf-g9xwq\" (UID: \"26392dce-f311-485e-b7b0-871bc9797a26\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g9xwq" Jul 20 16:10:50.329584 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.329559 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64b98f67c8-8x5pg"] Jul 20 16:10:50.332259 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:50.332210 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639210ba_deb2_435d_b2fa_d1e519cc62d5.slice/crio-344d6d1d29389380734f6b36a1cdd2bcc49dd4e65c36f0661ccf4041d6d1b4cc WatchSource:0}: Error finding container 344d6d1d29389380734f6b36a1cdd2bcc49dd4e65c36f0661ccf4041d6d1b4cc: Status 404 returned error can't find the container with id 344d6d1d29389380734f6b36a1cdd2bcc49dd4e65c36f0661ccf4041d6d1b4cc Jul 20 16:10:50.412997 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.412967 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" event={"ID":"639210ba-deb2-435d-b2fa-d1e519cc62d5","Type":"ContainerStarted","Data":"344d6d1d29389380734f6b36a1cdd2bcc49dd4e65c36f0661ccf4041d6d1b4cc"} Jul 20 16:10:50.414985 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.414962 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" event={"ID":"76c64832-22b5-48e5-a40d-17067c3f4c3c","Type":"ContainerStarted","Data":"8b4d8d767b72187bebd576c6d585bedb7f3abe23a9532ff202a9be54c549a220"} Jul 20 16:10:50.415092 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.415017 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" event={"ID":"76c64832-22b5-48e5-a40d-17067c3f4c3c","Type":"ContainerStarted","Data":"dd08647b3aab1279ae15521f34cad6caee7aec245db0516c72c66d2216aec4f1"} Jul 20 16:10:50.415092 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.415044 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" event={"ID":"76c64832-22b5-48e5-a40d-17067c3f4c3c","Type":"ContainerStarted","Data":"890ac7fbce0053dea27f44e4753b6b2a11fe85504249328ed2e830c9ba127346"} Jul 20 16:10:50.446563 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.446532 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g9xwq" Jul 20 16:10:50.569575 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.569540 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-585b6cb554-hrt5k"] Jul 20 16:10:50.573298 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.573278 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.576386 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.576299 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 20 16:10:50.576557 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.576533 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 20 16:10:50.576657 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.576583 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-c5928\"" Jul 20 16:10:50.576657 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.576647 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 20 16:10:50.576769 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.576536 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 20 16:10:50.576922 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.576899 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 20 16:10:50.582437 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.582418 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 20 16:10:50.585639 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.585617 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-585b6cb554-hrt5k"] Jul 20 16:10:50.693061 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.692980 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4abf73fd-672b-4e0f-b165-02c04e63ee6f-metrics-client-ca\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.693061 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.693022 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4abf73fd-672b-4e0f-b165-02c04e63ee6f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.693061 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.693063 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4abf73fd-672b-4e0f-b165-02c04e63ee6f-serving-certs-ca-bundle\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.693368 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.693082 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4abf73fd-672b-4e0f-b165-02c04e63ee6f-telemeter-client-tls\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.693368 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.693131 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4abf73fd-672b-4e0f-b165-02c04e63ee6f-secret-telemeter-client\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.693368 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.693213 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4abf73fd-672b-4e0f-b165-02c04e63ee6f-federate-client-tls\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.693368 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.693264 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4abf73fd-672b-4e0f-b165-02c04e63ee6f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.693368 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.693288 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jr9h\" (UniqueName: \"kubernetes.io/projected/4abf73fd-672b-4e0f-b165-02c04e63ee6f-kube-api-access-8jr9h\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.715622 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.715583 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6797868cfc-6f5jq"] Jul 20 16:10:50.719328 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.719302 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.729089 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.729062 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6797868cfc-6f5jq"] Jul 20 16:10:50.793815 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.793777 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jr9h\" (UniqueName: \"kubernetes.io/projected/4abf73fd-672b-4e0f-b165-02c04e63ee6f-kube-api-access-8jr9h\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.793815 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.793816 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4abf73fd-672b-4e0f-b165-02c04e63ee6f-metrics-client-ca\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.794049 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.793846 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4abf73fd-672b-4e0f-b165-02c04e63ee6f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.794049 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.793914 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-oauth-serving-cert\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.794049 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.793958 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-serving-cert\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.794049 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.793974 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-config\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.794049 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.794038 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4abf73fd-672b-4e0f-b165-02c04e63ee6f-serving-certs-ca-bundle\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.794325 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.794061 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-oauth-config\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.794325 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.794084 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4abf73fd-672b-4e0f-b165-02c04e63ee6f-telemeter-client-tls\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.794325 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.794107 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-trusted-ca-bundle\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.794325 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.794142 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4abf73fd-672b-4e0f-b165-02c04e63ee6f-secret-telemeter-client\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.794325 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.794223 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4abf73fd-672b-4e0f-b165-02c04e63ee6f-federate-client-tls\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.794325 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.794323 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-service-ca\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.794614 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.794351 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r5xg\" (UniqueName: \"kubernetes.io/projected/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-kube-api-access-2r5xg\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.794614 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.794385 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4abf73fd-672b-4e0f-b165-02c04e63ee6f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.794785 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.794759 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4abf73fd-672b-4e0f-b165-02c04e63ee6f-metrics-client-ca\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.794882 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.794854 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4abf73fd-672b-4e0f-b165-02c04e63ee6f-serving-certs-ca-bundle\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.795586 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.795556 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4abf73fd-672b-4e0f-b165-02c04e63ee6f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.796993 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.796938 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4abf73fd-672b-4e0f-b165-02c04e63ee6f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.797280 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.797259 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4abf73fd-672b-4e0f-b165-02c04e63ee6f-federate-client-tls\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.797735 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.797699 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4abf73fd-672b-4e0f-b165-02c04e63ee6f-telemeter-client-tls\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.798039 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.797997 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4abf73fd-672b-4e0f-b165-02c04e63ee6f-secret-telemeter-client\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.801907 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.801884 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jr9h\" (UniqueName: \"kubernetes.io/projected/4abf73fd-672b-4e0f-b165-02c04e63ee6f-kube-api-access-8jr9h\") pod \"telemeter-client-585b6cb554-hrt5k\" (UID: \"4abf73fd-672b-4e0f-b165-02c04e63ee6f\") " pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.884920 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.884722 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" Jul 20 16:10:50.891732 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.891710 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g9xwq"] Jul 20 16:10:50.896377 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.895292 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-oauth-config\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.896377 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.895333 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-trusted-ca-bundle\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.896377 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.895411 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-service-ca\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.896377 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.895432 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5xg\" (UniqueName: \"kubernetes.io/projected/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-kube-api-access-2r5xg\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.896377 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.895488 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-oauth-serving-cert\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.896377 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.895517 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-serving-cert\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.896377 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.895537 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-config\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.896377 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.896324 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-config\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.897052 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.896996 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-oauth-serving-cert\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.897052 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.897002 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-trusted-ca-bundle\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.897487 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.897452 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-service-ca\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.898525 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:50.898497 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26392dce_f311_485e_b7b0_871bc9797a26.slice/crio-ff1428d63bc142a1157b76573ec1d06ba92d38b50f8ecfe2fc95d0264fee7871 WatchSource:0}: Error finding container ff1428d63bc142a1157b76573ec1d06ba92d38b50f8ecfe2fc95d0264fee7871: Status 404 returned error can't find the container with id ff1428d63bc142a1157b76573ec1d06ba92d38b50f8ecfe2fc95d0264fee7871 Jul 20 16:10:50.900088 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.900060 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-serving-cert\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.903024 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.902703 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-oauth-config\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.905648 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.905600 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r5xg\" (UniqueName: \"kubernetes.io/projected/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-kube-api-access-2r5xg\") pod \"console-6797868cfc-6f5jq\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:50.949169 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:50.949020 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:51.033307 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.032409 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:10:51.061311 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.061130 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:51.093539 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.093510 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-585b6cb554-hrt5k"] Jul 20 16:10:51.096340 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:51.096216 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4abf73fd_672b_4e0f_b165_02c04e63ee6f.slice/crio-2b3ec275d76bc47e79c1903501d25f74e201b64e009ff29bf1c51d4890641854 WatchSource:0}: Error finding container 2b3ec275d76bc47e79c1903501d25f74e201b64e009ff29bf1c51d4890641854: Status 404 returned error can't find the container with id 2b3ec275d76bc47e79c1903501d25f74e201b64e009ff29bf1c51d4890641854 Jul 20 16:10:51.214093 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.214038 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6797868cfc-6f5jq"] Jul 20 16:10:51.328207 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:51.328141 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd041d916_ed84_49e0_ad8b_ff19d6ebb37d.slice/crio-03ca3dc75e4e2a9f4ba7dbab380553d467651dffa8a26a754feca4df47023b77 WatchSource:0}: Error finding container 03ca3dc75e4e2a9f4ba7dbab380553d467651dffa8a26a754feca4df47023b77: Status 404 returned error can't find the container with id 03ca3dc75e4e2a9f4ba7dbab380553d467651dffa8a26a754feca4df47023b77 Jul 20 16:10:51.423724 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.423653 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g9xwq" event={"ID":"26392dce-f311-485e-b7b0-871bc9797a26","Type":"ContainerStarted","Data":"ff1428d63bc142a1157b76573ec1d06ba92d38b50f8ecfe2fc95d0264fee7871"} Jul 20 16:10:51.430511 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.430474 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4952e8c6-ad49-4d28-a266-a7a6e879ac30","Type":"ContainerStarted","Data":"78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206"} Jul 20 16:10:51.430650 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.430565 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4952e8c6-ad49-4d28-a266-a7a6e879ac30","Type":"ContainerStarted","Data":"c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4"} Jul 20 16:10:51.430650 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.430609 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4952e8c6-ad49-4d28-a266-a7a6e879ac30","Type":"ContainerStarted","Data":"648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0"} Jul 20 16:10:51.430754 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.430652 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4952e8c6-ad49-4d28-a266-a7a6e879ac30","Type":"ContainerStarted","Data":"1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c"} Jul 20 16:10:51.430754 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.430694 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4952e8c6-ad49-4d28-a266-a7a6e879ac30","Type":"ContainerStarted","Data":"c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c"} Jul 20 16:10:51.432427 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.432395 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" event={"ID":"4abf73fd-672b-4e0f-b165-02c04e63ee6f","Type":"ContainerStarted","Data":"2b3ec275d76bc47e79c1903501d25f74e201b64e009ff29bf1c51d4890641854"} Jul 20 16:10:51.434186 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.434154 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6797868cfc-6f5jq" event={"ID":"d041d916-ed84-49e0-ad8b-ff19d6ebb37d","Type":"ContainerStarted","Data":"03ca3dc75e4e2a9f4ba7dbab380553d467651dffa8a26a754feca4df47023b77"} Jul 20 16:10:51.636045 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.633630 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 16:10:51.637617 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.637528 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:51.639264 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.639006 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.642720 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.642486 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 20 16:10:51.643191 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.643173 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 20 16:10:51.643472 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.643448 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 20 16:10:51.644326 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.644169 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 20 16:10:51.646565 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.644530 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7r8mnijk3h1m8\"" Jul 20 16:10:51.646565 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.644737 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 20 16:10:51.646565 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.644530 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 20 16:10:51.646565 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.645325 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 20 16:10:51.646565 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.645508 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-54t7h\"" Jul 20 16:10:51.646565 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.645700 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 20 16:10:51.646565 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.645863 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 20 16:10:51.646565 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.646027 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 20 16:10:51.646565 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.646189 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 20 16:10:51.646565 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.646268 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 20 16:10:51.648654 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.647827 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 20 16:10:51.653977 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.651978 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 20 16:10:51.656828 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.656808 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 16:10:51.703801 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.703763 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.703997 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.703827 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.703997 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.703857 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.703997 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.703886 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67aa069a-cbef-4886-9994-8e81299c9911-config-out\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.703997 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.703913 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.703997 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.703956 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.704290 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.704004 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.704290 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.704032 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.704290 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.704063 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67aa069a-cbef-4886-9994-8e81299c9911-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.704290 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.704087 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.704290 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.704140 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.704290 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.704194 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.704290 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.704245 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-config\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.704290 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.704274 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.704670 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.704308 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.704670 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.704342 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.704670 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.704364 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgct6\" (UniqueName: \"kubernetes.io/projected/67aa069a-cbef-4886-9994-8e81299c9911-kube-api-access-hgct6\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.704670 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.704486 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-web-config\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.704670 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.704557 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.704670 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.704600 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.805588 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805403 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-config\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.805588 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805442 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.805588 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805466 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.805588 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805488 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.805588 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805503 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgct6\" (UniqueName: \"kubernetes.io/projected/67aa069a-cbef-4886-9994-8e81299c9911-kube-api-access-hgct6\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.805588 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805534 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-web-config\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.805588 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805557 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.805588 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805580 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.806082 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805616 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.806082 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805638 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.806082 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805660 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.806082 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805683 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67aa069a-cbef-4886-9994-8e81299c9911-config-out\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.806082 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805704 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.806082 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805727 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.806082 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805773 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.806082 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805803 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.806082 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805833 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67aa069a-cbef-4886-9994-8e81299c9911-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.806082 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805856 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.806082 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805913 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.806082 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.805953 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.807500 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.807133 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.808026 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.807998 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.808778 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.808653 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.809516 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.809492 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.811575 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.810435 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-config\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.811575 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.810828 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.811575 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.811296 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.811575 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.811504 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.811840 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.811786 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.812058 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.811946 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.812163 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.812143 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.812385 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.812284 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67aa069a-cbef-4886-9994-8e81299c9911-config-out\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.812464 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.812388 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.812921 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.812878 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.813194 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.813170 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67aa069a-cbef-4886-9994-8e81299c9911-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.813855 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.813824 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.814342 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.814317 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.815191 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.815169 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.815191 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.815189 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-web-config\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.820566 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.820523 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgct6\" (UniqueName: \"kubernetes.io/projected/67aa069a-cbef-4886-9994-8e81299c9911-kube-api-access-hgct6\") pod \"prometheus-k8s-0\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:51.956035 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:51.955996 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:10:52.441932 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:52.441888 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6797868cfc-6f5jq" event={"ID":"d041d916-ed84-49e0-ad8b-ff19d6ebb37d","Type":"ContainerStarted","Data":"18b785e68e0a3e9b5efcc9607929591f1f5133ee773b365f8a7aae4d694ac0af"} Jul 20 16:10:52.446385 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:52.446345 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4952e8c6-ad49-4d28-a266-a7a6e879ac30","Type":"ContainerStarted","Data":"98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7"} Jul 20 16:10:52.450042 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:52.450013 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" event={"ID":"76c64832-22b5-48e5-a40d-17067c3f4c3c","Type":"ContainerStarted","Data":"44d387df9ccafa6b392b2fecc5ed436217d2463bb4c0f899079f4c84a8481d43"} Jul 20 16:10:52.450182 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:52.450083 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" event={"ID":"76c64832-22b5-48e5-a40d-17067c3f4c3c","Type":"ContainerStarted","Data":"221961574be21979acdea5a694910d487cd9e0cfb2acf0d105a417ed2a2155a9"} Jul 20 16:10:52.461744 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:52.461692 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6797868cfc-6f5jq" podStartSLOduration=2.461676251 podStartE2EDuration="2.461676251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:52.459591466 +0000 UTC m=+83.008890766" watchObservedRunningTime="2026-07-20 16:10:52.461676251 +0000 UTC m=+83.010975549" Jul 20 16:10:52.485871 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:52.485487 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.972067021 podStartE2EDuration="6.485466247s" totalImagesPullingTime="2.493761669s" totalInitContainerRuntime="19.637557ms" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:52.483382591 +0000 UTC m=+83.032681894" watchObservedRunningTime="2026-07-20 16:10:52.485466247 +0000 UTC m=+83.034765547" Jul 20 16:10:53.248726 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:53.248689 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 16:10:53.249367 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:10:53.249183 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67aa069a_cbef_4886_9994_8e81299c9911.slice/crio-ad8c98c14d39d3fde86b30f861657e973932e5c4559e93c08f915b45ed7c771c WatchSource:0}: Error finding container ad8c98c14d39d3fde86b30f861657e973932e5c4559e93c08f915b45ed7c771c: Status 404 returned error can't find the container with id ad8c98c14d39d3fde86b30f861657e973932e5c4559e93c08f915b45ed7c771c Jul 20 16:10:53.456686 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:53.456652 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" event={"ID":"4abf73fd-672b-4e0f-b165-02c04e63ee6f","Type":"ContainerStarted","Data":"75309bdb8b1fe8a8718819fb10f9f4f5b45633840e929979c592e75446ffbeb2"} Jul 20 16:10:53.457107 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:53.456714 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" event={"ID":"4abf73fd-672b-4e0f-b165-02c04e63ee6f","Type":"ContainerStarted","Data":"5aa65d330e1f068583ec939b45bf63e85e57115fb208fbfa3538b377a08ff2a1"} Jul 20 16:10:53.457107 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:53.456737 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" event={"ID":"4abf73fd-672b-4e0f-b165-02c04e63ee6f","Type":"ContainerStarted","Data":"9378ecbd74653279e7860f7e08ab1d3ee0895d182e25e2a5ef1533ca26f6600e"} Jul 20 16:10:53.458340 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:53.458312 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g9xwq" event={"ID":"26392dce-f311-485e-b7b0-871bc9797a26","Type":"ContainerStarted","Data":"399a2dfbf029141715ef704a6b1542718ffa1dc6b93e727576564d45a29582b6"} Jul 20 16:10:53.458539 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:53.458520 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g9xwq" Jul 20 16:10:53.460006 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:53.459946 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" event={"ID":"639210ba-deb2-435d-b2fa-d1e519cc62d5","Type":"ContainerStarted","Data":"2585f8934b92e2d0db5944537620b47252c4bf28e29b1b6454cad58468848254"} Jul 20 16:10:53.461922 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:53.461896 2569 generic.go:356] "Generic (PLEG): container finished" podID="67aa069a-cbef-4886-9994-8e81299c9911" containerID="d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a" exitCode=0 Jul 20 16:10:53.462026 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:53.461970 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67aa069a-cbef-4886-9994-8e81299c9911","Type":"ContainerDied","Data":"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a"} Jul 20 16:10:53.462106 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:53.462044 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67aa069a-cbef-4886-9994-8e81299c9911","Type":"ContainerStarted","Data":"ad8c98c14d39d3fde86b30f861657e973932e5c4559e93c08f915b45ed7c771c"} Jul 20 16:10:53.469893 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:53.469866 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g9xwq" Jul 20 16:10:53.471374 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:53.471347 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" event={"ID":"76c64832-22b5-48e5-a40d-17067c3f4c3c","Type":"ContainerStarted","Data":"7bf17995c9cb0a7ea761fe03b68d9d671b3d60ce5e62b8b84cd7e328007695d8"} Jul 20 16:10:53.477977 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:53.477918 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-585b6cb554-hrt5k" podStartSLOduration=1.429700809 podStartE2EDuration="3.477901308s" totalImagesPullingTime="2.048200499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:53.475830563 +0000 UTC m=+84.025129861" watchObservedRunningTime="2026-07-20 16:10:53.477901308 +0000 UTC m=+84.027200611" Jul 20 16:10:53.495784 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:53.495750 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" podStartSLOduration=1.739712439 podStartE2EDuration="4.495738216s" totalImagesPullingTime="2.756025777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:53.495559081 +0000 UTC m=+84.044858382" watchObservedRunningTime="2026-07-20 16:10:53.495738216 +0000 UTC m=+84.045037514" Jul 20 16:10:53.522039 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:53.521999 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" podStartSLOduration=3.254591076 podStartE2EDuration="6.521985452s" totalImagesPullingTime="3.267394376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:53.521021664 +0000 UTC m=+84.070320970" watchObservedRunningTime="2026-07-20 16:10:53.521985452 +0000 UTC m=+84.071284793" Jul 20 16:10:53.541075 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:53.541032 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-g9xwq" podStartSLOduration=1.354549794 podStartE2EDuration="3.541019742s" totalImagesPullingTime="2.186469948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:53.539557161 +0000 UTC m=+84.088856460" watchObservedRunningTime="2026-07-20 16:10:53.541019742 +0000 UTC m=+84.090319040" Jul 20 16:10:54.296572 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:54.296536 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6797868cfc-6f5jq"] Jul 20 16:10:54.477083 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:54.477043 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:55.490345 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:55.490309 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66f7f9c89f-2tl8d" Jul 20 16:10:57.219990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:57.219959 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:57.320022 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:57.319981 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:57.493769 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:57.493688 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67aa069a-cbef-4886-9994-8e81299c9911","Type":"ContainerStarted","Data":"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719"} Jul 20 16:10:57.493769 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:57.493754 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67aa069a-cbef-4886-9994-8e81299c9911","Type":"ContainerStarted","Data":"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9"} Jul 20 16:10:57.493943 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:57.493782 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67aa069a-cbef-4886-9994-8e81299c9911","Type":"ContainerStarted","Data":"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6"} Jul 20 16:10:57.493943 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:57.493815 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67aa069a-cbef-4886-9994-8e81299c9911","Type":"ContainerStarted","Data":"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf"} Jul 20 16:10:57.493943 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:57.493845 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67aa069a-cbef-4886-9994-8e81299c9911","Type":"ContainerStarted","Data":"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540"} Jul 20 16:10:57.493943 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:57.493871 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67aa069a-cbef-4886-9994-8e81299c9911","Type":"ContainerStarted","Data":"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642"} Jul 20 16:10:57.522365 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:57.522319 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.362890711 podStartE2EDuration="6.522303452s" totalImagesPullingTime="3.135806846s" totalInitContainerRuntime="23.605895ms" isStatefulPod=false podCreationTimestamp="2026-07-20 16:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:10:57.519333824 +0000 UTC m=+88.068633123" watchObservedRunningTime="2026-07-20 16:10:57.522303452 +0000 UTC m=+88.071602752" Jul 20 16:10:58.115209 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:58.115176 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:10:58.175872 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:10:58.175833 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:11:01.033486 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:01.033453 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:11:01.956540 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:01.956495 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:11:05.101582 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:05.101546 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bc96cd8c4-964rr"] Jul 20 16:11:05.188100 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:05.188062 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:11:05.289172 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:05.289139 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:11:05.339141 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:05.339110 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:11:10.175251 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:10.175200 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:11:10.175633 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:10.175277 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:11:13.492599 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:13.492537 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86f79857d9-7pvck" podUID="6fef9227-64ad-4226-b591-fe869e9e5f7c" containerName="console" containerID="cri-o://41b68709a5ee551e9540564f5a107784e0b24ac85a0a38698e4c30d89767de49" gracePeriod=15 Jul 20 16:11:13.909549 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:13.909507 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:11:13.971491 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:13.971457 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:11:14.263819 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.263791 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:11:14.328627 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.328591 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-serving-cert\") pod \"6fef9227-64ad-4226-b591-fe869e9e5f7c\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " Jul 20 16:11:14.328817 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.328638 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lggj\" (UniqueName: \"kubernetes.io/projected/6fef9227-64ad-4226-b591-fe869e9e5f7c-kube-api-access-7lggj\") pod \"6fef9227-64ad-4226-b591-fe869e9e5f7c\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " Jul 20 16:11:14.328817 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.328678 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-service-ca\") pod \"6fef9227-64ad-4226-b591-fe869e9e5f7c\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " Jul 20 16:11:14.328817 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.328745 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-oauth-serving-cert\") pod \"6fef9227-64ad-4226-b591-fe869e9e5f7c\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " Jul 20 16:11:14.328817 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.328808 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-config\") pod \"6fef9227-64ad-4226-b591-fe869e9e5f7c\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " Jul 20 16:11:14.329022 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.328842 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-oauth-config\") pod \"6fef9227-64ad-4226-b591-fe869e9e5f7c\" (UID: \"6fef9227-64ad-4226-b591-fe869e9e5f7c\") " Jul 20 16:11:14.329180 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.329149 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-service-ca" (OuterVolumeSpecName: "service-ca") pod "6fef9227-64ad-4226-b591-fe869e9e5f7c" (UID: "6fef9227-64ad-4226-b591-fe869e9e5f7c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:11:14.329290 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.329201 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-config" (OuterVolumeSpecName: "console-config") pod "6fef9227-64ad-4226-b591-fe869e9e5f7c" (UID: "6fef9227-64ad-4226-b591-fe869e9e5f7c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:11:14.329290 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.329214 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6fef9227-64ad-4226-b591-fe869e9e5f7c" (UID: "6fef9227-64ad-4226-b591-fe869e9e5f7c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:11:14.331059 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.331035 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6fef9227-64ad-4226-b591-fe869e9e5f7c" (UID: "6fef9227-64ad-4226-b591-fe869e9e5f7c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:11:14.331153 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.331071 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fef9227-64ad-4226-b591-fe869e9e5f7c-kube-api-access-7lggj" (OuterVolumeSpecName: "kube-api-access-7lggj") pod "6fef9227-64ad-4226-b591-fe869e9e5f7c" (UID: "6fef9227-64ad-4226-b591-fe869e9e5f7c"). InnerVolumeSpecName "kube-api-access-7lggj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:11:14.331153 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.331071 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6fef9227-64ad-4226-b591-fe869e9e5f7c" (UID: "6fef9227-64ad-4226-b591-fe869e9e5f7c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:11:14.368160 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.368083 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-62crl" Jul 20 16:11:14.429739 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.429707 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-config\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:14.429739 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.429731 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-oauth-config\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:14.429739 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.429741 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6fef9227-64ad-4226-b591-fe869e9e5f7c-console-serving-cert\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:14.429739 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.429750 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lggj\" (UniqueName: \"kubernetes.io/projected/6fef9227-64ad-4226-b591-fe869e9e5f7c-kube-api-access-7lggj\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:14.430080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.429760 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-service-ca\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:14.430080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.429768 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6fef9227-64ad-4226-b591-fe869e9e5f7c-oauth-serving-cert\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:14.571046 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.571017 2569 generic.go:356] "Generic (PLEG): container finished" podID="6fef9227-64ad-4226-b591-fe869e9e5f7c" containerID="41b68709a5ee551e9540564f5a107784e0b24ac85a0a38698e4c30d89767de49" exitCode=0 Jul 20 16:11:14.571415 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.571068 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f79857d9-7pvck" Jul 20 16:11:14.571415 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.571099 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f79857d9-7pvck" event={"ID":"6fef9227-64ad-4226-b591-fe869e9e5f7c","Type":"ContainerDied","Data":"41b68709a5ee551e9540564f5a107784e0b24ac85a0a38698e4c30d89767de49"} Jul 20 16:11:14.571415 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.571150 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f79857d9-7pvck" event={"ID":"6fef9227-64ad-4226-b591-fe869e9e5f7c","Type":"ContainerDied","Data":"5aa1de25242bab96af3a0f7675f5f975d708f4e86dd55a69b0ceb31f385fd0d5"} Jul 20 16:11:14.571415 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.571178 2569 scope.go:117] "RemoveContainer" containerID="41b68709a5ee551e9540564f5a107784e0b24ac85a0a38698e4c30d89767de49" Jul 20 16:11:14.580199 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.580185 2569 scope.go:117] "RemoveContainer" containerID="41b68709a5ee551e9540564f5a107784e0b24ac85a0a38698e4c30d89767de49" Jul 20 16:11:14.580515 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:11:14.580496 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41b68709a5ee551e9540564f5a107784e0b24ac85a0a38698e4c30d89767de49\": container with ID starting with 41b68709a5ee551e9540564f5a107784e0b24ac85a0a38698e4c30d89767de49 not found: ID does not exist" containerID="41b68709a5ee551e9540564f5a107784e0b24ac85a0a38698e4c30d89767de49" Jul 20 16:11:14.580585 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.580529 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41b68709a5ee551e9540564f5a107784e0b24ac85a0a38698e4c30d89767de49"} err="failed to get container status \"41b68709a5ee551e9540564f5a107784e0b24ac85a0a38698e4c30d89767de49\": rpc error: code = NotFound desc = could not find container \"41b68709a5ee551e9540564f5a107784e0b24ac85a0a38698e4c30d89767de49\": container with ID starting with 41b68709a5ee551e9540564f5a107784e0b24ac85a0a38698e4c30d89767de49 not found: ID does not exist" Jul 20 16:11:14.592891 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.592867 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f79857d9-7pvck"] Jul 20 16:11:14.597516 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:14.597493 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86f79857d9-7pvck"] Jul 20 16:11:16.048427 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:16.046221 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fef9227-64ad-4226-b591-fe869e9e5f7c" path="/var/lib/kubelet/pods/6fef9227-64ad-4226-b591-fe869e9e5f7c/volumes" Jul 20 16:11:16.186667 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:16.186628 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:11:16.245792 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:16.245736 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:11:19.499649 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.499588 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6797868cfc-6f5jq" podUID="d041d916-ed84-49e0-ad8b-ff19d6ebb37d" containerName="console" containerID="cri-o://18b785e68e0a3e9b5efcc9607929591f1f5133ee773b365f8a7aae4d694ac0af" gracePeriod=15 Jul 20 16:11:19.749946 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.749891 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:11:19.778213 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.778184 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-config\") pod \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " Jul 20 16:11:19.778213 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.778217 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-service-ca\") pod \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " Jul 20 16:11:19.778402 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.778256 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r5xg\" (UniqueName: \"kubernetes.io/projected/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-kube-api-access-2r5xg\") pod \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " Jul 20 16:11:19.778402 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.778289 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-trusted-ca-bundle\") pod \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " Jul 20 16:11:19.778402 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.778358 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-serving-cert\") pod \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " Jul 20 16:11:19.778402 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.778382 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-oauth-config\") pod \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " Jul 20 16:11:19.778587 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.778419 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-oauth-serving-cert\") pod \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\" (UID: \"d041d916-ed84-49e0-ad8b-ff19d6ebb37d\") " Jul 20 16:11:19.778642 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.778582 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-service-ca" (OuterVolumeSpecName: "service-ca") pod "d041d916-ed84-49e0-ad8b-ff19d6ebb37d" (UID: "d041d916-ed84-49e0-ad8b-ff19d6ebb37d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:11:19.778704 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.778693 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-service-ca\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:19.778960 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.778929 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d041d916-ed84-49e0-ad8b-ff19d6ebb37d" (UID: "d041d916-ed84-49e0-ad8b-ff19d6ebb37d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:11:19.778960 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.778949 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-config" (OuterVolumeSpecName: "console-config") pod "d041d916-ed84-49e0-ad8b-ff19d6ebb37d" (UID: "d041d916-ed84-49e0-ad8b-ff19d6ebb37d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:11:19.779128 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.779049 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d041d916-ed84-49e0-ad8b-ff19d6ebb37d" (UID: "d041d916-ed84-49e0-ad8b-ff19d6ebb37d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:11:19.780636 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.780615 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d041d916-ed84-49e0-ad8b-ff19d6ebb37d" (UID: "d041d916-ed84-49e0-ad8b-ff19d6ebb37d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:11:19.780720 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.780634 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d041d916-ed84-49e0-ad8b-ff19d6ebb37d" (UID: "d041d916-ed84-49e0-ad8b-ff19d6ebb37d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:11:19.780831 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.780814 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-kube-api-access-2r5xg" (OuterVolumeSpecName: "kube-api-access-2r5xg") pod "d041d916-ed84-49e0-ad8b-ff19d6ebb37d" (UID: "d041d916-ed84-49e0-ad8b-ff19d6ebb37d"). InnerVolumeSpecName "kube-api-access-2r5xg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:11:19.879167 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.879114 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-serving-cert\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:19.879167 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.879159 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-oauth-config\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:19.879167 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.879173 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-oauth-serving-cert\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:19.879465 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.879185 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-console-config\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:19.879465 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.879198 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r5xg\" (UniqueName: \"kubernetes.io/projected/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-kube-api-access-2r5xg\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:19.879465 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:19.879209 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d041d916-ed84-49e0-ad8b-ff19d6ebb37d-trusted-ca-bundle\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:20.598639 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:20.598602 2569 generic.go:356] "Generic (PLEG): container finished" podID="d041d916-ed84-49e0-ad8b-ff19d6ebb37d" containerID="18b785e68e0a3e9b5efcc9607929591f1f5133ee773b365f8a7aae4d694ac0af" exitCode=0 Jul 20 16:11:20.599079 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:20.598648 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6797868cfc-6f5jq" event={"ID":"d041d916-ed84-49e0-ad8b-ff19d6ebb37d","Type":"ContainerDied","Data":"18b785e68e0a3e9b5efcc9607929591f1f5133ee773b365f8a7aae4d694ac0af"} Jul 20 16:11:20.599079 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:20.598688 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6797868cfc-6f5jq" event={"ID":"d041d916-ed84-49e0-ad8b-ff19d6ebb37d","Type":"ContainerDied","Data":"03ca3dc75e4e2a9f4ba7dbab380553d467651dffa8a26a754feca4df47023b77"} Jul 20 16:11:20.599079 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:20.598707 2569 scope.go:117] "RemoveContainer" containerID="18b785e68e0a3e9b5efcc9607929591f1f5133ee773b365f8a7aae4d694ac0af" Jul 20 16:11:20.599079 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:20.598653 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6797868cfc-6f5jq" Jul 20 16:11:20.609166 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:20.609149 2569 scope.go:117] "RemoveContainer" containerID="18b785e68e0a3e9b5efcc9607929591f1f5133ee773b365f8a7aae4d694ac0af" Jul 20 16:11:20.609466 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:11:20.609446 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18b785e68e0a3e9b5efcc9607929591f1f5133ee773b365f8a7aae4d694ac0af\": container with ID starting with 18b785e68e0a3e9b5efcc9607929591f1f5133ee773b365f8a7aae4d694ac0af not found: ID does not exist" containerID="18b785e68e0a3e9b5efcc9607929591f1f5133ee773b365f8a7aae4d694ac0af" Jul 20 16:11:20.609518 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:20.609474 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18b785e68e0a3e9b5efcc9607929591f1f5133ee773b365f8a7aae4d694ac0af"} err="failed to get container status \"18b785e68e0a3e9b5efcc9607929591f1f5133ee773b365f8a7aae4d694ac0af\": rpc error: code = NotFound desc = could not find container \"18b785e68e0a3e9b5efcc9607929591f1f5133ee773b365f8a7aae4d694ac0af\": container with ID starting with 18b785e68e0a3e9b5efcc9607929591f1f5133ee773b365f8a7aae4d694ac0af not found: ID does not exist" Jul 20 16:11:20.617974 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:20.617950 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6797868cfc-6f5jq"] Jul 20 16:11:20.621601 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:20.621580 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6797868cfc-6f5jq"] Jul 20 16:11:22.044546 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:22.044516 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d041d916-ed84-49e0-ad8b-ff19d6ebb37d" path="/var/lib/kubelet/pods/d041d916-ed84-49e0-ad8b-ff19d6ebb37d/volumes" Jul 20 16:11:27.223431 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:27.223404 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:11:27.277087 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:27.277054 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:11:30.121698 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.121653 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bc96cd8c4-964rr" podUID="bdc37ebd-886e-4b76-a71f-a67c0cbe05e2" containerName="console" containerID="cri-o://01da4e69028e345ebfa0396494a7b8d0b7110f0ed48915441452414392c0165f" gracePeriod=15 Jul 20 16:11:30.180406 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.180374 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:11:30.185656 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.185622 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-64b98f67c8-8x5pg" Jul 20 16:11:30.398281 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.398250 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:11:30.481647 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.481609 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbqtc\" (UniqueName: \"kubernetes.io/projected/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-kube-api-access-gbqtc\") pod \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " Jul 20 16:11:30.481818 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.481658 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-trusted-ca-bundle\") pod \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " Jul 20 16:11:30.481818 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.481698 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-oauth-serving-cert\") pod \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " Jul 20 16:11:30.481998 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.481824 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-oauth-config\") pod \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " Jul 20 16:11:30.481998 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.481860 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-service-ca\") pod \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " Jul 20 16:11:30.481998 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.481955 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-serving-cert\") pod \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " Jul 20 16:11:30.482163 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.482001 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-config\") pod \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\" (UID: \"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2\") " Jul 20 16:11:30.482163 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.482032 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bdc37ebd-886e-4b76-a71f-a67c0cbe05e2" (UID: "bdc37ebd-886e-4b76-a71f-a67c0cbe05e2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:11:30.482163 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.482047 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bdc37ebd-886e-4b76-a71f-a67c0cbe05e2" (UID: "bdc37ebd-886e-4b76-a71f-a67c0cbe05e2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:11:30.482364 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.482304 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-service-ca" (OuterVolumeSpecName: "service-ca") pod "bdc37ebd-886e-4b76-a71f-a67c0cbe05e2" (UID: "bdc37ebd-886e-4b76-a71f-a67c0cbe05e2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:11:30.482463 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.482359 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-trusted-ca-bundle\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:30.482463 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.482379 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-oauth-serving-cert\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:30.482635 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.482592 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-config" (OuterVolumeSpecName: "console-config") pod "bdc37ebd-886e-4b76-a71f-a67c0cbe05e2" (UID: "bdc37ebd-886e-4b76-a71f-a67c0cbe05e2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:11:30.484158 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.484136 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bdc37ebd-886e-4b76-a71f-a67c0cbe05e2" (UID: "bdc37ebd-886e-4b76-a71f-a67c0cbe05e2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:11:30.484392 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.484366 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bdc37ebd-886e-4b76-a71f-a67c0cbe05e2" (UID: "bdc37ebd-886e-4b76-a71f-a67c0cbe05e2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:11:30.484392 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.484375 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-kube-api-access-gbqtc" (OuterVolumeSpecName: "kube-api-access-gbqtc") pod "bdc37ebd-886e-4b76-a71f-a67c0cbe05e2" (UID: "bdc37ebd-886e-4b76-a71f-a67c0cbe05e2"). InnerVolumeSpecName "kube-api-access-gbqtc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:11:30.583723 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.583679 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-serving-cert\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:30.583723 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.583722 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-config\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:30.583998 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.583741 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbqtc\" (UniqueName: \"kubernetes.io/projected/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-kube-api-access-gbqtc\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:30.583998 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.583758 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-console-oauth-config\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:30.583998 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.583773 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2-service-ca\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:11:30.648966 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.648864 2569 generic.go:356] "Generic (PLEG): container finished" podID="bdc37ebd-886e-4b76-a71f-a67c0cbe05e2" containerID="01da4e69028e345ebfa0396494a7b8d0b7110f0ed48915441452414392c0165f" exitCode=0 Jul 20 16:11:30.648966 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.648928 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc96cd8c4-964rr" event={"ID":"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2","Type":"ContainerDied","Data":"01da4e69028e345ebfa0396494a7b8d0b7110f0ed48915441452414392c0165f"} Jul 20 16:11:30.649194 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.649010 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bc96cd8c4-964rr" event={"ID":"bdc37ebd-886e-4b76-a71f-a67c0cbe05e2","Type":"ContainerDied","Data":"da3f5485eee6db26dd0ab9429403946948a664caf04fc5f0d541c8aa73e17c2b"} Jul 20 16:11:30.649194 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.649041 2569 scope.go:117] "RemoveContainer" containerID="01da4e69028e345ebfa0396494a7b8d0b7110f0ed48915441452414392c0165f" Jul 20 16:11:30.649330 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.649192 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bc96cd8c4-964rr" Jul 20 16:11:30.659032 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.659014 2569 scope.go:117] "RemoveContainer" containerID="01da4e69028e345ebfa0396494a7b8d0b7110f0ed48915441452414392c0165f" Jul 20 16:11:30.659318 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:11:30.659296 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01da4e69028e345ebfa0396494a7b8d0b7110f0ed48915441452414392c0165f\": container with ID starting with 01da4e69028e345ebfa0396494a7b8d0b7110f0ed48915441452414392c0165f not found: ID does not exist" containerID="01da4e69028e345ebfa0396494a7b8d0b7110f0ed48915441452414392c0165f" Jul 20 16:11:30.659390 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.659328 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01da4e69028e345ebfa0396494a7b8d0b7110f0ed48915441452414392c0165f"} err="failed to get container status \"01da4e69028e345ebfa0396494a7b8d0b7110f0ed48915441452414392c0165f\": rpc error: code = NotFound desc = could not find container \"01da4e69028e345ebfa0396494a7b8d0b7110f0ed48915441452414392c0165f\": container with ID starting with 01da4e69028e345ebfa0396494a7b8d0b7110f0ed48915441452414392c0165f not found: ID does not exist" Jul 20 16:11:30.670950 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.670922 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bc96cd8c4-964rr"] Jul 20 16:11:30.674647 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:30.674624 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bc96cd8c4-964rr"] Jul 20 16:11:32.043664 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:32.043635 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdc37ebd-886e-4b76-a71f-a67c0cbe05e2" path="/var/lib/kubelet/pods/bdc37ebd-886e-4b76-a71f-a67c0cbe05e2/volumes" Jul 20 16:11:51.956710 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:51.956670 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:11:51.976370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:51.976345 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:11:52.753382 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:11:52.753360 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:01.476758 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:01.476719 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:12:01.605084 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:01.605052 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:12:04.831274 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:04.831240 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:12:05.080425 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:05.080381 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:12:05.746919 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:05.746884 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:12:05.747189 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:05.747166 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="alertmanager" containerID="cri-o://c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c" gracePeriod=120 Jul 20 16:12:05.747275 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:05.747222 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="kube-rbac-proxy-metric" containerID="cri-o://78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206" gracePeriod=120 Jul 20 16:12:05.747275 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:05.747260 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="kube-rbac-proxy" containerID="cri-o://c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4" gracePeriod=120 Jul 20 16:12:05.747384 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:05.747264 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="kube-rbac-proxy-web" containerID="cri-o://648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0" gracePeriod=120 Jul 20 16:12:05.747384 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:05.747325 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="prom-label-proxy" containerID="cri-o://98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7" gracePeriod=120 Jul 20 16:12:05.747473 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:05.747321 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="config-reloader" containerID="cri-o://1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c" gracePeriod=120 Jul 20 16:12:06.797757 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:06.797723 2569 generic.go:356] "Generic (PLEG): container finished" podID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerID="98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7" exitCode=0 Jul 20 16:12:06.797757 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:06.797750 2569 generic.go:356] "Generic (PLEG): container finished" podID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerID="c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4" exitCode=0 Jul 20 16:12:06.797757 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:06.797756 2569 generic.go:356] "Generic (PLEG): container finished" podID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerID="1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c" exitCode=0 Jul 20 16:12:06.797757 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:06.797761 2569 generic.go:356] "Generic (PLEG): container finished" podID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerID="c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c" exitCode=0 Jul 20 16:12:06.798379 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:06.797794 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4952e8c6-ad49-4d28-a266-a7a6e879ac30","Type":"ContainerDied","Data":"98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7"} Jul 20 16:12:06.798379 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:06.797881 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4952e8c6-ad49-4d28-a266-a7a6e879ac30","Type":"ContainerDied","Data":"c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4"} Jul 20 16:12:06.798379 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:06.797909 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4952e8c6-ad49-4d28-a266-a7a6e879ac30","Type":"ContainerDied","Data":"1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c"} Jul 20 16:12:06.798379 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:06.797934 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4952e8c6-ad49-4d28-a266-a7a6e879ac30","Type":"ContainerDied","Data":"c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c"} Jul 20 16:12:06.991202 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:06.991168 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:07.093706 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.093618 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-cluster-tls-config\") pod \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " Jul 20 16:12:07.093706 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.093665 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f2kw\" (UniqueName: \"kubernetes.io/projected/4952e8c6-ad49-4d28-a266-a7a6e879ac30-kube-api-access-5f2kw\") pod \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " Jul 20 16:12:07.093706 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.093699 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4952e8c6-ad49-4d28-a266-a7a6e879ac30-alertmanager-trusted-ca-bundle\") pod \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " Jul 20 16:12:07.093976 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.093726 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-config-volume\") pod \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " Jul 20 16:12:07.093976 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.093767 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4952e8c6-ad49-4d28-a266-a7a6e879ac30-alertmanager-main-db\") pod \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " Jul 20 16:12:07.093976 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.093792 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4952e8c6-ad49-4d28-a266-a7a6e879ac30-metrics-client-ca\") pod \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " Jul 20 16:12:07.094282 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.094159 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4952e8c6-ad49-4d28-a266-a7a6e879ac30-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4952e8c6-ad49-4d28-a266-a7a6e879ac30" (UID: "4952e8c6-ad49-4d28-a266-a7a6e879ac30"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:12:07.094282 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.094194 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4952e8c6-ad49-4d28-a266-a7a6e879ac30-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4952e8c6-ad49-4d28-a266-a7a6e879ac30" (UID: "4952e8c6-ad49-4d28-a266-a7a6e879ac30"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:12:07.094282 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.094171 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4952e8c6-ad49-4d28-a266-a7a6e879ac30-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4952e8c6-ad49-4d28-a266-a7a6e879ac30" (UID: "4952e8c6-ad49-4d28-a266-a7a6e879ac30"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:12:07.094526 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.094430 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " Jul 20 16:12:07.094526 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.094464 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-web-config\") pod \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " Jul 20 16:12:07.094526 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.094497 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy-web\") pod \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " Jul 20 16:12:07.094699 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.094530 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4952e8c6-ad49-4d28-a266-a7a6e879ac30-tls-assets\") pod \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " Jul 20 16:12:07.094699 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.094584 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy\") pod \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " Jul 20 16:12:07.094699 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.094614 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-main-tls\") pod \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " Jul 20 16:12:07.094699 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.094646 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4952e8c6-ad49-4d28-a266-a7a6e879ac30-config-out\") pod \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\" (UID: \"4952e8c6-ad49-4d28-a266-a7a6e879ac30\") " Jul 20 16:12:07.094940 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.094917 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4952e8c6-ad49-4d28-a266-a7a6e879ac30-alertmanager-main-db\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:07.094999 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.094946 2569 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4952e8c6-ad49-4d28-a266-a7a6e879ac30-metrics-client-ca\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:07.094999 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.094962 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4952e8c6-ad49-4d28-a266-a7a6e879ac30-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:07.096434 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.096399 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4952e8c6-ad49-4d28-a266-a7a6e879ac30-kube-api-access-5f2kw" (OuterVolumeSpecName: "kube-api-access-5f2kw") pod "4952e8c6-ad49-4d28-a266-a7a6e879ac30" (UID: "4952e8c6-ad49-4d28-a266-a7a6e879ac30"). InnerVolumeSpecName "kube-api-access-5f2kw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:12:07.097353 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.097117 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-config-volume" (OuterVolumeSpecName: "config-volume") pod "4952e8c6-ad49-4d28-a266-a7a6e879ac30" (UID: "4952e8c6-ad49-4d28-a266-a7a6e879ac30"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:12:07.097353 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.097299 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4952e8c6-ad49-4d28-a266-a7a6e879ac30" (UID: "4952e8c6-ad49-4d28-a266-a7a6e879ac30"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:12:07.097353 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.097318 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4952e8c6-ad49-4d28-a266-a7a6e879ac30" (UID: "4952e8c6-ad49-4d28-a266-a7a6e879ac30"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:12:07.097577 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.097406 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4952e8c6-ad49-4d28-a266-a7a6e879ac30-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4952e8c6-ad49-4d28-a266-a7a6e879ac30" (UID: "4952e8c6-ad49-4d28-a266-a7a6e879ac30"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:12:07.097577 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.097446 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4952e8c6-ad49-4d28-a266-a7a6e879ac30-config-out" (OuterVolumeSpecName: "config-out") pod "4952e8c6-ad49-4d28-a266-a7a6e879ac30" (UID: "4952e8c6-ad49-4d28-a266-a7a6e879ac30"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:12:07.098323 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.098299 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4952e8c6-ad49-4d28-a266-a7a6e879ac30" (UID: "4952e8c6-ad49-4d28-a266-a7a6e879ac30"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:12:07.098791 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.098768 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4952e8c6-ad49-4d28-a266-a7a6e879ac30" (UID: "4952e8c6-ad49-4d28-a266-a7a6e879ac30"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:12:07.102002 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.101980 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4952e8c6-ad49-4d28-a266-a7a6e879ac30" (UID: "4952e8c6-ad49-4d28-a266-a7a6e879ac30"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:12:07.108346 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.108323 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-web-config" (OuterVolumeSpecName: "web-config") pod "4952e8c6-ad49-4d28-a266-a7a6e879ac30" (UID: "4952e8c6-ad49-4d28-a266-a7a6e879ac30"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:12:07.196007 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.195980 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:07.196007 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.196006 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-main-tls\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:07.196166 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.196017 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4952e8c6-ad49-4d28-a266-a7a6e879ac30-config-out\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:07.196166 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.196027 2569 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-cluster-tls-config\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:07.196166 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.196036 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f2kw\" (UniqueName: \"kubernetes.io/projected/4952e8c6-ad49-4d28-a266-a7a6e879ac30-kube-api-access-5f2kw\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:07.196166 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.196043 2569 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-config-volume\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:07.196166 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.196051 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:07.196166 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.196060 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-web-config\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:07.196166 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.196069 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4952e8c6-ad49-4d28-a266-a7a6e879ac30-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:07.196166 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.196076 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4952e8c6-ad49-4d28-a266-a7a6e879ac30-tls-assets\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:07.805419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.805389 2569 generic.go:356] "Generic (PLEG): container finished" podID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerID="78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206" exitCode=0 Jul 20 16:12:07.805419 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.805413 2569 generic.go:356] "Generic (PLEG): container finished" podID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerID="648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0" exitCode=0 Jul 20 16:12:07.805827 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.805438 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4952e8c6-ad49-4d28-a266-a7a6e879ac30","Type":"ContainerDied","Data":"78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206"} Jul 20 16:12:07.805827 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.805476 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:07.805827 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.805513 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4952e8c6-ad49-4d28-a266-a7a6e879ac30","Type":"ContainerDied","Data":"648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0"} Jul 20 16:12:07.805827 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.805540 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4952e8c6-ad49-4d28-a266-a7a6e879ac30","Type":"ContainerDied","Data":"3b84ca0d94422fbddec0f9c45c17c01db207b59d3f0ae35ba8988d3bb7455731"} Jul 20 16:12:07.805827 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.805567 2569 scope.go:117] "RemoveContainer" containerID="98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7" Jul 20 16:12:07.816876 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.816858 2569 scope.go:117] "RemoveContainer" containerID="78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206" Jul 20 16:12:07.823942 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.823922 2569 scope.go:117] "RemoveContainer" containerID="c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4" Jul 20 16:12:07.830903 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.830880 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:12:07.831880 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.831773 2569 scope.go:117] "RemoveContainer" containerID="648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0" Jul 20 16:12:07.834083 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.834061 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:12:07.839131 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.839115 2569 scope.go:117] "RemoveContainer" containerID="1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c" Jul 20 16:12:07.846060 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.846039 2569 scope.go:117] "RemoveContainer" containerID="c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c" Jul 20 16:12:07.853449 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.853433 2569 scope.go:117] "RemoveContainer" containerID="498f29c5540b86f492f98bc8655de2cf3e15281351f767ecbc2b9f88b4843984" Jul 20 16:12:07.858993 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.858972 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:12:07.859321 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859297 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="kube-rbac-proxy-metric" Jul 20 16:12:07.859321 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859312 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="kube-rbac-proxy-metric" Jul 20 16:12:07.859321 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859324 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="kube-rbac-proxy" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859330 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="kube-rbac-proxy" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859337 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc37ebd-886e-4b76-a71f-a67c0cbe05e2" containerName="console" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859342 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc37ebd-886e-4b76-a71f-a67c0cbe05e2" containerName="console" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859351 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="config-reloader" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859358 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="config-reloader" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859364 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="alertmanager" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859369 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="alertmanager" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859381 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="kube-rbac-proxy-web" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859386 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="kube-rbac-proxy-web" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859395 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="init-config-reloader" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859401 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="init-config-reloader" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859407 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d041d916-ed84-49e0-ad8b-ff19d6ebb37d" containerName="console" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859412 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d041d916-ed84-49e0-ad8b-ff19d6ebb37d" containerName="console" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859420 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fef9227-64ad-4226-b591-fe869e9e5f7c" containerName="console" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859425 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fef9227-64ad-4226-b591-fe869e9e5f7c" containerName="console" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859432 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="prom-label-proxy" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859437 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="prom-label-proxy" Jul 20 16:12:07.859474 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859482 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="kube-rbac-proxy" Jul 20 16:12:07.860314 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859489 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="kube-rbac-proxy-metric" Jul 20 16:12:07.860314 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859496 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="prom-label-proxy" Jul 20 16:12:07.860314 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859502 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="alertmanager" Jul 20 16:12:07.860314 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859509 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fef9227-64ad-4226-b591-fe869e9e5f7c" containerName="console" Jul 20 16:12:07.860314 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859514 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d041d916-ed84-49e0-ad8b-ff19d6ebb37d" containerName="console" Jul 20 16:12:07.860314 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859520 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdc37ebd-886e-4b76-a71f-a67c0cbe05e2" containerName="console" Jul 20 16:12:07.860314 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859525 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="config-reloader" Jul 20 16:12:07.860314 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.859531 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" containerName="kube-rbac-proxy-web" Jul 20 16:12:07.861148 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.860999 2569 scope.go:117] "RemoveContainer" containerID="98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7" Jul 20 16:12:07.861333 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:12:07.861298 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7\": container with ID starting with 98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7 not found: ID does not exist" containerID="98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7" Jul 20 16:12:07.861386 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.861346 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7"} err="failed to get container status \"98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7\": rpc error: code = NotFound desc = could not find container \"98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7\": container with ID starting with 98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7 not found: ID does not exist" Jul 20 16:12:07.861386 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.861370 2569 scope.go:117] "RemoveContainer" containerID="78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206" Jul 20 16:12:07.861639 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:12:07.861614 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206\": container with ID starting with 78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206 not found: ID does not exist" containerID="78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206" Jul 20 16:12:07.861712 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.861646 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206"} err="failed to get container status \"78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206\": rpc error: code = NotFound desc = could not find container \"78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206\": container with ID starting with 78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206 not found: ID does not exist" Jul 20 16:12:07.861712 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.861671 2569 scope.go:117] "RemoveContainer" containerID="c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4" Jul 20 16:12:07.861923 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:12:07.861907 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4\": container with ID starting with c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4 not found: ID does not exist" containerID="c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4" Jul 20 16:12:07.861963 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.861936 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4"} err="failed to get container status \"c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4\": rpc error: code = NotFound desc = could not find container \"c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4\": container with ID starting with c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4 not found: ID does not exist" Jul 20 16:12:07.861963 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.861950 2569 scope.go:117] "RemoveContainer" containerID="648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0" Jul 20 16:12:07.862165 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:12:07.862149 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0\": container with ID starting with 648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0 not found: ID does not exist" containerID="648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0" Jul 20 16:12:07.862206 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.862168 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0"} err="failed to get container status \"648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0\": rpc error: code = NotFound desc = could not find container \"648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0\": container with ID starting with 648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0 not found: ID does not exist" Jul 20 16:12:07.862206 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.862182 2569 scope.go:117] "RemoveContainer" containerID="1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c" Jul 20 16:12:07.862436 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:12:07.862416 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c\": container with ID starting with 1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c not found: ID does not exist" containerID="1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c" Jul 20 16:12:07.862527 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.862442 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c"} err="failed to get container status \"1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c\": rpc error: code = NotFound desc = could not find container \"1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c\": container with ID starting with 1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c not found: ID does not exist" Jul 20 16:12:07.862527 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.862462 2569 scope.go:117] "RemoveContainer" containerID="c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c" Jul 20 16:12:07.862696 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:12:07.862680 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c\": container with ID starting with c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c not found: ID does not exist" containerID="c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c" Jul 20 16:12:07.862753 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.862702 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c"} err="failed to get container status \"c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c\": rpc error: code = NotFound desc = could not find container \"c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c\": container with ID starting with c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c not found: ID does not exist" Jul 20 16:12:07.862753 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.862720 2569 scope.go:117] "RemoveContainer" containerID="498f29c5540b86f492f98bc8655de2cf3e15281351f767ecbc2b9f88b4843984" Jul 20 16:12:07.862949 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:12:07.862931 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"498f29c5540b86f492f98bc8655de2cf3e15281351f767ecbc2b9f88b4843984\": container with ID starting with 498f29c5540b86f492f98bc8655de2cf3e15281351f767ecbc2b9f88b4843984 not found: ID does not exist" containerID="498f29c5540b86f492f98bc8655de2cf3e15281351f767ecbc2b9f88b4843984" Jul 20 16:12:07.862990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.862959 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498f29c5540b86f492f98bc8655de2cf3e15281351f767ecbc2b9f88b4843984"} err="failed to get container status \"498f29c5540b86f492f98bc8655de2cf3e15281351f767ecbc2b9f88b4843984\": rpc error: code = NotFound desc = could not find container \"498f29c5540b86f492f98bc8655de2cf3e15281351f767ecbc2b9f88b4843984\": container with ID starting with 498f29c5540b86f492f98bc8655de2cf3e15281351f767ecbc2b9f88b4843984 not found: ID does not exist" Jul 20 16:12:07.862990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.862976 2569 scope.go:117] "RemoveContainer" containerID="98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7" Jul 20 16:12:07.863202 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.863184 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7"} err="failed to get container status \"98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7\": rpc error: code = NotFound desc = could not find container \"98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7\": container with ID starting with 98a7da8384cb387abc9067bd6ca4cb540151fdc5fed99542a5136b81b4013cf7 not found: ID does not exist" Jul 20 16:12:07.863202 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.863203 2569 scope.go:117] "RemoveContainer" containerID="78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206" Jul 20 16:12:07.863472 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.863451 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206"} err="failed to get container status \"78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206\": rpc error: code = NotFound desc = could not find container \"78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206\": container with ID starting with 78b81b9caf02bb4dea61ff98cfca54b5ba5ab1ff55030bb33612de1845a03206 not found: ID does not exist" Jul 20 16:12:07.863553 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.863473 2569 scope.go:117] "RemoveContainer" containerID="c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4" Jul 20 16:12:07.865524 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.865495 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4"} err="failed to get container status \"c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4\": rpc error: code = NotFound desc = could not find container \"c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4\": container with ID starting with c125319b3699bcb6fdc5e1825ac386093febf82206724147a3e6f848519641e4 not found: ID does not exist" Jul 20 16:12:07.865618 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.865526 2569 scope.go:117] "RemoveContainer" containerID="648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0" Jul 20 16:12:07.865802 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.865781 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0"} err="failed to get container status \"648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0\": rpc error: code = NotFound desc = could not find container \"648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0\": container with ID starting with 648f9f56a6ae61e7a9a00655bf68356c5ca2e17edb58b5d1cbd1a40b66bc97d0 not found: ID does not exist" Jul 20 16:12:07.865802 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.865801 2569 scope.go:117] "RemoveContainer" containerID="1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c" Jul 20 16:12:07.866015 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.865998 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c"} err="failed to get container status \"1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c\": rpc error: code = NotFound desc = could not find container \"1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c\": container with ID starting with 1e49e5eea2a95ea8b3cc81eac0d6b9cd7b4aa707ada9c64a2fd5d73ec5d2878c not found: ID does not exist" Jul 20 16:12:07.866063 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.866015 2569 scope.go:117] "RemoveContainer" containerID="c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c" Jul 20 16:12:07.866214 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.866198 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c"} err="failed to get container status \"c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c\": rpc error: code = NotFound desc = could not find container \"c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c\": container with ID starting with c3d277add4cca5c7f2ed3e642b986468d7dfa04ddba43ee6c6e619e5b0fc376c not found: ID does not exist" Jul 20 16:12:07.866286 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.866213 2569 scope.go:117] "RemoveContainer" containerID="498f29c5540b86f492f98bc8655de2cf3e15281351f767ecbc2b9f88b4843984" Jul 20 16:12:07.866422 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.866407 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498f29c5540b86f492f98bc8655de2cf3e15281351f767ecbc2b9f88b4843984"} err="failed to get container status \"498f29c5540b86f492f98bc8655de2cf3e15281351f767ecbc2b9f88b4843984\": rpc error: code = NotFound desc = could not find container \"498f29c5540b86f492f98bc8655de2cf3e15281351f767ecbc2b9f88b4843984\": container with ID starting with 498f29c5540b86f492f98bc8655de2cf3e15281351f767ecbc2b9f88b4843984 not found: ID does not exist" Jul 20 16:12:07.866929 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.866915 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:07.869763 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.869745 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 20 16:12:07.870010 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.869991 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 20 16:12:07.870089 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.870063 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 20 16:12:07.870147 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.869999 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l2vs4\"" Jul 20 16:12:07.870147 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.870063 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 20 16:12:07.870296 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.870000 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 20 16:12:07.870408 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.870389 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 20 16:12:07.870408 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.870400 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 20 16:12:07.870529 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.870394 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 20 16:12:07.874958 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.874940 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 20 16:12:07.881759 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.881740 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:12:07.900385 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.900357 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stffj\" (UniqueName: \"kubernetes.io/projected/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-kube-api-access-stffj\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:07.900385 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.900395 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-web-config\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:07.900613 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.900419 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:07.900613 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.900435 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-config-out\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:07.900613 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.900528 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:07.900613 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.900560 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:07.900613 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.900604 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-config-volume\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:07.900807 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.900675 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:07.900807 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.900694 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:07.900807 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.900729 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:07.900807 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.900766 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:07.900807 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.900791 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:07.900807 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:07.900806 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.001821 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.001778 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.001821 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.001825 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.002084 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.001880 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.002084 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.001926 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stffj\" (UniqueName: \"kubernetes.io/projected/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-kube-api-access-stffj\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.002084 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.001953 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-web-config\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.002084 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.001979 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.002084 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.001993 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-config-out\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.002084 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.002019 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.002762 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.002733 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.002872 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.002783 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-config-volume\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.002872 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.002846 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.002999 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.002875 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.002999 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.002917 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.002999 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.002974 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.003318 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.003295 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.003921 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.003891 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.004770 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.004748 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-config-out\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.005090 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.005032 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-web-config\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.005188 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.005093 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.005188 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.005150 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.005357 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.005224 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.005357 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.005328 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.006183 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.006161 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-config-volume\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.006421 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.006402 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.006690 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.006673 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.009980 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.009959 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stffj\" (UniqueName: \"kubernetes.io/projected/7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101-kube-api-access-stffj\") pod \"alertmanager-main-0\" (UID: \"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101\") " pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.044115 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.044086 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4952e8c6-ad49-4d28-a266-a7a6e879ac30" path="/var/lib/kubelet/pods/4952e8c6-ad49-4d28-a266-a7a6e879ac30/volumes" Jul 20 16:12:08.175578 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.175549 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 20 16:12:08.316637 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.316604 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 20 16:12:08.319507 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:12:08.319482 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7efd6dbd_1f57_4bc8_93d5_bf3cafcb3101.slice/crio-595541b84a968b58c3b10360ed8d4d5b443091f0bf9c6779a113dd7fe2a6257c WatchSource:0}: Error finding container 595541b84a968b58c3b10360ed8d4d5b443091f0bf9c6779a113dd7fe2a6257c: Status 404 returned error can't find the container with id 595541b84a968b58c3b10360ed8d4d5b443091f0bf9c6779a113dd7fe2a6257c Jul 20 16:12:08.811511 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.811470 2569 generic.go:356] "Generic (PLEG): container finished" podID="7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101" containerID="fc2c743f1e9d9f2fbec657f6bb66162de5411f13c2d7467eba643a639d781889" exitCode=0 Jul 20 16:12:08.811991 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.811515 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101","Type":"ContainerDied","Data":"fc2c743f1e9d9f2fbec657f6bb66162de5411f13c2d7467eba643a639d781889"} Jul 20 16:12:08.811991 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:08.811590 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101","Type":"ContainerStarted","Data":"595541b84a968b58c3b10360ed8d4d5b443091f0bf9c6779a113dd7fe2a6257c"} Jul 20 16:12:09.822873 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:09.822840 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101","Type":"ContainerStarted","Data":"eb6c5e31947b2f13058973d0399008a3eb3759e279a7954063a944f2102088ff"} Jul 20 16:12:09.823351 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:09.822958 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101","Type":"ContainerStarted","Data":"551365c1b4d4a46d353f867aa2f46cdbe1332aef2d6c9095f3ac50088ae5298d"} Jul 20 16:12:09.823351 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:09.823001 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101","Type":"ContainerStarted","Data":"401fe076ebb962add34d7cd90b760e0f7e797d032190f4b8c1ecc72efe078492"} Jul 20 16:12:09.823351 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:09.823057 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101","Type":"ContainerStarted","Data":"8ac600c060f71777fe38ac2a510c9a46049bc06e473d4b9caa0a8324e9af7764"} Jul 20 16:12:09.823840 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:09.823095 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101","Type":"ContainerStarted","Data":"459d764d46d668d1a168de78200480e1df64d7f8d917fd4e6ab2ebc27021172b"} Jul 20 16:12:09.823939 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:09.823887 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101","Type":"ContainerStarted","Data":"088dd6661c6c6ced0c48e11232e6e3fa09b52bb73f9a7ee402dec2c346fb0152"} Jul 20 16:12:09.851796 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:09.851720 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.8381222680000002 podStartE2EDuration="2.851697962s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.575694ms" isStatefulPod=false podCreationTimestamp="2026-07-20 16:12:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:12:09.849809114 +0000 UTC m=+160.399108428" watchObservedRunningTime="2026-07-20 16:12:09.851697962 +0000 UTC m=+160.400997262" Jul 20 16:12:10.011480 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.011438 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 16:12:10.011835 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.011798 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="prometheus" containerID="cri-o://3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642" gracePeriod=600 Jul 20 16:12:10.011962 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.011866 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="kube-rbac-proxy" containerID="cri-o://27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9" gracePeriod=600 Jul 20 16:12:10.011962 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.011916 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="thanos-sidecar" containerID="cri-o://0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf" gracePeriod=600 Jul 20 16:12:10.011962 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.011937 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="kube-rbac-proxy-web" containerID="cri-o://424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6" gracePeriod=600 Jul 20 16:12:10.012098 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.011961 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="config-reloader" containerID="cri-o://ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540" gracePeriod=600 Jul 20 16:12:10.012098 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.012004 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="kube-rbac-proxy-thanos" containerID="cri-o://afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719" gracePeriod=600 Jul 20 16:12:10.264375 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.264346 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.325324 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.325288 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-grpc-tls\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.325324 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.325323 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.325573 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.325359 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-0\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.325573 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.325397 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-kubelet-serving-ca-bundle\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.325788 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.325458 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-config\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.325846 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.325787 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:12:10.325904 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.325844 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-kube-rbac-proxy\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.326029 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326004 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-metrics-client-certs\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.326092 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326049 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67aa069a-cbef-4886-9994-8e81299c9911-config-out\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.326148 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326092 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-2\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.326203 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326143 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-serving-certs-ca-bundle\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.326203 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326183 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-1\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.326323 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326219 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-web-config\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.326323 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326268 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-trusted-ca-bundle\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.326323 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326310 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67aa069a-cbef-4886-9994-8e81299c9911-tls-assets\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.326478 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326335 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-tls\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.326478 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326362 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgct6\" (UniqueName: \"kubernetes.io/projected/67aa069a-cbef-4886-9994-8e81299c9911-kube-api-access-hgct6\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.326478 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326405 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-thanos-prometheus-http-client-file\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.326478 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326430 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-metrics-client-ca\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.326478 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326459 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-db\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.326747 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326497 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"67aa069a-cbef-4886-9994-8e81299c9911\" (UID: \"67aa069a-cbef-4886-9994-8e81299c9911\") " Jul 20 16:12:10.326747 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326589 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:12:10.326875 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326828 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.326875 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.326849 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.327164 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.327136 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:12:10.327853 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.327820 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:12:10.329112 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.328551 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-config" (OuterVolumeSpecName: "config") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:12:10.329112 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.328904 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:12:10.329679 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.329429 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:12:10.329679 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.329575 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:12:10.330008 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.329983 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:12:10.331517 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.331476 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:12:10.331602 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.331587 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:12:10.331956 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.331911 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67aa069a-cbef-4886-9994-8e81299c9911-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:12:10.331956 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.331933 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67aa069a-cbef-4886-9994-8e81299c9911-kube-api-access-hgct6" (OuterVolumeSpecName: "kube-api-access-hgct6") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "kube-api-access-hgct6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:12:10.332143 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.332113 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67aa069a-cbef-4886-9994-8e81299c9911-config-out" (OuterVolumeSpecName: "config-out") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:12:10.332209 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.332154 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:12:10.332999 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.332969 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:12:10.333330 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.333304 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:12:10.333838 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.333811 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:12:10.334053 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.334034 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:12:10.343337 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.343272 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-web-config" (OuterVolumeSpecName: "web-config") pod "67aa069a-cbef-4886-9994-8e81299c9911" (UID: "67aa069a-cbef-4886-9994-8e81299c9911"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:12:10.427876 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.427844 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-web-config\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.427876 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.427871 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.427876 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.427883 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67aa069a-cbef-4886-9994-8e81299c9911-tls-assets\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.428118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.427893 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.428118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.427902 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgct6\" (UniqueName: \"kubernetes.io/projected/67aa069a-cbef-4886-9994-8e81299c9911-kube-api-access-hgct6\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.428118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.427912 2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.428118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.427920 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-configmap-metrics-client-ca\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.428118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.427929 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-db\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.428118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.427937 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.428118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.427945 2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-grpc-tls\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.428118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.427954 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.428118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.427962 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.428118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.427970 2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-config\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.428118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.427978 2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-kube-rbac-proxy\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.428118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.427986 2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/67aa069a-cbef-4886-9994-8e81299c9911-secret-metrics-client-certs\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.428118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.427994 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67aa069a-cbef-4886-9994-8e81299c9911-config-out\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.428118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.428002 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.428118 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.428011 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/67aa069a-cbef-4886-9994-8e81299c9911-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:12:10.835985 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.835949 2569 generic.go:356] "Generic (PLEG): container finished" podID="67aa069a-cbef-4886-9994-8e81299c9911" containerID="afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719" exitCode=0 Jul 20 16:12:10.835985 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.835975 2569 generic.go:356] "Generic (PLEG): container finished" podID="67aa069a-cbef-4886-9994-8e81299c9911" containerID="27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9" exitCode=0 Jul 20 16:12:10.835985 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.835981 2569 generic.go:356] "Generic (PLEG): container finished" podID="67aa069a-cbef-4886-9994-8e81299c9911" containerID="424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6" exitCode=0 Jul 20 16:12:10.835985 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.835987 2569 generic.go:356] "Generic (PLEG): container finished" podID="67aa069a-cbef-4886-9994-8e81299c9911" containerID="0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf" exitCode=0 Jul 20 16:12:10.835985 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.835992 2569 generic.go:356] "Generic (PLEG): container finished" podID="67aa069a-cbef-4886-9994-8e81299c9911" containerID="ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540" exitCode=0 Jul 20 16:12:10.835985 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.835996 2569 generic.go:356] "Generic (PLEG): container finished" podID="67aa069a-cbef-4886-9994-8e81299c9911" containerID="3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642" exitCode=0 Jul 20 16:12:10.836703 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.836034 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.836703 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.836044 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67aa069a-cbef-4886-9994-8e81299c9911","Type":"ContainerDied","Data":"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719"} Jul 20 16:12:10.836703 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.836172 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67aa069a-cbef-4886-9994-8e81299c9911","Type":"ContainerDied","Data":"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9"} Jul 20 16:12:10.836703 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.836216 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67aa069a-cbef-4886-9994-8e81299c9911","Type":"ContainerDied","Data":"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6"} Jul 20 16:12:10.836703 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.836248 2569 scope.go:117] "RemoveContainer" containerID="afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719" Jul 20 16:12:10.836703 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.836272 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67aa069a-cbef-4886-9994-8e81299c9911","Type":"ContainerDied","Data":"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf"} Jul 20 16:12:10.836703 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.836315 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67aa069a-cbef-4886-9994-8e81299c9911","Type":"ContainerDied","Data":"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540"} Jul 20 16:12:10.836703 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.836353 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67aa069a-cbef-4886-9994-8e81299c9911","Type":"ContainerDied","Data":"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642"} Jul 20 16:12:10.836703 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.836388 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67aa069a-cbef-4886-9994-8e81299c9911","Type":"ContainerDied","Data":"ad8c98c14d39d3fde86b30f861657e973932e5c4559e93c08f915b45ed7c771c"} Jul 20 16:12:10.844351 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.844195 2569 scope.go:117] "RemoveContainer" containerID="27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9" Jul 20 16:12:10.851951 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.851934 2569 scope.go:117] "RemoveContainer" containerID="424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6" Jul 20 16:12:10.859556 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.859531 2569 scope.go:117] "RemoveContainer" containerID="0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf" Jul 20 16:12:10.861467 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.861444 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 16:12:10.864975 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.864954 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 16:12:10.867559 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.867544 2569 scope.go:117] "RemoveContainer" containerID="ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540" Jul 20 16:12:10.874886 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.874869 2569 scope.go:117] "RemoveContainer" containerID="3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642" Jul 20 16:12:10.882912 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.882891 2569 scope.go:117] "RemoveContainer" containerID="d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a" Jul 20 16:12:10.889980 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.889953 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 16:12:10.890308 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890295 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="init-config-reloader" Jul 20 16:12:10.890352 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890311 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="init-config-reloader" Jul 20 16:12:10.890352 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890325 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="thanos-sidecar" Jul 20 16:12:10.890352 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890330 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="thanos-sidecar" Jul 20 16:12:10.890352 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890338 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="kube-rbac-proxy" Jul 20 16:12:10.890352 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890343 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="kube-rbac-proxy" Jul 20 16:12:10.890352 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890352 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="kube-rbac-proxy-web" Jul 20 16:12:10.890535 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890358 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="kube-rbac-proxy-web" Jul 20 16:12:10.890535 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890374 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="prometheus" Jul 20 16:12:10.890535 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890382 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="prometheus" Jul 20 16:12:10.890535 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890387 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="config-reloader" Jul 20 16:12:10.890535 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890392 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="config-reloader" Jul 20 16:12:10.890535 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890403 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="kube-rbac-proxy-thanos" Jul 20 16:12:10.890535 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890408 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="kube-rbac-proxy-thanos" Jul 20 16:12:10.890535 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890454 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="config-reloader" Jul 20 16:12:10.890535 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890465 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="kube-rbac-proxy-thanos" Jul 20 16:12:10.890535 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890473 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="thanos-sidecar" Jul 20 16:12:10.890535 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890478 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="kube-rbac-proxy-web" Jul 20 16:12:10.890535 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890487 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="prometheus" Jul 20 16:12:10.890535 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.890492 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="67aa069a-cbef-4886-9994-8e81299c9911" containerName="kube-rbac-proxy" Jul 20 16:12:10.891130 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.891111 2569 scope.go:117] "RemoveContainer" containerID="afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719" Jul 20 16:12:10.891456 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:12:10.891435 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719\": container with ID starting with afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719 not found: ID does not exist" containerID="afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719" Jul 20 16:12:10.891536 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.891470 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719"} err="failed to get container status \"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719\": rpc error: code = NotFound desc = could not find container \"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719\": container with ID starting with afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719 not found: ID does not exist" Jul 20 16:12:10.891536 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.891497 2569 scope.go:117] "RemoveContainer" containerID="27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9" Jul 20 16:12:10.891756 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:12:10.891741 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9\": container with ID starting with 27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9 not found: ID does not exist" containerID="27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9" Jul 20 16:12:10.891820 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.891764 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9"} err="failed to get container status \"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9\": rpc error: code = NotFound desc = could not find container \"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9\": container with ID starting with 27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9 not found: ID does not exist" Jul 20 16:12:10.891820 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.891784 2569 scope.go:117] "RemoveContainer" containerID="424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6" Jul 20 16:12:10.892090 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:12:10.892073 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6\": container with ID starting with 424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6 not found: ID does not exist" containerID="424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6" Jul 20 16:12:10.892133 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.892096 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6"} err="failed to get container status \"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6\": rpc error: code = NotFound desc = could not find container \"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6\": container with ID starting with 424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6 not found: ID does not exist" Jul 20 16:12:10.892133 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.892110 2569 scope.go:117] "RemoveContainer" containerID="0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf" Jul 20 16:12:10.892365 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:12:10.892348 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf\": container with ID starting with 0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf not found: ID does not exist" containerID="0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf" Jul 20 16:12:10.892423 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.892369 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf"} err="failed to get container status \"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf\": rpc error: code = NotFound desc = could not find container \"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf\": container with ID starting with 0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf not found: ID does not exist" Jul 20 16:12:10.892423 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.892382 2569 scope.go:117] "RemoveContainer" containerID="ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540" Jul 20 16:12:10.892588 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:12:10.892567 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540\": container with ID starting with ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540 not found: ID does not exist" containerID="ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540" Jul 20 16:12:10.892645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.892596 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540"} err="failed to get container status \"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540\": rpc error: code = NotFound desc = could not find container \"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540\": container with ID starting with ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540 not found: ID does not exist" Jul 20 16:12:10.892645 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.892618 2569 scope.go:117] "RemoveContainer" containerID="3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642" Jul 20 16:12:10.892893 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:12:10.892870 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642\": container with ID starting with 3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642 not found: ID does not exist" containerID="3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642" Jul 20 16:12:10.893004 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.892897 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642"} err="failed to get container status \"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642\": rpc error: code = NotFound desc = could not find container \"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642\": container with ID starting with 3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642 not found: ID does not exist" Jul 20 16:12:10.893004 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.892917 2569 scope.go:117] "RemoveContainer" containerID="d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a" Jul 20 16:12:10.893283 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:12:10.893261 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a\": container with ID starting with d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a not found: ID does not exist" containerID="d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a" Jul 20 16:12:10.893379 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.893288 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a"} err="failed to get container status \"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a\": rpc error: code = NotFound desc = could not find container \"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a\": container with ID starting with d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a not found: ID does not exist" Jul 20 16:12:10.893379 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.893302 2569 scope.go:117] "RemoveContainer" containerID="afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719" Jul 20 16:12:10.893609 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.893572 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719"} err="failed to get container status \"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719\": rpc error: code = NotFound desc = could not find container \"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719\": container with ID starting with afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719 not found: ID does not exist" Jul 20 16:12:10.893694 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.893611 2569 scope.go:117] "RemoveContainer" containerID="27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9" Jul 20 16:12:10.893857 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.893839 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9"} err="failed to get container status \"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9\": rpc error: code = NotFound desc = could not find container \"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9\": container with ID starting with 27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9 not found: ID does not exist" Jul 20 16:12:10.893901 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.893857 2569 scope.go:117] "RemoveContainer" containerID="424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6" Jul 20 16:12:10.894111 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.894086 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6"} err="failed to get container status \"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6\": rpc error: code = NotFound desc = could not find container \"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6\": container with ID starting with 424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6 not found: ID does not exist" Jul 20 16:12:10.894185 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.894112 2569 scope.go:117] "RemoveContainer" containerID="0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf" Jul 20 16:12:10.894405 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.894383 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf"} err="failed to get container status \"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf\": rpc error: code = NotFound desc = could not find container \"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf\": container with ID starting with 0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf not found: ID does not exist" Jul 20 16:12:10.894405 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.894405 2569 scope.go:117] "RemoveContainer" containerID="ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540" Jul 20 16:12:10.894669 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.894647 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540"} err="failed to get container status \"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540\": rpc error: code = NotFound desc = could not find container \"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540\": container with ID starting with ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540 not found: ID does not exist" Jul 20 16:12:10.894669 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.894667 2569 scope.go:117] "RemoveContainer" containerID="3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642" Jul 20 16:12:10.894952 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.894930 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642"} err="failed to get container status \"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642\": rpc error: code = NotFound desc = could not find container \"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642\": container with ID starting with 3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642 not found: ID does not exist" Jul 20 16:12:10.895007 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.894953 2569 scope.go:117] "RemoveContainer" containerID="d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a" Jul 20 16:12:10.895196 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.895178 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a"} err="failed to get container status \"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a\": rpc error: code = NotFound desc = could not find container \"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a\": container with ID starting with d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a not found: ID does not exist" Jul 20 16:12:10.895277 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.895196 2569 scope.go:117] "RemoveContainer" containerID="afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719" Jul 20 16:12:10.895440 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.895424 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719"} err="failed to get container status \"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719\": rpc error: code = NotFound desc = could not find container \"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719\": container with ID starting with afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719 not found: ID does not exist" Jul 20 16:12:10.895482 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.895442 2569 scope.go:117] "RemoveContainer" containerID="27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9" Jul 20 16:12:10.895520 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.895500 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.895901 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.895686 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9"} err="failed to get container status \"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9\": rpc error: code = NotFound desc = could not find container \"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9\": container with ID starting with 27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9 not found: ID does not exist" Jul 20 16:12:10.895901 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.895709 2569 scope.go:117] "RemoveContainer" containerID="424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6" Jul 20 16:12:10.896120 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.896098 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6"} err="failed to get container status \"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6\": rpc error: code = NotFound desc = could not find container \"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6\": container with ID starting with 424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6 not found: ID does not exist" Jul 20 16:12:10.896164 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.896122 2569 scope.go:117] "RemoveContainer" containerID="0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf" Jul 20 16:12:10.896401 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.896383 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf"} err="failed to get container status \"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf\": rpc error: code = NotFound desc = could not find container \"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf\": container with ID starting with 0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf not found: ID does not exist" Jul 20 16:12:10.896445 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.896402 2569 scope.go:117] "RemoveContainer" containerID="ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540" Jul 20 16:12:10.896639 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.896622 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540"} err="failed to get container status \"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540\": rpc error: code = NotFound desc = could not find container \"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540\": container with ID starting with ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540 not found: ID does not exist" Jul 20 16:12:10.896694 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.896643 2569 scope.go:117] "RemoveContainer" containerID="3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642" Jul 20 16:12:10.896899 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.896880 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642"} err="failed to get container status \"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642\": rpc error: code = NotFound desc = could not find container \"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642\": container with ID starting with 3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642 not found: ID does not exist" Jul 20 16:12:10.896943 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.896900 2569 scope.go:117] "RemoveContainer" containerID="d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a" Jul 20 16:12:10.897134 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.897114 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a"} err="failed to get container status \"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a\": rpc error: code = NotFound desc = could not find container \"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a\": container with ID starting with d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a not found: ID does not exist" Jul 20 16:12:10.897134 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.897134 2569 scope.go:117] "RemoveContainer" containerID="afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719" Jul 20 16:12:10.897460 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.897444 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719"} err="failed to get container status \"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719\": rpc error: code = NotFound desc = could not find container \"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719\": container with ID starting with afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719 not found: ID does not exist" Jul 20 16:12:10.897508 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.897462 2569 scope.go:117] "RemoveContainer" containerID="27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9" Jul 20 16:12:10.897686 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.897667 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9"} err="failed to get container status \"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9\": rpc error: code = NotFound desc = could not find container \"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9\": container with ID starting with 27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9 not found: ID does not exist" Jul 20 16:12:10.897727 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.897687 2569 scope.go:117] "RemoveContainer" containerID="424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6" Jul 20 16:12:10.897914 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.897891 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6"} err="failed to get container status \"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6\": rpc error: code = NotFound desc = could not find container \"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6\": container with ID starting with 424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6 not found: ID does not exist" Jul 20 16:12:10.897914 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.897913 2569 scope.go:117] "RemoveContainer" containerID="0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf" Jul 20 16:12:10.898391 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.898366 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf"} err="failed to get container status \"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf\": rpc error: code = NotFound desc = could not find container \"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf\": container with ID starting with 0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf not found: ID does not exist" Jul 20 16:12:10.898391 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.898392 2569 scope.go:117] "RemoveContainer" containerID="ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540" Jul 20 16:12:10.898391 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.898408 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 20 16:12:10.898715 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.898450 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 20 16:12:10.898715 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.898449 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 20 16:12:10.898715 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.898496 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 20 16:12:10.898715 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.898638 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 20 16:12:10.899032 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.898722 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540"} err="failed to get container status \"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540\": rpc error: code = NotFound desc = could not find container \"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540\": container with ID starting with ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540 not found: ID does not exist" Jul 20 16:12:10.899032 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.898746 2569 scope.go:117] "RemoveContainer" containerID="3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642" Jul 20 16:12:10.899032 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.898800 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 20 16:12:10.899182 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.899116 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642"} err="failed to get container status \"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642\": rpc error: code = NotFound desc = could not find container \"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642\": container with ID starting with 3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642 not found: ID does not exist" Jul 20 16:12:10.899182 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.899139 2569 scope.go:117] "RemoveContainer" containerID="d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a" Jul 20 16:12:10.899182 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.899155 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 20 16:12:10.899404 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.899383 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 20 16:12:10.899458 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.899447 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7r8mnijk3h1m8\"" Jul 20 16:12:10.899506 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.899462 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 20 16:12:10.899566 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.899504 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-54t7h\"" Jul 20 16:12:10.899618 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.899601 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a"} err="failed to get container status \"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a\": rpc error: code = NotFound desc = could not find container \"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a\": container with ID starting with d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a not found: ID does not exist" Jul 20 16:12:10.899683 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.899621 2569 scope.go:117] "RemoveContainer" containerID="afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719" Jul 20 16:12:10.899865 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.899848 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 20 16:12:10.900210 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.900193 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 20 16:12:10.900334 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.900313 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 20 16:12:10.900488 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.900467 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719"} err="failed to get container status \"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719\": rpc error: code = NotFound desc = could not find container \"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719\": container with ID starting with afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719 not found: ID does not exist" Jul 20 16:12:10.900573 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.900488 2569 scope.go:117] "RemoveContainer" containerID="27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9" Jul 20 16:12:10.900895 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.900869 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9"} err="failed to get container status \"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9\": rpc error: code = NotFound desc = could not find container \"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9\": container with ID starting with 27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9 not found: ID does not exist" Jul 20 16:12:10.900972 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.900896 2569 scope.go:117] "RemoveContainer" containerID="424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6" Jul 20 16:12:10.901204 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.901180 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6"} err="failed to get container status \"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6\": rpc error: code = NotFound desc = could not find container \"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6\": container with ID starting with 424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6 not found: ID does not exist" Jul 20 16:12:10.901299 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.901221 2569 scope.go:117] "RemoveContainer" containerID="0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf" Jul 20 16:12:10.901575 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.901550 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf"} err="failed to get container status \"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf\": rpc error: code = NotFound desc = could not find container \"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf\": container with ID starting with 0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf not found: ID does not exist" Jul 20 16:12:10.901661 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.901575 2569 scope.go:117] "RemoveContainer" containerID="ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540" Jul 20 16:12:10.901819 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.901800 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540"} err="failed to get container status \"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540\": rpc error: code = NotFound desc = could not find container \"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540\": container with ID starting with ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540 not found: ID does not exist" Jul 20 16:12:10.901900 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.901821 2569 scope.go:117] "RemoveContainer" containerID="3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642" Jul 20 16:12:10.901900 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.901894 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 20 16:12:10.902187 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.902166 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642"} err="failed to get container status \"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642\": rpc error: code = NotFound desc = could not find container \"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642\": container with ID starting with 3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642 not found: ID does not exist" Jul 20 16:12:10.902187 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.902184 2569 scope.go:117] "RemoveContainer" containerID="d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a" Jul 20 16:12:10.902509 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.902488 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a"} err="failed to get container status \"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a\": rpc error: code = NotFound desc = could not find container \"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a\": container with ID starting with d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a not found: ID does not exist" Jul 20 16:12:10.902509 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.902509 2569 scope.go:117] "RemoveContainer" containerID="afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719" Jul 20 16:12:10.902892 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.902855 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719"} err="failed to get container status \"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719\": rpc error: code = NotFound desc = could not find container \"afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719\": container with ID starting with afb27f2281fa1ce376521a12094840f05db316655a31b113cbdb8ae166777719 not found: ID does not exist" Jul 20 16:12:10.902990 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.902894 2569 scope.go:117] "RemoveContainer" containerID="27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9" Jul 20 16:12:10.903145 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.903128 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9"} err="failed to get container status \"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9\": rpc error: code = NotFound desc = could not find container \"27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9\": container with ID starting with 27ccd2c82fa1fed24955ca3d8b76012485f386c243970760985a17e3cc62fdc9 not found: ID does not exist" Jul 20 16:12:10.903145 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.903145 2569 scope.go:117] "RemoveContainer" containerID="424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6" Jul 20 16:12:10.903401 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.903375 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6"} err="failed to get container status \"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6\": rpc error: code = NotFound desc = could not find container \"424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6\": container with ID starting with 424c8cddf95647623845f4ca06417111114cb8ccfed3c7fe9d81b79ed5fc44e6 not found: ID does not exist" Jul 20 16:12:10.903485 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.903403 2569 scope.go:117] "RemoveContainer" containerID="0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf" Jul 20 16:12:10.903661 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.903638 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf"} err="failed to get container status \"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf\": rpc error: code = NotFound desc = could not find container \"0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf\": container with ID starting with 0ed2339b48c104b374e22a7ae8c40fb6c9a8ff6ccdef0184f0bb5a15677dbdcf not found: ID does not exist" Jul 20 16:12:10.903661 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.903655 2569 scope.go:117] "RemoveContainer" containerID="ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540" Jul 20 16:12:10.904171 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.903879 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540"} err="failed to get container status \"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540\": rpc error: code = NotFound desc = could not find container \"ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540\": container with ID starting with ef0c09e2e934be2e2f5c4cbe7a2f60cec06224150f7aee0f92d673f8a0e2f540 not found: ID does not exist" Jul 20 16:12:10.904171 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.903902 2569 scope.go:117] "RemoveContainer" containerID="3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642" Jul 20 16:12:10.904423 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.904200 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642"} err="failed to get container status \"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642\": rpc error: code = NotFound desc = could not find container \"3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642\": container with ID starting with 3f1db2e158e5356a1f395c484f68bf34745502ba54c7353bf7807171c4c55642 not found: ID does not exist" Jul 20 16:12:10.904423 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.904222 2569 scope.go:117] "RemoveContainer" containerID="d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a" Jul 20 16:12:10.904556 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.904537 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a"} err="failed to get container status \"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a\": rpc error: code = NotFound desc = could not find container \"d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a\": container with ID starting with d948551d62d6d3b2c3006d92422ab951fa6700bc5651844363fddd654d4cda9a not found: ID does not exist" Jul 20 16:12:10.905032 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.905013 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 20 16:12:10.911526 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.911502 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 16:12:10.932170 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.932139 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.932343 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.932178 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.932343 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.932206 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.932343 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.932291 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.932493 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.932347 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.932493 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.932376 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.932493 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.932445 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.932493 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.932477 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.932667 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.932534 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.932713 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.932654 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/596cdfa0-640f-4e56-85ff-4b4c83c6c558-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.932713 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.932704 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.932803 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.932749 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.932853 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.932811 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-web-config\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.932910 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.932858 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.933104 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.933039 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/596cdfa0-640f-4e56-85ff-4b4c83c6c558-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.933104 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.933074 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt8fz\" (UniqueName: \"kubernetes.io/projected/596cdfa0-640f-4e56-85ff-4b4c83c6c558-kube-api-access-xt8fz\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.933432 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.933349 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/596cdfa0-640f-4e56-85ff-4b4c83c6c558-config-out\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.933432 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.933401 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.933602 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.933576 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:10.933663 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:10.933609 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-config\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.034599 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.034546 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/596cdfa0-640f-4e56-85ff-4b4c83c6c558-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.034599 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.034602 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt8fz\" (UniqueName: \"kubernetes.io/projected/596cdfa0-640f-4e56-85ff-4b4c83c6c558-kube-api-access-xt8fz\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.034859 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.034629 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/596cdfa0-640f-4e56-85ff-4b4c83c6c558-config-out\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.034859 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.034662 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.034859 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.034685 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.034859 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.034712 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-config\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.034859 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.034744 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.034859 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.034770 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.034859 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.034789 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.034859 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.034817 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.034859 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.034855 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.035667 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.035375 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.035667 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.035439 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.035667 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.035455 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.035667 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.035470 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.035667 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.035527 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.035667 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.035585 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/596cdfa0-640f-4e56-85ff-4b4c83c6c558-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.035667 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.035611 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.035667 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.035641 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.036122 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.035678 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-web-config\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.036122 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.035725 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.036442 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.036418 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.037641 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.037611 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/596cdfa0-640f-4e56-85ff-4b4c83c6c558-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.037893 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.037872 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.038435 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.038260 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.039019 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.038760 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.039019 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.038808 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-config\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.039019 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.038831 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.039019 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.038854 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.039253 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.039070 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.039253 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.039116 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/596cdfa0-640f-4e56-85ff-4b4c83c6c558-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.039646 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.039520 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.039646 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.039637 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.039773 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.039704 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/596cdfa0-640f-4e56-85ff-4b4c83c6c558-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.040251 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.040215 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/596cdfa0-640f-4e56-85ff-4b4c83c6c558-config-out\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.040706 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.040688 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.041425 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.041397 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.041555 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.041539 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-web-config\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.041916 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.041896 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/596cdfa0-640f-4e56-85ff-4b4c83c6c558-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.042999 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.042983 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt8fz\" (UniqueName: \"kubernetes.io/projected/596cdfa0-640f-4e56-85ff-4b4c83c6c558-kube-api-access-xt8fz\") pod \"prometheus-k8s-0\" (UID: \"596cdfa0-640f-4e56-85ff-4b4c83c6c558\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.206962 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.206926 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:11.351768 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.351664 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 16:12:11.353777 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:12:11.353747 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod596cdfa0_640f_4e56_85ff_4b4c83c6c558.slice/crio-16d941201fff5101a4c6ca9adfdf657646e6f6bd2c94c67bfe272ecd2622e87b WatchSource:0}: Error finding container 16d941201fff5101a4c6ca9adfdf657646e6f6bd2c94c67bfe272ecd2622e87b: Status 404 returned error can't find the container with id 16d941201fff5101a4c6ca9adfdf657646e6f6bd2c94c67bfe272ecd2622e87b Jul 20 16:12:11.845027 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.844997 2569 generic.go:356] "Generic (PLEG): container finished" podID="596cdfa0-640f-4e56-85ff-4b4c83c6c558" containerID="0c952111f1b470ec589a4777eca8ef015a09873f1f1d7a2b2c6398db960ce238" exitCode=0 Jul 20 16:12:11.845420 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.845093 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"596cdfa0-640f-4e56-85ff-4b4c83c6c558","Type":"ContainerDied","Data":"0c952111f1b470ec589a4777eca8ef015a09873f1f1d7a2b2c6398db960ce238"} Jul 20 16:12:11.845420 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:11.845160 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"596cdfa0-640f-4e56-85ff-4b4c83c6c558","Type":"ContainerStarted","Data":"16d941201fff5101a4c6ca9adfdf657646e6f6bd2c94c67bfe272ecd2622e87b"} Jul 20 16:12:12.048462 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:12.047605 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67aa069a-cbef-4886-9994-8e81299c9911" path="/var/lib/kubelet/pods/67aa069a-cbef-4886-9994-8e81299c9911/volumes" Jul 20 16:12:12.852565 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:12.852535 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"596cdfa0-640f-4e56-85ff-4b4c83c6c558","Type":"ContainerStarted","Data":"f478a56b4d7c5ba32868d69b00118b9a5124f65ca11e71e0e3f63fcb7987bbe9"} Jul 20 16:12:12.852969 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:12.852599 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"596cdfa0-640f-4e56-85ff-4b4c83c6c558","Type":"ContainerStarted","Data":"2532e4cc1892bf03eb51d2eb602122cf30c0ea0fd23660be812c4a528185bddf"} Jul 20 16:12:12.852969 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:12.852624 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"596cdfa0-640f-4e56-85ff-4b4c83c6c558","Type":"ContainerStarted","Data":"e0d294b9e55dd31dcf18ee01f3bbb9b546f4ba9b74559f72a31c4ebb472b0e17"} Jul 20 16:12:12.852969 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:12.852648 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"596cdfa0-640f-4e56-85ff-4b4c83c6c558","Type":"ContainerStarted","Data":"9254603754f84a8998ce3bf3e19365dfcf1e4f5500cdc3d052a3169df449d469"} Jul 20 16:12:12.852969 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:12.852674 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"596cdfa0-640f-4e56-85ff-4b4c83c6c558","Type":"ContainerStarted","Data":"dd717d00ee387426d3860607364ee5e0366591d3594f08e92f54fdf1ac773950"} Jul 20 16:12:12.852969 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:12.852700 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"596cdfa0-640f-4e56-85ff-4b4c83c6c558","Type":"ContainerStarted","Data":"eeb082dd876aa092118c2bd48f021f19cf5fc26e97d00032f977bd5eba803786"} Jul 20 16:12:12.883350 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:12.883287 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.861962211 podStartE2EDuration="2.883266474s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.304263ms" isStatefulPod=false podCreationTimestamp="2026-07-20 16:12:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:12:12.881012147 +0000 UTC m=+163.430311461" watchObservedRunningTime="2026-07-20 16:12:12.883266474 +0000 UTC m=+163.432565774" Jul 20 16:12:13.402852 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:13.402814 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:12:13.460686 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:13.460650 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:12:15.457942 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:15.457906 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:12:15.563190 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:15.563159 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:12:15.808202 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:15.808116 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:12:16.207835 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:16.207804 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:12:27.230601 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:27.230507 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:12:27.332417 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:27.332382 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:12:47.960112 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:12:47.960074 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:08.206219 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:08.206185 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:08.367719 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:08.367677 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:11.207561 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:11.207529 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:13:11.223295 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:11.223266 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:13:12.111503 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:12.111478 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 16:13:34.768461 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:34.768425 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:35.545349 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:35.545321 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:38.182682 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:38.182644 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:38.238498 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:38.238465 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:40.444835 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:40.444795 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:40.545773 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:40.545737 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:42.614498 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:42.614446 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:42.781992 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:42.781959 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:42.859589 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:42.859558 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:43.012053 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:43.012018 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:43.059628 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:43.059596 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dwldt"] Jul 20 16:13:43.063219 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:43.063203 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwldt" Jul 20 16:13:43.066013 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:43.065954 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 20 16:13:43.067403 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:43.067385 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wwkx7\"" Jul 20 16:13:43.067521 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:43.067425 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 20 16:13:43.071938 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:43.071917 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dwldt"] Jul 20 16:13:43.143791 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:43.143758 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/162f794b-c67f-48e4-afd8-9a1a61f805c4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dwldt\" (UID: \"162f794b-c67f-48e4-afd8-9a1a61f805c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwldt" Jul 20 16:13:43.143791 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:43.143796 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlq2r\" (UniqueName: \"kubernetes.io/projected/162f794b-c67f-48e4-afd8-9a1a61f805c4-kube-api-access-nlq2r\") pod \"cert-manager-cainjector-559cdd8c87-dwldt\" (UID: \"162f794b-c67f-48e4-afd8-9a1a61f805c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwldt" Jul 20 16:13:43.245091 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:43.245060 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/162f794b-c67f-48e4-afd8-9a1a61f805c4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dwldt\" (UID: \"162f794b-c67f-48e4-afd8-9a1a61f805c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwldt" Jul 20 16:13:43.245091 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:43.245095 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlq2r\" (UniqueName: \"kubernetes.io/projected/162f794b-c67f-48e4-afd8-9a1a61f805c4-kube-api-access-nlq2r\") pod \"cert-manager-cainjector-559cdd8c87-dwldt\" (UID: \"162f794b-c67f-48e4-afd8-9a1a61f805c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwldt" Jul 20 16:13:43.253594 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:43.253567 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/162f794b-c67f-48e4-afd8-9a1a61f805c4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dwldt\" (UID: \"162f794b-c67f-48e4-afd8-9a1a61f805c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwldt" Jul 20 16:13:43.253716 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:43.253688 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlq2r\" (UniqueName: \"kubernetes.io/projected/162f794b-c67f-48e4-afd8-9a1a61f805c4-kube-api-access-nlq2r\") pod \"cert-manager-cainjector-559cdd8c87-dwldt\" (UID: \"162f794b-c67f-48e4-afd8-9a1a61f805c4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwldt" Jul 20 16:13:43.390941 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:43.390906 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwldt" Jul 20 16:13:43.521997 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:43.521975 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dwldt"] Jul 20 16:13:43.524431 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:13:43.524406 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod162f794b_c67f_48e4_afd8_9a1a61f805c4.slice/crio-cbdb6ab74588c702a6f6e74c220c6a7e625e3ca7912d46df5ea7970fe80398f8 WatchSource:0}: Error finding container cbdb6ab74588c702a6f6e74c220c6a7e625e3ca7912d46df5ea7970fe80398f8: Status 404 returned error can't find the container with id cbdb6ab74588c702a6f6e74c220c6a7e625e3ca7912d46df5ea7970fe80398f8 Jul 20 16:13:44.221243 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:44.221170 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwldt" event={"ID":"162f794b-c67f-48e4-afd8-9a1a61f805c4","Type":"ContainerStarted","Data":"cbdb6ab74588c702a6f6e74c220c6a7e625e3ca7912d46df5ea7970fe80398f8"} Jul 20 16:13:46.992180 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:46.992149 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:47.092460 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:47.092430 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:47.239070 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:47.239039 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwldt" event={"ID":"162f794b-c67f-48e4-afd8-9a1a61f805c4","Type":"ContainerStarted","Data":"81578c52c82f61869c5395f5ceea3edee2bac40c143323112b98b17a009d510f"} Jul 20 16:13:47.258627 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:47.258511 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dwldt" podStartSLOduration=1.245374328 podStartE2EDuration="4.258488159s" totalImagesPullingTime="3.013113831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:13:47.255273291 +0000 UTC m=+257.804572590" watchObservedRunningTime="2026-07-20 16:13:47.258488159 +0000 UTC m=+257.807787459" Jul 20 16:13:51.062462 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:51.062425 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:52.888753 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:52.888705 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:13:52.988797 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:13:52.988760 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:04.202837 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:04.202791 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:04.315514 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:04.315486 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:04.857154 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:04.857120 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:06.314972 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:06.314937 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:06.532994 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:06.532957 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-58nxd"] Jul 20 16:14:06.536143 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:06.536122 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-58nxd" Jul 20 16:14:06.538903 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:06.538876 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-7pwns\"" Jul 20 16:14:06.539011 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:06.538885 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 20 16:14:06.540253 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:06.540218 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 20 16:14:06.544427 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:06.544404 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-58nxd"] Jul 20 16:14:06.655333 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:06.655296 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dca9d5b7-8969-459f-b955-a52d405aaf2f-tmp\") pod \"jobset-operator-5bc45f897-58nxd\" (UID: \"dca9d5b7-8969-459f-b955-a52d405aaf2f\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-58nxd" Jul 20 16:14:06.655533 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:06.655359 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86j49\" (UniqueName: \"kubernetes.io/projected/dca9d5b7-8969-459f-b955-a52d405aaf2f-kube-api-access-86j49\") pod \"jobset-operator-5bc45f897-58nxd\" (UID: \"dca9d5b7-8969-459f-b955-a52d405aaf2f\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-58nxd" Jul 20 16:14:06.756570 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:06.756535 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dca9d5b7-8969-459f-b955-a52d405aaf2f-tmp\") pod \"jobset-operator-5bc45f897-58nxd\" (UID: \"dca9d5b7-8969-459f-b955-a52d405aaf2f\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-58nxd" Jul 20 16:14:06.756754 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:06.756599 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86j49\" (UniqueName: \"kubernetes.io/projected/dca9d5b7-8969-459f-b955-a52d405aaf2f-kube-api-access-86j49\") pod \"jobset-operator-5bc45f897-58nxd\" (UID: \"dca9d5b7-8969-459f-b955-a52d405aaf2f\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-58nxd" Jul 20 16:14:06.756946 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:06.756926 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dca9d5b7-8969-459f-b955-a52d405aaf2f-tmp\") pod \"jobset-operator-5bc45f897-58nxd\" (UID: \"dca9d5b7-8969-459f-b955-a52d405aaf2f\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-58nxd" Jul 20 16:14:06.765090 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:06.765058 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86j49\" (UniqueName: \"kubernetes.io/projected/dca9d5b7-8969-459f-b955-a52d405aaf2f-kube-api-access-86j49\") pod \"jobset-operator-5bc45f897-58nxd\" (UID: \"dca9d5b7-8969-459f-b955-a52d405aaf2f\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-58nxd" Jul 20 16:14:06.845518 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:06.845481 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-58nxd" Jul 20 16:14:06.973073 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:06.972993 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-58nxd"] Jul 20 16:14:06.975444 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:14:06.975419 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddca9d5b7_8969_459f_b955_a52d405aaf2f.slice/crio-a1f69276ba93e40470d70569357931feda28f27138383fe60913814db0319bd1 WatchSource:0}: Error finding container a1f69276ba93e40470d70569357931feda28f27138383fe60913814db0319bd1: Status 404 returned error can't find the container with id a1f69276ba93e40470d70569357931feda28f27138383fe60913814db0319bd1 Jul 20 16:14:07.325636 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:07.325554 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-58nxd" event={"ID":"dca9d5b7-8969-459f-b955-a52d405aaf2f","Type":"ContainerStarted","Data":"a1f69276ba93e40470d70569357931feda28f27138383fe60913814db0319bd1"} Jul 20 16:14:10.340182 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:10.340139 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-58nxd" event={"ID":"dca9d5b7-8969-459f-b955-a52d405aaf2f","Type":"ContainerStarted","Data":"47fcaea99d3635c8a627e89479a3954b3131eaf772ab7fda6ef88fe14655ac8c"} Jul 20 16:14:10.357920 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:10.357867 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-58nxd" podStartSLOduration=2.05551631 podStartE2EDuration="4.357849568s" totalImagesPullingTime="2.302333258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:14:10.356674013 +0000 UTC m=+280.905973323" watchObservedRunningTime="2026-07-20 16:14:10.357849568 +0000 UTC m=+280.907148867" Jul 20 16:14:14.276867 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:14.276834 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:15.748006 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:15.747974 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:15.961856 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:15.961827 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:16.015078 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:16.014995 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:17.626928 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:17.626894 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:17.727612 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:17.727579 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:14:29.885459 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:14:29.885427 2569 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 16:15:18.417448 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:15:18.417406 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:20.732616 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:15:20.732577 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:29.999272 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:15:29.999168 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:47.589880 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:15:47.589843 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:58.585012 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:15:58.584976 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:15:58.639172 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:15:58.639141 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:09.378984 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:09.378949 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:09.428512 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:09.428475 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:09.485795 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:09.485767 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:12.801023 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:12.800989 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:12.853671 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:12.853639 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:14.377963 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.377932 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst"] Jul 20 16:16:14.381429 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.381411 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" Jul 20 16:16:14.384268 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.384223 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 20 16:16:14.384372 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.384287 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 20 16:16:14.385582 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.385564 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-rsrcl\"" Jul 20 16:16:14.385685 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.385598 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 20 16:16:14.385685 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.385661 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 20 16:16:14.390189 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.390164 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:14.390537 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.390503 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst"] Jul 20 16:16:14.445350 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.445321 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be23b908-9f8a-4060-b578-778c032cfe55-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst\" (UID: \"be23b908-9f8a-4060-b578-778c032cfe55\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" Jul 20 16:16:14.445498 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.445376 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4f8q\" (UniqueName: \"kubernetes.io/projected/be23b908-9f8a-4060-b578-778c032cfe55-kube-api-access-q4f8q\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst\" (UID: \"be23b908-9f8a-4060-b578-778c032cfe55\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" Jul 20 16:16:14.445498 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.445403 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/be23b908-9f8a-4060-b578-778c032cfe55-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst\" (UID: \"be23b908-9f8a-4060-b578-778c032cfe55\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" Jul 20 16:16:14.546669 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.546635 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be23b908-9f8a-4060-b578-778c032cfe55-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst\" (UID: \"be23b908-9f8a-4060-b578-778c032cfe55\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" Jul 20 16:16:14.546857 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.546691 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4f8q\" (UniqueName: \"kubernetes.io/projected/be23b908-9f8a-4060-b578-778c032cfe55-kube-api-access-q4f8q\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst\" (UID: \"be23b908-9f8a-4060-b578-778c032cfe55\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" Jul 20 16:16:14.546857 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.546713 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/be23b908-9f8a-4060-b578-778c032cfe55-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst\" (UID: \"be23b908-9f8a-4060-b578-778c032cfe55\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" Jul 20 16:16:14.547304 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.547283 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/be23b908-9f8a-4060-b578-778c032cfe55-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst\" (UID: \"be23b908-9f8a-4060-b578-778c032cfe55\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" Jul 20 16:16:14.549123 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.549098 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be23b908-9f8a-4060-b578-778c032cfe55-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst\" (UID: \"be23b908-9f8a-4060-b578-778c032cfe55\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" Jul 20 16:16:14.555569 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.555544 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4f8q\" (UniqueName: \"kubernetes.io/projected/be23b908-9f8a-4060-b578-778c032cfe55-kube-api-access-q4f8q\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst\" (UID: \"be23b908-9f8a-4060-b578-778c032cfe55\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" Jul 20 16:16:14.607540 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.607492 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:14.691709 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.691605 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" Jul 20 16:16:14.824888 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.824853 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst"] Jul 20 16:16:14.828146 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:16:14.828113 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe23b908_9f8a_4060_b578_778c032cfe55.slice/crio-4d6a14984cbf6c634cdd8ee704c52cc8f505d1ad9747cf31afcbe53d8cb77f34 WatchSource:0}: Error finding container 4d6a14984cbf6c634cdd8ee704c52cc8f505d1ad9747cf31afcbe53d8cb77f34: Status 404 returned error can't find the container with id 4d6a14984cbf6c634cdd8ee704c52cc8f505d1ad9747cf31afcbe53d8cb77f34 Jul 20 16:16:14.830063 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.830046 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 16:16:14.851383 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:14.851352 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" event={"ID":"be23b908-9f8a-4060-b578-778c032cfe55","Type":"ContainerStarted","Data":"4d6a14984cbf6c634cdd8ee704c52cc8f505d1ad9747cf31afcbe53d8cb77f34"} Jul 20 16:16:15.618695 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:15.618667 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:15.720528 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:15.720486 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:17.867669 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:17.867632 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" event={"ID":"be23b908-9f8a-4060-b578-778c032cfe55","Type":"ContainerStarted","Data":"65e8aff9ee0ff493f895e2e6acb52c15859caeef7e2bf7fbbb89989243b001e9"} Jul 20 16:16:17.868085 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:17.867697 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" Jul 20 16:16:17.886209 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:17.886156 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" podStartSLOduration=1.009109122 podStartE2EDuration="3.886136361s" totalImagesPullingTime="2.877027239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:16:17.883849535 +0000 UTC m=+408.433148844" watchObservedRunningTime="2026-07-20 16:16:17.886136361 +0000 UTC m=+408.435435661" Jul 20 16:16:18.328797 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:18.328757 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:33.877727 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:33.877694 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" Jul 20 16:16:36.471211 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:36.471167 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:16:36.499536 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:36.499509 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-fcktc"] Jul 20 16:16:36.501973 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:36.501959 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-fcktc" Jul 20 16:16:36.504854 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:36.504835 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-m4rl4\"" Jul 20 16:16:36.513196 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:36.513174 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-fcktc"] Jul 20 16:16:36.650421 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:36.650384 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsrzl\" (UniqueName: \"kubernetes.io/projected/b09a7567-b219-4bd6-8801-f9e5ba31b72c-kube-api-access-bsrzl\") pod \"test-trainjob-workflow-node-0-0-fcktc\" (UID: \"b09a7567-b219-4bd6-8801-f9e5ba31b72c\") " pod="opendatahub/test-trainjob-workflow-node-0-0-fcktc" Jul 20 16:16:36.751402 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:36.751307 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsrzl\" (UniqueName: \"kubernetes.io/projected/b09a7567-b219-4bd6-8801-f9e5ba31b72c-kube-api-access-bsrzl\") pod \"test-trainjob-workflow-node-0-0-fcktc\" (UID: \"b09a7567-b219-4bd6-8801-f9e5ba31b72c\") " pod="opendatahub/test-trainjob-workflow-node-0-0-fcktc" Jul 20 16:16:36.760005 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:36.759970 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsrzl\" (UniqueName: \"kubernetes.io/projected/b09a7567-b219-4bd6-8801-f9e5ba31b72c-kube-api-access-bsrzl\") pod \"test-trainjob-workflow-node-0-0-fcktc\" (UID: \"b09a7567-b219-4bd6-8801-f9e5ba31b72c\") " pod="opendatahub/test-trainjob-workflow-node-0-0-fcktc" Jul 20 16:16:36.811084 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:36.811048 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-fcktc" Jul 20 16:16:36.938766 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:36.938728 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-fcktc"] Jul 20 16:16:36.941324 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:16:36.941301 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb09a7567_b219_4bd6_8801_f9e5ba31b72c.slice/crio-59a7ec1aac30c26cd44fdbf999ed7a4b653de50c224728d40db0f05cfbcc3ff5 WatchSource:0}: Error finding container 59a7ec1aac30c26cd44fdbf999ed7a4b653de50c224728d40db0f05cfbcc3ff5: Status 404 returned error can't find the container with id 59a7ec1aac30c26cd44fdbf999ed7a4b653de50c224728d40db0f05cfbcc3ff5 Jul 20 16:16:36.948745 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:36.948717 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-fcktc" event={"ID":"b09a7567-b219-4bd6-8801-f9e5ba31b72c","Type":"ContainerStarted","Data":"59a7ec1aac30c26cd44fdbf999ed7a4b653de50c224728d40db0f05cfbcc3ff5"} Jul 20 16:16:37.759335 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:16:37.759299 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:51.338894 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:51.338863 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-fcktc" event={"ID":"b09a7567-b219-4bd6-8801-f9e5ba31b72c","Type":"ContainerStarted","Data":"fa1293062d2b82a0a0fff5321b9b473e287358e542d52c8db4a0a0425ad46027"} Jul 20 16:17:51.357306 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:51.357217 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-fcktc" podStartSLOduration=1.067257519 podStartE2EDuration="1m15.357195034s" totalImagesPullingTime="1m14.289937515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:17:51.356113126 +0000 UTC m=+501.905412433" watchObservedRunningTime="2026-07-20 16:17:51.357195034 +0000 UTC m=+501.906494334" Jul 20 16:17:54.355275 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:54.355178 2569 generic.go:356] "Generic (PLEG): container finished" podID="b09a7567-b219-4bd6-8801-f9e5ba31b72c" containerID="fa1293062d2b82a0a0fff5321b9b473e287358e542d52c8db4a0a0425ad46027" exitCode=0 Jul 20 16:17:54.355275 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:54.355252 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-fcktc" event={"ID":"b09a7567-b219-4bd6-8801-f9e5ba31b72c","Type":"ContainerDied","Data":"fa1293062d2b82a0a0fff5321b9b473e287358e542d52c8db4a0a0425ad46027"} Jul 20 16:17:55.547165 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:55.547134 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-fcktc" Jul 20 16:17:55.621222 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:55.621195 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsrzl\" (UniqueName: \"kubernetes.io/projected/b09a7567-b219-4bd6-8801-f9e5ba31b72c-kube-api-access-bsrzl\") pod \"b09a7567-b219-4bd6-8801-f9e5ba31b72c\" (UID: \"b09a7567-b219-4bd6-8801-f9e5ba31b72c\") " Jul 20 16:17:55.623304 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:55.623278 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b09a7567-b219-4bd6-8801-f9e5ba31b72c-kube-api-access-bsrzl" (OuterVolumeSpecName: "kube-api-access-bsrzl") pod "b09a7567-b219-4bd6-8801-f9e5ba31b72c" (UID: "b09a7567-b219-4bd6-8801-f9e5ba31b72c"). InnerVolumeSpecName "kube-api-access-bsrzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:17:55.722490 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:55.722454 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsrzl\" (UniqueName: \"kubernetes.io/projected/b09a7567-b219-4bd6-8801-f9e5ba31b72c-kube-api-access-bsrzl\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:17:56.365015 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:56.364989 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-fcktc" event={"ID":"b09a7567-b219-4bd6-8801-f9e5ba31b72c","Type":"ContainerDied","Data":"59a7ec1aac30c26cd44fdbf999ed7a4b653de50c224728d40db0f05cfbcc3ff5"} Jul 20 16:17:56.365200 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:56.365023 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59a7ec1aac30c26cd44fdbf999ed7a4b653de50c224728d40db0f05cfbcc3ff5" Jul 20 16:17:56.365200 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:56.365024 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-fcktc" Jul 20 16:17:56.760692 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:56.760594 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-fcktc"] Jul 20 16:17:56.762930 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:56.762901 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-fcktc"] Jul 20 16:17:56.790813 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:56.790786 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:56.895815 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:56.895784 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst"] Jul 20 16:17:56.896022 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:56.895998 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" podUID="be23b908-9f8a-4060-b578-778c032cfe55" containerName="manager" containerID="cri-o://65e8aff9ee0ff493f895e2e6acb52c15859caeef7e2bf7fbbb89989243b001e9" gracePeriod=30 Jul 20 16:17:56.899911 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:56.899883 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:56.976797 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:56.976764 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:57.094313 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.094284 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:57.151830 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.151809 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" Jul 20 16:17:57.176427 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.176393 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:57.235337 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.235302 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4f8q\" (UniqueName: \"kubernetes.io/projected/be23b908-9f8a-4060-b578-778c032cfe55-kube-api-access-q4f8q\") pod \"be23b908-9f8a-4060-b578-778c032cfe55\" (UID: \"be23b908-9f8a-4060-b578-778c032cfe55\") " Jul 20 16:17:57.235670 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.235357 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/be23b908-9f8a-4060-b578-778c032cfe55-kubeflow-trainer-config\") pod \"be23b908-9f8a-4060-b578-778c032cfe55\" (UID: \"be23b908-9f8a-4060-b578-778c032cfe55\") " Jul 20 16:17:57.235670 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.235387 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be23b908-9f8a-4060-b578-778c032cfe55-cert\") pod \"be23b908-9f8a-4060-b578-778c032cfe55\" (UID: \"be23b908-9f8a-4060-b578-778c032cfe55\") " Jul 20 16:17:57.237444 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.237411 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be23b908-9f8a-4060-b578-778c032cfe55-cert" (OuterVolumeSpecName: "cert") pod "be23b908-9f8a-4060-b578-778c032cfe55" (UID: "be23b908-9f8a-4060-b578-778c032cfe55"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 16:17:57.237548 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.237455 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be23b908-9f8a-4060-b578-778c032cfe55-kube-api-access-q4f8q" (OuterVolumeSpecName: "kube-api-access-q4f8q") pod "be23b908-9f8a-4060-b578-778c032cfe55" (UID: "be23b908-9f8a-4060-b578-778c032cfe55"). InnerVolumeSpecName "kube-api-access-q4f8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:17:57.239985 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.239962 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be23b908-9f8a-4060-b578-778c032cfe55-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "be23b908-9f8a-4060-b578-778c032cfe55" (UID: "be23b908-9f8a-4060-b578-778c032cfe55"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 16:17:57.336405 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.336318 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4f8q\" (UniqueName: \"kubernetes.io/projected/be23b908-9f8a-4060-b578-778c032cfe55-kube-api-access-q4f8q\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:17:57.336405 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.336346 2569 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/be23b908-9f8a-4060-b578-778c032cfe55-kubeflow-trainer-config\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:17:57.336405 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.336355 2569 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be23b908-9f8a-4060-b578-778c032cfe55-cert\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:17:57.370739 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.370707 2569 generic.go:356] "Generic (PLEG): container finished" podID="be23b908-9f8a-4060-b578-778c032cfe55" containerID="65e8aff9ee0ff493f895e2e6acb52c15859caeef7e2bf7fbbb89989243b001e9" exitCode=0 Jul 20 16:17:57.370892 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.370749 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" event={"ID":"be23b908-9f8a-4060-b578-778c032cfe55","Type":"ContainerDied","Data":"65e8aff9ee0ff493f895e2e6acb52c15859caeef7e2bf7fbbb89989243b001e9"} Jul 20 16:17:57.370892 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.370789 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" event={"ID":"be23b908-9f8a-4060-b578-778c032cfe55","Type":"ContainerDied","Data":"4d6a14984cbf6c634cdd8ee704c52cc8f505d1ad9747cf31afcbe53d8cb77f34"} Jul 20 16:17:57.370892 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.370805 2569 scope.go:117] "RemoveContainer" containerID="65e8aff9ee0ff493f895e2e6acb52c15859caeef7e2bf7fbbb89989243b001e9" Jul 20 16:17:57.370892 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.370762 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst" Jul 20 16:17:57.383109 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.383009 2569 scope.go:117] "RemoveContainer" containerID="65e8aff9ee0ff493f895e2e6acb52c15859caeef7e2bf7fbbb89989243b001e9" Jul 20 16:17:57.383654 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:17:57.383630 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65e8aff9ee0ff493f895e2e6acb52c15859caeef7e2bf7fbbb89989243b001e9\": container with ID starting with 65e8aff9ee0ff493f895e2e6acb52c15859caeef7e2bf7fbbb89989243b001e9 not found: ID does not exist" containerID="65e8aff9ee0ff493f895e2e6acb52c15859caeef7e2bf7fbbb89989243b001e9" Jul 20 16:17:57.383746 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.383665 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65e8aff9ee0ff493f895e2e6acb52c15859caeef7e2bf7fbbb89989243b001e9"} err="failed to get container status \"65e8aff9ee0ff493f895e2e6acb52c15859caeef7e2bf7fbbb89989243b001e9\": rpc error: code = NotFound desc = could not find container \"65e8aff9ee0ff493f895e2e6acb52c15859caeef7e2bf7fbbb89989243b001e9\": container with ID starting with 65e8aff9ee0ff493f895e2e6acb52c15859caeef7e2bf7fbbb89989243b001e9 not found: ID does not exist" Jul 20 16:17:57.394999 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.394970 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst"] Jul 20 16:17:57.399561 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.399535 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-p4cst"] Jul 20 16:17:57.654255 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.654213 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rpb9v/must-gather-sgktw"] Jul 20 16:17:57.654613 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.654600 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b09a7567-b219-4bd6-8801-f9e5ba31b72c" containerName="node" Jul 20 16:17:57.654663 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.654615 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b09a7567-b219-4bd6-8801-f9e5ba31b72c" containerName="node" Jul 20 16:17:57.654663 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.654635 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be23b908-9f8a-4060-b578-778c032cfe55" containerName="manager" Jul 20 16:17:57.654663 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.654641 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="be23b908-9f8a-4060-b578-778c032cfe55" containerName="manager" Jul 20 16:17:57.654764 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.654691 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b09a7567-b219-4bd6-8801-f9e5ba31b72c" containerName="node" Jul 20 16:17:57.654764 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.654715 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="be23b908-9f8a-4060-b578-778c032cfe55" containerName="manager" Jul 20 16:17:57.657629 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.657612 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rpb9v/must-gather-sgktw" Jul 20 16:17:57.660580 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.660555 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rpb9v\"/\"default-dockercfg-r22hv\"" Jul 20 16:17:57.660701 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.660594 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rpb9v\"/\"openshift-service-ca.crt\"" Jul 20 16:17:57.660701 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.660601 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rpb9v\"/\"kube-root-ca.crt\"" Jul 20 16:17:57.666695 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.666674 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rpb9v/must-gather-sgktw"] Jul 20 16:17:57.668092 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.668069 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:57.727337 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.727304 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:17:57.739482 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.739460 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9d63cd05-ab3f-4b3a-b3bb-77d778d8391b-must-gather-output\") pod \"must-gather-sgktw\" (UID: \"9d63cd05-ab3f-4b3a-b3bb-77d778d8391b\") " pod="openshift-must-gather-rpb9v/must-gather-sgktw" Jul 20 16:17:57.739553 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.739500 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pbwg\" (UniqueName: \"kubernetes.io/projected/9d63cd05-ab3f-4b3a-b3bb-77d778d8391b-kube-api-access-2pbwg\") pod \"must-gather-sgktw\" (UID: \"9d63cd05-ab3f-4b3a-b3bb-77d778d8391b\") " pod="openshift-must-gather-rpb9v/must-gather-sgktw" Jul 20 16:17:57.840049 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.840015 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9d63cd05-ab3f-4b3a-b3bb-77d778d8391b-must-gather-output\") pod \"must-gather-sgktw\" (UID: \"9d63cd05-ab3f-4b3a-b3bb-77d778d8391b\") " pod="openshift-must-gather-rpb9v/must-gather-sgktw" Jul 20 16:17:57.840507 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.840061 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pbwg\" (UniqueName: \"kubernetes.io/projected/9d63cd05-ab3f-4b3a-b3bb-77d778d8391b-kube-api-access-2pbwg\") pod \"must-gather-sgktw\" (UID: \"9d63cd05-ab3f-4b3a-b3bb-77d778d8391b\") " pod="openshift-must-gather-rpb9v/must-gather-sgktw" Jul 20 16:17:57.840507 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.840371 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9d63cd05-ab3f-4b3a-b3bb-77d778d8391b-must-gather-output\") pod \"must-gather-sgktw\" (UID: \"9d63cd05-ab3f-4b3a-b3bb-77d778d8391b\") " pod="openshift-must-gather-rpb9v/must-gather-sgktw" Jul 20 16:17:57.848535 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.848507 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pbwg\" (UniqueName: \"kubernetes.io/projected/9d63cd05-ab3f-4b3a-b3bb-77d778d8391b-kube-api-access-2pbwg\") pod \"must-gather-sgktw\" (UID: \"9d63cd05-ab3f-4b3a-b3bb-77d778d8391b\") " pod="openshift-must-gather-rpb9v/must-gather-sgktw" Jul 20 16:17:57.967510 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:57.967414 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rpb9v/must-gather-sgktw" Jul 20 16:17:58.044584 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:58.044554 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b09a7567-b219-4bd6-8801-f9e5ba31b72c" path="/var/lib/kubelet/pods/b09a7567-b219-4bd6-8801-f9e5ba31b72c/volumes" Jul 20 16:17:58.044911 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:58.044897 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be23b908-9f8a-4060-b578-778c032cfe55" path="/var/lib/kubelet/pods/be23b908-9f8a-4060-b578-778c032cfe55/volumes" Jul 20 16:17:58.093653 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:58.093623 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rpb9v/must-gather-sgktw"] Jul 20 16:17:58.097327 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:17:58.097297 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d63cd05_ab3f_4b3a_b3bb_77d778d8391b.slice/crio-0de6103e40203c604ce12c3c6b86ef1d81d1a5fb8d2f2f58bb391b856c1ae430 WatchSource:0}: Error finding container 0de6103e40203c604ce12c3c6b86ef1d81d1a5fb8d2f2f58bb391b856c1ae430: Status 404 returned error can't find the container with id 0de6103e40203c604ce12c3c6b86ef1d81d1a5fb8d2f2f58bb391b856c1ae430 Jul 20 16:17:58.377126 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:17:58.377100 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rpb9v/must-gather-sgktw" event={"ID":"9d63cd05-ab3f-4b3a-b3bb-77d778d8391b","Type":"ContainerStarted","Data":"0de6103e40203c604ce12c3c6b86ef1d81d1a5fb8d2f2f58bb391b856c1ae430"} Jul 20 16:18:05.417765 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:05.417733 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rpb9v/must-gather-sgktw" event={"ID":"9d63cd05-ab3f-4b3a-b3bb-77d778d8391b","Type":"ContainerStarted","Data":"af783a1c6e26d423ee68a7e12ad10b86cbdd6772c051220327a016e38aa2952e"} Jul 20 16:18:05.417765 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:05.417773 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rpb9v/must-gather-sgktw" event={"ID":"9d63cd05-ab3f-4b3a-b3bb-77d778d8391b","Type":"ContainerStarted","Data":"2b56d2df00dfc81888e17753d2d3871c55636a7a1bc383b69bd57439dd5d0cb2"} Jul 20 16:18:05.433509 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:05.433463 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rpb9v/must-gather-sgktw" podStartSLOduration=1.578085848 podStartE2EDuration="8.433448527s" totalImagesPullingTime="6.855362679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:18:05.432626319 +0000 UTC m=+515.981925619" watchObservedRunningTime="2026-07-20 16:18:05.433448527 +0000 UTC m=+515.982747826" Jul 20 16:18:50.644186 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:50.644156 2569 generic.go:356] "Generic (PLEG): container finished" podID="9d63cd05-ab3f-4b3a-b3bb-77d778d8391b" containerID="2b56d2df00dfc81888e17753d2d3871c55636a7a1bc383b69bd57439dd5d0cb2" exitCode=0 Jul 20 16:18:50.644629 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:50.644256 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rpb9v/must-gather-sgktw" event={"ID":"9d63cd05-ab3f-4b3a-b3bb-77d778d8391b","Type":"ContainerDied","Data":"2b56d2df00dfc81888e17753d2d3871c55636a7a1bc383b69bd57439dd5d0cb2"} Jul 20 16:18:50.644629 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:50.644606 2569 scope.go:117] "RemoveContainer" containerID="2b56d2df00dfc81888e17753d2d3871c55636a7a1bc383b69bd57439dd5d0cb2" Jul 20 16:18:51.474455 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:51.474427 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-rpb9v_must-gather-sgktw_9d63cd05-ab3f-4b3a-b3bb-77d778d8391b/gather/0.log" Jul 20 16:18:51.837394 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:51.837313 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:18:52.009015 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:52.008965 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:18:52.109321 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:52.109225 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:18:54.870325 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:54.870296 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jn4lt_8e116ef2-0fca-44f3-84c2-86b3bde42a78/global-pull-secret-syncer/0.log" Jul 20 16:18:55.020633 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:55.020596 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" Jul 20 16:18:55.115826 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:55.115799 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-156.ec2.internal_b679fc128ec345ad8c5a7680ba39ba5b/haproxy/0.log" Jul 20 16:18:56.825039 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:56.824995 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-rpb9v/must-gather-sgktw"] Jul 20 16:18:56.825644 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:56.825274 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-rpb9v/must-gather-sgktw" podUID="9d63cd05-ab3f-4b3a-b3bb-77d778d8391b" containerName="copy" containerID="cri-o://af783a1c6e26d423ee68a7e12ad10b86cbdd6772c051220327a016e38aa2952e" gracePeriod=2 Jul 20 16:18:56.826625 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:56.826595 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-rpb9v/must-gather-sgktw"] Jul 20 16:18:56.827630 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:18:56.827597 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-sgktw\" is forbidden: User \"system:node:ip-10-0-138-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rpb9v\": no relationship found between node 'ip-10-0-138-156.ec2.internal' and this object" podUID="9d63cd05-ab3f-4b3a-b3bb-77d778d8391b" pod="openshift-must-gather-rpb9v/must-gather-sgktw" Jul 20 16:18:57.055368 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.055348 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-rpb9v_must-gather-sgktw_9d63cd05-ab3f-4b3a-b3bb-77d778d8391b/copy/0.log" Jul 20 16:18:57.056890 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.056876 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rpb9v/must-gather-sgktw" Jul 20 16:18:57.059203 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:18:57.059177 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-sgktw\" is forbidden: User \"system:node:ip-10-0-138-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rpb9v\": no relationship found between node 'ip-10-0-138-156.ec2.internal' and this object" podUID="9d63cd05-ab3f-4b3a-b3bb-77d778d8391b" pod="openshift-must-gather-rpb9v/must-gather-sgktw" Jul 20 16:18:57.184044 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.184021 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pbwg\" (UniqueName: \"kubernetes.io/projected/9d63cd05-ab3f-4b3a-b3bb-77d778d8391b-kube-api-access-2pbwg\") pod \"9d63cd05-ab3f-4b3a-b3bb-77d778d8391b\" (UID: \"9d63cd05-ab3f-4b3a-b3bb-77d778d8391b\") " Jul 20 16:18:57.184220 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.184133 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9d63cd05-ab3f-4b3a-b3bb-77d778d8391b-must-gather-output\") pod \"9d63cd05-ab3f-4b3a-b3bb-77d778d8391b\" (UID: \"9d63cd05-ab3f-4b3a-b3bb-77d778d8391b\") " Jul 20 16:18:57.185304 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.185273 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d63cd05-ab3f-4b3a-b3bb-77d778d8391b-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "9d63cd05-ab3f-4b3a-b3bb-77d778d8391b" (UID: "9d63cd05-ab3f-4b3a-b3bb-77d778d8391b"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 16:18:57.186141 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.186121 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d63cd05-ab3f-4b3a-b3bb-77d778d8391b-kube-api-access-2pbwg" (OuterVolumeSpecName: "kube-api-access-2pbwg") pod "9d63cd05-ab3f-4b3a-b3bb-77d778d8391b" (UID: "9d63cd05-ab3f-4b3a-b3bb-77d778d8391b"). InnerVolumeSpecName "kube-api-access-2pbwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 16:18:57.285370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.285341 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pbwg\" (UniqueName: \"kubernetes.io/projected/9d63cd05-ab3f-4b3a-b3bb-77d778d8391b-kube-api-access-2pbwg\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:18:57.285370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.285369 2569 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9d63cd05-ab3f-4b3a-b3bb-77d778d8391b-must-gather-output\") on node \"ip-10-0-138-156.ec2.internal\" DevicePath \"\"" Jul 20 16:18:57.456447 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.456362 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:18:57.557444 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.557410 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:18:57.674441 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.674415 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-rpb9v_must-gather-sgktw_9d63cd05-ab3f-4b3a-b3bb-77d778d8391b/copy/0.log" Jul 20 16:18:57.674822 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.674795 2569 generic.go:356] "Generic (PLEG): container finished" podID="9d63cd05-ab3f-4b3a-b3bb-77d778d8391b" containerID="af783a1c6e26d423ee68a7e12ad10b86cbdd6772c051220327a016e38aa2952e" exitCode=143 Jul 20 16:18:57.674898 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.674843 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rpb9v/must-gather-sgktw" Jul 20 16:18:57.674898 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.674891 2569 scope.go:117] "RemoveContainer" containerID="af783a1c6e26d423ee68a7e12ad10b86cbdd6772c051220327a016e38aa2952e" Jul 20 16:18:57.677351 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:18:57.677323 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-sgktw\" is forbidden: User \"system:node:ip-10-0-138-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rpb9v\": no relationship found between node 'ip-10-0-138-156.ec2.internal' and this object" podUID="9d63cd05-ab3f-4b3a-b3bb-77d778d8391b" pod="openshift-must-gather-rpb9v/must-gather-sgktw" Jul 20 16:18:57.683585 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.683571 2569 scope.go:117] "RemoveContainer" containerID="2b56d2df00dfc81888e17753d2d3871c55636a7a1bc383b69bd57439dd5d0cb2" Jul 20 16:18:57.685578 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:18:57.685554 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-sgktw\" is forbidden: User \"system:node:ip-10-0-138-156.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rpb9v\": no relationship found between node 'ip-10-0-138-156.ec2.internal' and this object" podUID="9d63cd05-ab3f-4b3a-b3bb-77d778d8391b" pod="openshift-must-gather-rpb9v/must-gather-sgktw" Jul 20 16:18:57.695126 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.695109 2569 scope.go:117] "RemoveContainer" containerID="af783a1c6e26d423ee68a7e12ad10b86cbdd6772c051220327a016e38aa2952e" Jul 20 16:18:57.695425 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:18:57.695407 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af783a1c6e26d423ee68a7e12ad10b86cbdd6772c051220327a016e38aa2952e\": container with ID starting with af783a1c6e26d423ee68a7e12ad10b86cbdd6772c051220327a016e38aa2952e not found: ID does not exist" containerID="af783a1c6e26d423ee68a7e12ad10b86cbdd6772c051220327a016e38aa2952e" Jul 20 16:18:57.695476 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.695433 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af783a1c6e26d423ee68a7e12ad10b86cbdd6772c051220327a016e38aa2952e"} err="failed to get container status \"af783a1c6e26d423ee68a7e12ad10b86cbdd6772c051220327a016e38aa2952e\": rpc error: code = NotFound desc = could not find container \"af783a1c6e26d423ee68a7e12ad10b86cbdd6772c051220327a016e38aa2952e\": container with ID starting with af783a1c6e26d423ee68a7e12ad10b86cbdd6772c051220327a016e38aa2952e not found: ID does not exist" Jul 20 16:18:57.695476 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.695451 2569 scope.go:117] "RemoveContainer" containerID="2b56d2df00dfc81888e17753d2d3871c55636a7a1bc383b69bd57439dd5d0cb2" Jul 20 16:18:57.695708 ip-10-0-138-156 kubenswrapper[2569]: E0720 16:18:57.695686 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b56d2df00dfc81888e17753d2d3871c55636a7a1bc383b69bd57439dd5d0cb2\": container with ID starting with 2b56d2df00dfc81888e17753d2d3871c55636a7a1bc383b69bd57439dd5d0cb2 not found: ID does not exist" containerID="2b56d2df00dfc81888e17753d2d3871c55636a7a1bc383b69bd57439dd5d0cb2" Jul 20 16:18:57.695752 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:57.695714 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b56d2df00dfc81888e17753d2d3871c55636a7a1bc383b69bd57439dd5d0cb2"} err="failed to get container status \"2b56d2df00dfc81888e17753d2d3871c55636a7a1bc383b69bd57439dd5d0cb2\": rpc error: code = NotFound desc = could not find container \"2b56d2df00dfc81888e17753d2d3871c55636a7a1bc383b69bd57439dd5d0cb2\": container with ID starting with 2b56d2df00dfc81888e17753d2d3871c55636a7a1bc383b69bd57439dd5d0cb2 not found: ID does not exist" Jul 20 16:18:58.044507 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:58.044479 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d63cd05-ab3f-4b3a-b3bb-77d778d8391b" path="/var/lib/kubelet/pods/9d63cd05-ab3f-4b3a-b3bb-77d778d8391b/volumes" Jul 20 16:18:58.823439 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:58.823392 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101/alertmanager/0.log" Jul 20 16:18:58.847554 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:58.847534 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101/config-reloader/0.log" Jul 20 16:18:58.873457 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:58.873437 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101/kube-rbac-proxy-web/0.log" Jul 20 16:18:58.895626 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:58.895595 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101/kube-rbac-proxy/0.log" Jul 20 16:18:58.919268 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:58.919247 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101/kube-rbac-proxy-metric/0.log" Jul 20 16:18:58.943965 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:58.943938 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101/prom-label-proxy/0.log" Jul 20 16:18:58.972055 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:58.972022 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7efd6dbd-1f57-4bc8-93d5-bf3cafcb3101/init-config-reloader/0.log" Jul 20 16:18:59.034103 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.034054 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-bp5ll_59b1d78a-f8ff-428e-a304-57f3fb9f320f/kube-state-metrics/0.log" Jul 20 16:18:59.054996 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.054976 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-bp5ll_59b1d78a-f8ff-428e-a304-57f3fb9f320f/kube-rbac-proxy-main/0.log" Jul 20 16:18:59.075327 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.075267 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-bp5ll_59b1d78a-f8ff-428e-a304-57f3fb9f320f/kube-rbac-proxy-self/0.log" Jul 20 16:18:59.109958 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.109935 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-64b98f67c8-8x5pg_639210ba-deb2-435d-b2fa-d1e519cc62d5/metrics-server/0.log" Jul 20 16:18:59.130931 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.130902 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-g9xwq_26392dce-f311-485e-b7b0-871bc9797a26/monitoring-plugin/0.log" Jul 20 16:18:59.161735 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.161716 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7wswx_532f72f2-1c23-4349-a854-f246a8c9a343/node-exporter/0.log" Jul 20 16:18:59.186122 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.186098 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7wswx_532f72f2-1c23-4349-a854-f246a8c9a343/kube-rbac-proxy/0.log" Jul 20 16:18:59.207226 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.207200 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7wswx_532f72f2-1c23-4349-a854-f246a8c9a343/init-textfile/0.log" Jul 20 16:18:59.424660 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.424633 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-xqhxh_17c3339c-dff7-4d9d-aa5b-5da1faf6f5be/kube-rbac-proxy-main/0.log" Jul 20 16:18:59.446956 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.446921 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-xqhxh_17c3339c-dff7-4d9d-aa5b-5da1faf6f5be/kube-rbac-proxy-self/0.log" Jul 20 16:18:59.467506 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.467481 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-xqhxh_17c3339c-dff7-4d9d-aa5b-5da1faf6f5be/openshift-state-metrics/0.log" Jul 20 16:18:59.506839 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.506814 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_596cdfa0-640f-4e56-85ff-4b4c83c6c558/prometheus/0.log" Jul 20 16:18:59.525927 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.525903 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_596cdfa0-640f-4e56-85ff-4b4c83c6c558/config-reloader/0.log" Jul 20 16:18:59.550533 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.550507 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_596cdfa0-640f-4e56-85ff-4b4c83c6c558/thanos-sidecar/0.log" Jul 20 16:18:59.570409 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.570388 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_596cdfa0-640f-4e56-85ff-4b4c83c6c558/kube-rbac-proxy-web/0.log" Jul 20 16:18:59.594109 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.594082 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_596cdfa0-640f-4e56-85ff-4b4c83c6c558/kube-rbac-proxy/0.log" Jul 20 16:18:59.614346 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.614324 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_596cdfa0-640f-4e56-85ff-4b4c83c6c558/kube-rbac-proxy-thanos/0.log" Jul 20 16:18:59.634881 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.634857 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_596cdfa0-640f-4e56-85ff-4b4c83c6c558/init-config-reloader/0.log" Jul 20 16:18:59.661017 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.660926 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-tq8wl_e017ebdb-ff50-4aa2-925b-91ec7dd188ab/prometheus-operator/0.log" Jul 20 16:18:59.679270 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.679226 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-tq8wl_e017ebdb-ff50-4aa2-925b-91ec7dd188ab/kube-rbac-proxy/0.log" Jul 20 16:18:59.702127 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.702067 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-dkmvc_b1a3a88a-96be-4d9b-a629-40cbd96b9c15/prometheus-operator-admission-webhook/0.log" Jul 20 16:18:59.734537 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.734504 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-585b6cb554-hrt5k_4abf73fd-672b-4e0f-b165-02c04e63ee6f/telemeter-client/0.log" Jul 20 16:18:59.763101 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.763071 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-585b6cb554-hrt5k_4abf73fd-672b-4e0f-b165-02c04e63ee6f/reload/0.log" Jul 20 16:18:59.787169 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.787141 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-585b6cb554-hrt5k_4abf73fd-672b-4e0f-b165-02c04e63ee6f/kube-rbac-proxy/0.log" Jul 20 16:18:59.816828 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.816804 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f7f9c89f-2tl8d_76c64832-22b5-48e5-a40d-17067c3f4c3c/thanos-query/0.log" Jul 20 16:18:59.836891 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.836865 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f7f9c89f-2tl8d_76c64832-22b5-48e5-a40d-17067c3f4c3c/kube-rbac-proxy-web/0.log" Jul 20 16:18:59.857749 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.857718 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f7f9c89f-2tl8d_76c64832-22b5-48e5-a40d-17067c3f4c3c/kube-rbac-proxy/0.log" Jul 20 16:18:59.879507 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.879484 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f7f9c89f-2tl8d_76c64832-22b5-48e5-a40d-17067c3f4c3c/prom-label-proxy/0.log" Jul 20 16:18:59.900117 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.900097 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f7f9c89f-2tl8d_76c64832-22b5-48e5-a40d-17067c3f4c3c/kube-rbac-proxy-rules/0.log" Jul 20 16:18:59.923221 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:18:59.923157 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f7f9c89f-2tl8d_76c64832-22b5-48e5-a40d-17067c3f4c3c/kube-rbac-proxy-metrics/0.log" Jul 20 16:19:02.631284 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.631250 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8"] Jul 20 16:19:02.631671 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.631592 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d63cd05-ab3f-4b3a-b3bb-77d778d8391b" containerName="gather" Jul 20 16:19:02.631671 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.631603 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d63cd05-ab3f-4b3a-b3bb-77d778d8391b" containerName="gather" Jul 20 16:19:02.631671 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.631628 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d63cd05-ab3f-4b3a-b3bb-77d778d8391b" containerName="copy" Jul 20 16:19:02.631671 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.631633 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d63cd05-ab3f-4b3a-b3bb-77d778d8391b" containerName="copy" Jul 20 16:19:02.631808 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.631687 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d63cd05-ab3f-4b3a-b3bb-77d778d8391b" containerName="gather" Jul 20 16:19:02.631808 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.631694 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d63cd05-ab3f-4b3a-b3bb-77d778d8391b" containerName="copy" Jul 20 16:19:02.635395 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.635379 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:02.638585 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.638557 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qvk2v\"/\"openshift-service-ca.crt\"" Jul 20 16:19:02.638746 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.638665 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qvk2v\"/\"default-dockercfg-4hh94\"" Jul 20 16:19:02.638746 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.638697 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qvk2v\"/\"kube-root-ca.crt\"" Jul 20 16:19:02.644400 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.644369 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8"] Jul 20 16:19:02.730809 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.730764 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eceb0018-bfe2-4057-aff3-51ad0d68e6e5-proc\") pod \"perf-node-gather-daemonset-2jvv8\" (UID: \"eceb0018-bfe2-4057-aff3-51ad0d68e6e5\") " pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:02.730997 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.730817 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eceb0018-bfe2-4057-aff3-51ad0d68e6e5-lib-modules\") pod \"perf-node-gather-daemonset-2jvv8\" (UID: \"eceb0018-bfe2-4057-aff3-51ad0d68e6e5\") " pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:02.730997 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.730885 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eceb0018-bfe2-4057-aff3-51ad0d68e6e5-sys\") pod \"perf-node-gather-daemonset-2jvv8\" (UID: \"eceb0018-bfe2-4057-aff3-51ad0d68e6e5\") " pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:02.730997 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.730926 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eceb0018-bfe2-4057-aff3-51ad0d68e6e5-podres\") pod \"perf-node-gather-daemonset-2jvv8\" (UID: \"eceb0018-bfe2-4057-aff3-51ad0d68e6e5\") " pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:02.730997 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.730981 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k82th\" (UniqueName: \"kubernetes.io/projected/eceb0018-bfe2-4057-aff3-51ad0d68e6e5-kube-api-access-k82th\") pod \"perf-node-gather-daemonset-2jvv8\" (UID: \"eceb0018-bfe2-4057-aff3-51ad0d68e6e5\") " pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:02.831866 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.831838 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eceb0018-bfe2-4057-aff3-51ad0d68e6e5-proc\") pod \"perf-node-gather-daemonset-2jvv8\" (UID: \"eceb0018-bfe2-4057-aff3-51ad0d68e6e5\") " pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:02.831999 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.831878 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eceb0018-bfe2-4057-aff3-51ad0d68e6e5-lib-modules\") pod \"perf-node-gather-daemonset-2jvv8\" (UID: \"eceb0018-bfe2-4057-aff3-51ad0d68e6e5\") " pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:02.831999 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.831902 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eceb0018-bfe2-4057-aff3-51ad0d68e6e5-sys\") pod \"perf-node-gather-daemonset-2jvv8\" (UID: \"eceb0018-bfe2-4057-aff3-51ad0d68e6e5\") " pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:02.831999 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.831922 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eceb0018-bfe2-4057-aff3-51ad0d68e6e5-podres\") pod \"perf-node-gather-daemonset-2jvv8\" (UID: \"eceb0018-bfe2-4057-aff3-51ad0d68e6e5\") " pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:02.831999 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.831960 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k82th\" (UniqueName: \"kubernetes.io/projected/eceb0018-bfe2-4057-aff3-51ad0d68e6e5-kube-api-access-k82th\") pod \"perf-node-gather-daemonset-2jvv8\" (UID: \"eceb0018-bfe2-4057-aff3-51ad0d68e6e5\") " pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:02.831999 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.831971 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eceb0018-bfe2-4057-aff3-51ad0d68e6e5-proc\") pod \"perf-node-gather-daemonset-2jvv8\" (UID: \"eceb0018-bfe2-4057-aff3-51ad0d68e6e5\") " pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:02.831999 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.831984 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eceb0018-bfe2-4057-aff3-51ad0d68e6e5-sys\") pod \"perf-node-gather-daemonset-2jvv8\" (UID: \"eceb0018-bfe2-4057-aff3-51ad0d68e6e5\") " pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:02.832305 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.832020 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eceb0018-bfe2-4057-aff3-51ad0d68e6e5-lib-modules\") pod \"perf-node-gather-daemonset-2jvv8\" (UID: \"eceb0018-bfe2-4057-aff3-51ad0d68e6e5\") " pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:02.832305 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.832085 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eceb0018-bfe2-4057-aff3-51ad0d68e6e5-podres\") pod \"perf-node-gather-daemonset-2jvv8\" (UID: \"eceb0018-bfe2-4057-aff3-51ad0d68e6e5\") " pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:02.840176 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.840157 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k82th\" (UniqueName: \"kubernetes.io/projected/eceb0018-bfe2-4057-aff3-51ad0d68e6e5-kube-api-access-k82th\") pod \"perf-node-gather-daemonset-2jvv8\" (UID: \"eceb0018-bfe2-4057-aff3-51ad0d68e6e5\") " pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:02.946418 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:02.946342 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:03.078511 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:03.078489 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8"] Jul 20 16:19:03.080830 ip-10-0-138-156 kubenswrapper[2569]: W0720 16:19:03.080808 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podeceb0018_bfe2_4057_aff3_51ad0d68e6e5.slice/crio-e10bfa226b622e6c619bc45213071f72af5445e738e67fa6db65711fef521d76 WatchSource:0}: Error finding container e10bfa226b622e6c619bc45213071f72af5445e738e67fa6db65711fef521d76: Status 404 returned error can't find the container with id e10bfa226b622e6c619bc45213071f72af5445e738e67fa6db65711fef521d76 Jul 20 16:19:03.403612 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:03.403581 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lc4ht_e067d9c1-b358-4fc6-a1ca-a274208f01da/dns/0.log" Jul 20 16:19:03.425505 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:03.425484 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lc4ht_e067d9c1-b358-4fc6-a1ca-a274208f01da/kube-rbac-proxy/0.log" Jul 20 16:19:03.494043 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:03.494020 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4t89d_87285192-3790-4b9e-bd2b-dbec974fe2d4/dns-node-resolver/0.log" Jul 20 16:19:03.702577 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:03.702490 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" event={"ID":"eceb0018-bfe2-4057-aff3-51ad0d68e6e5","Type":"ContainerStarted","Data":"c2528a6eaf4e6f0ba8b557f3f1c67d90a7bbf81a85f12dc03b4282ec7c54a21f"} Jul 20 16:19:03.702577 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:03.702547 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" event={"ID":"eceb0018-bfe2-4057-aff3-51ad0d68e6e5","Type":"ContainerStarted","Data":"e10bfa226b622e6c619bc45213071f72af5445e738e67fa6db65711fef521d76"} Jul 20 16:19:03.703020 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:03.702623 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:03.718799 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:03.718750 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" podStartSLOduration=1.71873524 podStartE2EDuration="1.71873524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:19:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:19:03.717363735 +0000 UTC m=+574.266663036" watchObservedRunningTime="2026-07-20 16:19:03.71873524 +0000 UTC m=+574.268034536" Jul 20 16:19:03.944080 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:03.944055 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p8s8r_285af9dc-62d9-4bd9-858c-9d8ccfcea829/node-ca/0.log" Jul 20 16:19:05.017662 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:05.017630 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7fz44_bf72da65-d94d-43d6-a122-d5a372ead7b5/serve-healthcheck-canary/0.log" Jul 20 16:19:05.371866 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:05.371840 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5w42m_03a5a004-f663-40e4-b550-7a2adefefc49/kube-rbac-proxy/0.log" Jul 20 16:19:05.390601 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:05.390580 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5w42m_03a5a004-f663-40e4-b550-7a2adefefc49/exporter/0.log" Jul 20 16:19:05.410834 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:05.410810 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5w42m_03a5a004-f663-40e4-b550-7a2adefefc49/extractor/0.log" Jul 20 16:19:07.107573 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:07.107539 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-58nxd_dca9d5b7-8969-459f-b955-a52d405aaf2f/jobset-operator/0.log" Jul 20 16:19:09.716432 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:09.716402 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qvk2v/perf-node-gather-daemonset-2jvv8" Jul 20 16:19:10.659174 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:10.659135 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6c2ms_e8cd0d1d-b1b3-4420-9430-667b02723ae5/konnectivity-agent/0.log" limit=1024 Jul 20 16:19:11.458068 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:11.457986 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpvnh_e8dc04f1-d7ca-4632-98a7-086b49b0513a/kube-multus-additional-cni-plugins/0.log" Jul 20 16:19:11.479150 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:11.479113 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpvnh_e8dc04f1-d7ca-4632-98a7-086b49b0513a/egress-router-binary-copy/0.log" Jul 20 16:19:11.501951 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:11.501921 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpvnh_e8dc04f1-d7ca-4632-98a7-086b49b0513a/cni-plugins/0.log" Jul 20 16:19:11.528719 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:11.528692 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpvnh_e8dc04f1-d7ca-4632-98a7-086b49b0513a/bond-cni-plugin/0.log" Jul 20 16:19:11.552055 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:11.552025 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpvnh_e8dc04f1-d7ca-4632-98a7-086b49b0513a/routeoverride-cni/0.log" Jul 20 16:19:11.573323 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:11.573302 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpvnh_e8dc04f1-d7ca-4632-98a7-086b49b0513a/whereabouts-cni-bincopy/0.log" Jul 20 16:19:11.593186 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:11.593162 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fpvnh_e8dc04f1-d7ca-4632-98a7-086b49b0513a/whereabouts-cni/0.log" Jul 20 16:19:11.790025 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:11.789990 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cj8gg_4c29c040-f0ab-430a-9996-4ea896634f6f/kube-multus/0.log" Jul 20 16:19:11.890914 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:11.890885 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fzrbx_586b30af-aafe-48c8-a1c9-cd97c9bcbeb7/network-metrics-daemon/0.log" Jul 20 16:19:11.909814 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:11.909792 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fzrbx_586b30af-aafe-48c8-a1c9-cd97c9bcbeb7/kube-rbac-proxy/0.log" Jul 20 16:19:12.849370 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:12.849338 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5x9t_e49166de-d769-4f5b-8829-46cd62bd63dc/ovn-controller/0.log" Jul 20 16:19:12.866537 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:12.866512 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5x9t_e49166de-d769-4f5b-8829-46cd62bd63dc/ovn-acl-logging/0.log" Jul 20 16:19:12.890663 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:12.890635 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5x9t_e49166de-d769-4f5b-8829-46cd62bd63dc/kube-rbac-proxy-node/0.log" Jul 20 16:19:12.914875 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:12.914853 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5x9t_e49166de-d769-4f5b-8829-46cd62bd63dc/kube-rbac-proxy-ovn-metrics/0.log" Jul 20 16:19:12.936487 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:12.936463 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5x9t_e49166de-d769-4f5b-8829-46cd62bd63dc/northd/0.log" Jul 20 16:19:12.958864 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:12.958837 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5x9t_e49166de-d769-4f5b-8829-46cd62bd63dc/nbdb/0.log" Jul 20 16:19:12.983161 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:12.983138 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5x9t_e49166de-d769-4f5b-8829-46cd62bd63dc/sbdb/0.log" Jul 20 16:19:13.038274 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:13.038243 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j5x9t_e49166de-d769-4f5b-8829-46cd62bd63dc/ovnkube-controller/0.log" Jul 20 16:19:14.327635 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:14.327604 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-62crl_3f2af8e3-e9b2-492d-9b37-351d28c756a6/network-check-target-container/0.log" Jul 20 16:19:15.223907 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:15.223883 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-f96wb_7f8eb516-d99a-4adf-afdd-10ea8779634a/iptables-alerter/0.log" Jul 20 16:19:15.807947 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:15.807914 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-ppzkq_ce16b1f2-4958-479c-b384-29b4d141a0ba/tuned/0.log" Jul 20 16:19:19.118082 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:19.118055 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-c2qdv_16873ea8-9a09-40e6-b5fd-324b65fe693b/csi-driver/0.log" Jul 20 16:19:19.138337 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:19.138311 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-c2qdv_16873ea8-9a09-40e6-b5fd-324b65fe693b/csi-node-driver-registrar/0.log" Jul 20 16:19:19.163177 ip-10-0-138-156 kubenswrapper[2569]: I0720 16:19:19.163153 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-c2qdv_16873ea8-9a09-40e6-b5fd-324b65fe693b/csi-liveness-probe/0.log"