Sep 10 12:07:11.384370 ip-10-0-142-28 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 10 12:07:11.384381 ip-10-0-142-28 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 10 12:07:11.384388 ip-10-0-142-28 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 10 12:07:11.384548 ip-10-0-142-28 systemd[1]: Failed to start Kubernetes Kubelet. Sep 10 12:07:22.806549 ip-10-0-142-28 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 10 12:07:22.806566 ip-10-0-142-28 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5d9d8531fcb44ec48af85244bf169b85 -- Sep 10 12:09:26.434384 ip-10-0-142-28 systemd[1]: Starting Kubernetes Kubelet... Sep 10 12:09:26.873329 ip-10-0-142-28 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:09:26.873329 ip-10-0-142-28 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 12:09:26.873329 ip-10-0-142-28 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:09:26.873329 ip-10-0-142-28 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 12:09:26.873329 ip-10-0-142-28 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:09:26.875525 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.875438 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 12:09:26.880744 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880728 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:09:26.880744 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880744 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880748 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880752 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880755 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880758 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880761 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880764 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880767 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880770 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880773 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880776 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880779 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880781 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880784 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880787 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880789 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880792 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880796 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880799 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:09:26.880809 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880802 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880805 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880808 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880811 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880814 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880817 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880819 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880823 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880826 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880828 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880831 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880833 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880836 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880839 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880841 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880844 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880850 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880853 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880857 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:09:26.881282 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880861 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880864 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880867 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880870 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880873 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880875 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880878 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880881 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880884 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880886 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880889 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880892 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880895 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880898 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880901 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880904 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880906 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880909 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880912 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880915 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:09:26.881743 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880917 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880920 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880923 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880925 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880928 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880931 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880934 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880936 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880939 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880941 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880944 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880947 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880950 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880954 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880956 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880959 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880962 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880964 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880967 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:09:26.882333 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880970 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880972 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880975 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880978 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880982 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880984 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880987 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880990 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880993 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880995 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.880998 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881001 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881005 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881009 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881012 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881014 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881017 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881020 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881022 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881025 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:09:26.882804 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881028 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881732 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881739 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881742 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881745 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881748 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881751 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881754 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881757 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881760 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881763 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881766 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881769 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881772 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881774 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881777 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881780 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881783 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881786 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881789 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:09:26.883294 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881792 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881794 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881797 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881799 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881802 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881805 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881807 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881810 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881814 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881818 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881821 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881824 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881827 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881830 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881833 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881836 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881838 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881841 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881843 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:09:26.883846 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881846 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881850 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881853 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881857 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881860 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881863 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881865 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881868 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881871 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881873 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881877 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881879 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881882 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881885 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881887 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881890 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881892 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881896 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881898 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:09:26.884331 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881901 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881904 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881906 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881909 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881911 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881914 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881917 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881920 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881923 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881925 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881928 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881930 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881933 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881936 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881940 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881944 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881946 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881949 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881952 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881954 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:09:26.884808 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881957 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881960 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881963 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881966 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881969 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881971 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881974 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881977 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881980 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881983 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881985 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881988 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881991 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881994 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881996 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.881999 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.882001 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.882004 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.882007 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.882009 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:09:26.885325 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.882012 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.882016 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883060 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883079 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883083 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883086 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883092 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883096 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883099 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883102 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883106 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883108 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883111 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883114 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883117 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883119 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883122 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883125 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883128 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:09:26.885823 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883130 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883133 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883136 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883138 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883141 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883144 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883147 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883150 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883152 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883155 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883157 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883160 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883164 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883168 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883171 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883174 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883177 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883179 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883182 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:09:26.886299 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883186 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883190 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883194 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883197 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883199 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883202 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883204 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883207 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883210 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883212 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883215 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883217 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883220 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883223 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883225 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883228 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883230 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883234 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883236 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883239 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:09:26.886770 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883241 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883244 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883247 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883249 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883252 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883254 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883257 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883261 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883264 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883267 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883270 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883273 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883276 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883279 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883282 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883285 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883288 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883290 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883293 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883296 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:09:26.887273 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883299 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883303 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883305 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883308 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883311 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883314 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883316 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883319 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883321 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883324 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883326 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883329 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883331 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883334 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883337 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883339 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883342 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883344 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883347 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883349 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:09:26.887780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883352 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883354 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.883357 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883426 2555 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883460 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883468 2555 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883473 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883478 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883481 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883486 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883490 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883494 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883497 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883501 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883504 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883507 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883511 2555 flags.go:64] FLAG: --cgroup-root="" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883514 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883517 2555 flags.go:64] FLAG: --client-ca-file="" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883520 2555 flags.go:64] FLAG: --cloud-provider="external" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883523 2555 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883527 2555 flags.go:64] FLAG: --cluster-domain="" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883530 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 12:09:26.888290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883533 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883536 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883540 2555 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883544 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883547 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883550 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883553 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883556 2555 flags.go:64] FLAG: --contention-profiling="false" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883560 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883562 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883566 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883568 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883573 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883576 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883579 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883585 2555 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883588 2555 flags.go:64] FLAG: --enable-server="true" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883592 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883597 2555 flags.go:64] FLAG: --event-burst="100" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883600 2555 flags.go:64] FLAG: --event-qps="50" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883604 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883607 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883610 2555 flags.go:64] FLAG: --eviction-hard="" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883614 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 12:09:26.888881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883617 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883620 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883623 2555 flags.go:64] FLAG: --eviction-soft="" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883626 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883629 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883632 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883636 2555 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883639 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883642 2555 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883644 2555 flags.go:64] FLAG: --feature-gates="" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883648 2555 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883651 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883654 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883658 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883661 2555 flags.go:64] FLAG: --healthz-port="10248" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883664 2555 flags.go:64] FLAG: --help="false" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883667 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-142-28.ec2.internal" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883670 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883673 2555 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883676 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883680 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883684 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883687 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 12:09:26.889485 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883692 2555 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883695 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883698 2555 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883702 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883705 2555 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883708 2555 flags.go:64] FLAG: --kube-reserved="" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883711 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883714 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883717 2555 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883720 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883723 2555 flags.go:64] FLAG: --lock-file="" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883726 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883729 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883732 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883737 2555 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883740 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883743 2555 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883746 2555 flags.go:64] FLAG: --logging-format="text" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883749 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883752 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883756 2555 flags.go:64] FLAG: --manifest-url="" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883759 2555 flags.go:64] FLAG: --manifest-url-header="" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883763 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883767 2555 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883771 2555 flags.go:64] FLAG: --max-pods="110" Sep 10 12:09:26.890064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883774 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883777 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883780 2555 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883783 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883786 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883789 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883792 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883801 2555 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883804 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883807 2555 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883819 2555 flags.go:64] FLAG: --pod-cidr="" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883823 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883829 2555 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883832 2555 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883835 2555 flags.go:64] FLAG: --pods-per-core="0" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883838 2555 flags.go:64] FLAG: --port="10250" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883841 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883844 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-077ff0f4b1a1bc803" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883847 2555 flags.go:64] FLAG: --qos-reserved="" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883851 2555 flags.go:64] FLAG: --read-only-port="10255" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883854 2555 flags.go:64] FLAG: --register-node="true" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883857 2555 flags.go:64] FLAG: --register-with-taints="" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883861 2555 flags.go:64] FLAG: --registry-burst="10" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883864 2555 flags.go:64] FLAG: --registry-qps="5" Sep 10 12:09:26.890691 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883867 2555 flags.go:64] FLAG: --reserved-cpus="" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883871 2555 flags.go:64] FLAG: --reserved-memory="" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883875 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883878 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883881 2555 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883884 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883887 2555 flags.go:64] FLAG: --runonce="false" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883890 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883893 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883896 2555 flags.go:64] FLAG: --seccomp-default="false" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883899 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883902 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883905 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883908 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883911 2555 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883915 2555 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883919 2555 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883922 2555 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883925 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883928 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883932 2555 flags.go:64] FLAG: --system-cgroups="" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883935 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883940 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883943 2555 flags.go:64] FLAG: --tls-cert-file="" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883946 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 12:09:26.891307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883950 2555 flags.go:64] FLAG: --tls-min-version="" Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883952 2555 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883956 2555 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883959 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883962 2555 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883965 2555 flags.go:64] FLAG: --v="2" Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883969 2555 flags.go:64] FLAG: --version="false" Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883973 2555 flags.go:64] FLAG: --vmodule="" Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883979 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.883982 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884108 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884113 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884118 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884121 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884123 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884126 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884129 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884132 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884135 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884138 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884141 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884143 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:09:26.891917 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884146 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884150 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884153 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884156 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884160 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884162 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884167 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884170 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884173 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884176 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884179 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884182 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884185 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884188 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884191 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884194 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884197 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884200 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884204 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:09:26.892520 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884206 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884209 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884212 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884214 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884217 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884220 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884222 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884225 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884227 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884230 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884233 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884235 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884238 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884240 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884245 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884248 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884250 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884253 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884255 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884258 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:09:26.893002 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884261 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884264 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884266 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884269 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884272 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884274 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884277 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884280 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884282 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884285 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884288 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884292 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884295 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884297 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884300 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884303 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884305 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884308 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884310 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884313 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:09:26.893528 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884315 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884318 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884321 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884323 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884326 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884328 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884332 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884335 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884338 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884340 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884343 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884346 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884349 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884352 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884354 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884357 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884360 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884362 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884365 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884367 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:09:26.894271 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884370 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:09:26.895005 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884374 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:09:26.895005 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884378 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:09:26.895005 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884382 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:09:26.895005 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884385 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:09:26.895005 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884388 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:09:26.895005 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884391 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:09:26.895005 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.884394 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:09:26.895005 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.884923 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:09:26.895005 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.892535 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 12:09:26.895005 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.892555 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 12:09:26.895005 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.893384 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 12:09:26.895005 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.893391 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 12:09:26.895005 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893466 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:09:26.895005 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893471 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893475 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893478 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893481 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893484 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893487 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893489 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893493 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893496 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893499 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893501 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893504 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893507 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893509 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893512 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893514 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893517 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893521 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893525 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:09:26.895388 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893528 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893531 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893534 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893537 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893540 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893543 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893545 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893548 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893551 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893606 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893908 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893915 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893921 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893926 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893931 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893936 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893940 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893945 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893950 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893954 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:09:26.895875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893959 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893972 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893976 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893981 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893986 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893991 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.893996 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894000 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894004 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894009 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894013 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894017 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894024 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894035 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894040 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894045 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894050 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894055 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894061 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:09:26.896424 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894081 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894087 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894093 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894125 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894130 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894135 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894140 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894149 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894153 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894158 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894162 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894167 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894171 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894175 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894180 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894184 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894188 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894192 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894196 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894206 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:09:26.896891 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894210 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894214 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894219 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894223 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894227 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894232 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894237 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894241 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894246 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894250 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894254 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894259 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894268 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894272 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894276 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894281 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894309 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894314 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894318 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:09:26.897547 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894322 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:09:26.898018 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.894331 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:09:26.898018 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894881 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:09:26.898018 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894891 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:09:26.898018 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894895 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:09:26.898018 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894898 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:09:26.898018 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894904 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:09:26.898018 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894908 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:09:26.898018 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894911 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:09:26.898018 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894914 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:09:26.898018 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894917 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:09:26.898018 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.894920 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:09:26.898018 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895013 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:09:26.898018 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895039 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:09:26.898018 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895047 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895173 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895185 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895190 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895195 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895199 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895204 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895208 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895212 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895216 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895220 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895225 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895229 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895233 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895237 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895241 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895245 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895249 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895253 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895258 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:09:26.898380 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895263 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895267 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895271 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895275 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895279 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895283 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895287 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895291 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895295 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895299 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895305 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895309 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895313 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895317 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895322 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895326 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895330 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895334 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895338 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895342 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:09:26.898863 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895349 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895357 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895362 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895366 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895370 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895379 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895384 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895389 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895395 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895401 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895408 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895412 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895417 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895422 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895427 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895431 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895434 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895437 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895440 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:09:26.899373 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895443 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895446 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895449 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895452 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895455 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895458 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895461 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895464 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895467 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895470 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895473 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895476 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895478 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895481 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895484 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895488 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895492 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895496 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895499 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895501 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:09:26.899869 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895504 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:09:26.900394 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895507 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:09:26.900394 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895510 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:09:26.900394 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895513 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:09:26.900394 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895516 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:09:26.900394 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895519 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:09:26.900394 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895522 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:09:26.900394 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:26.895524 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:09:26.900394 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.895531 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:09:26.900394 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.895646 2555 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 12:09:26.900394 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.899945 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 12:09:26.901426 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.901413 2555 server.go:1019] "Starting client certificate rotation" Sep 10 12:09:26.901534 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.901520 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 12:09:26.901569 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.901558 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 12:09:26.904508 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.904488 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 12:09:26.909026 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.909009 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 12:09:26.921052 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.921035 2555 log.go:25] "Validated CRI v1 runtime API" Sep 10 12:09:26.923861 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.923847 2555 log.go:25] "Validated CRI v1 image API" Sep 10 12:09:26.924748 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.924729 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 12:09:26.927173 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.927153 2555 fs.go:135] Filesystem UUIDs: map[04ab5347-2092-475c-af98-ce3f0c11ff8b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cb28fa64-c12f-4273-996c-da75bc393a01:/dev/nvme0n1p3] Sep 10 12:09:26.927247 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.927170 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 12:09:26.933712 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.933695 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 12:09:26.934328 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.934220 2555 manager.go:216] Machine: {Timestamp:2026-09-10 12:09:26.932512845 +0000 UTC m=+0.372401089 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088520 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f1a190b99818ba6c524547a5f6922 SystemUUID:ec2f1a19-0b99-818b-a6c5-24547a5f6922 BootID:5d9d8531-fcb4-4ec4-8af8-5244bf169b85 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:31:8a:65:b6:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:31:8a:65:b6:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:c9:85:31:4c:b0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 12:09:26.934328 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.934328 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 12:09:26.934427 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.934413 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 12:09:26.938273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.938231 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 12:09:26.938448 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.938278 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-28.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 12:09:26.940103 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.940090 2555 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 12:09:26.940171 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.940109 2555 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 12:09:26.940171 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.940121 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 12:09:26.941153 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.941141 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 12:09:26.941964 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.941952 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 12:09:26.945106 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.945092 2555 state_mem.go:36] "Initialized new in-memory state store" Sep 10 12:09:26.945252 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.945241 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 12:09:26.945310 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.945299 2555 kubelet.go:486] "Attempting to sync node with API server" Sep 10 12:09:26.945356 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.945320 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 12:09:26.945356 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.945336 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 12:09:26.945356 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.945354 2555 kubelet.go:398] "Adding apiserver pod source" Sep 10 12:09:26.945482 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.945367 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 12:09:26.945852 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.945837 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 12:09:26.945910 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.945869 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 12:09:26.950060 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.949929 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 12:09:26.952380 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.952365 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 12:09:26.952441 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.952396 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 12:09:26.954141 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.954127 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 12:09:26.954193 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.954149 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 12:09:26.954193 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.954156 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 12:09:26.954193 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.954161 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 12:09:26.954193 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.954169 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 12:09:26.954193 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.954175 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 12:09:26.954193 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.954188 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 12:09:26.954193 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.954193 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 12:09:26.954398 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.954200 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 12:09:26.954398 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.954205 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 12:09:26.954398 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.954217 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 12:09:26.954398 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.954222 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 12:09:26.955498 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:26.955476 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 12:09:26.955558 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:26.955503 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 12:09:26.955891 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.955880 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 12:09:26.955926 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.955891 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 12:09:26.959958 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.959946 2555 server.go:1268] "Started kubelet" Sep 10 12:09:26.960094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.960050 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 12:09:26.960154 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.960064 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 12:09:26.960154 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.960146 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 12:09:26.960614 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.960596 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2tbmx" Sep 10 12:09:26.960981 ip-10-0-142-28 systemd[1]: Started Kubernetes Kubelet. Sep 10 12:09:26.961954 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.961937 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 12:09:26.963087 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.963060 2555 server.go:310] "Adding debug handlers to kubelet server" Sep 10 12:09:26.964054 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:26.964029 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 12:09:26.966528 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.966511 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 12:09:26.967096 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.967063 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 12:09:26.967186 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.967109 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2tbmx" Sep 10 12:09:26.967315 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:26.967283 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-28.ec2.internal\" not found" Sep 10 12:09:26.967881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.967861 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 12:09:26.967881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.967882 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 12:09:26.968034 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.967955 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-28.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 12:09:26.968034 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.967963 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 12:09:26.968164 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.968035 2555 reconstruct.go:97] "Volume reconstruction finished" Sep 10 12:09:26.968164 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.968043 2555 reconciler.go:29] "Reconciler: start to sync state" Sep 10 12:09:26.968396 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.968378 2555 factory.go:55] Registering systemd factory Sep 10 12:09:26.968396 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.968396 2555 factory.go:223] Registration of the systemd container factory successfully Sep 10 12:09:26.968632 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.968615 2555 factory.go:153] Registering CRI-O factory Sep 10 12:09:26.968687 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.968649 2555 factory.go:223] Registration of the crio container factory successfully Sep 10 12:09:26.968722 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.968691 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 12:09:26.968722 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.968704 2555 factory.go:103] Registering Raw factory Sep 10 12:09:26.968722 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.968715 2555 manager.go:1196] Started watching for new ooms in manager Sep 10 12:09:26.969375 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:26.968391 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-28.ec2.internal.18d3f45f41d75152 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-28.ec2.internal,UID:ip-10-0-142-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-28.ec2.internal,},FirstTimestamp:2026-09-10 12:09:26.959919442 +0000 UTC m=+0.399807666,LastTimestamp:2026-09-10 12:09:26.959919442 +0000 UTC m=+0.399807666,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-28.ec2.internal,}" Sep 10 12:09:26.969518 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.969505 2555 manager.go:349] Starting recovery of all containers Sep 10 12:09:26.976367 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.976345 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:09:26.979061 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:26.978973 2555 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-28.ec2.internal\" not found" node="ip-10-0-142-28.ec2.internal" Sep 10 12:09:26.983872 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.983688 2555 manager.go:354] Recovery completed Sep 10 12:09:26.988303 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.988291 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:09:26.991136 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.991118 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:09:26.991210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.991152 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:09:26.991210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.991167 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:09:26.991805 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.991788 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 12:09:26.991805 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.991802 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:09:26.991929 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.991805 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 12:09:26.991929 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.991836 2555 state_mem.go:36] "Initialized new in-memory state store" Sep 10 12:09:26.992506 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.992491 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:09:26.992574 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.992530 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:09:26.992574 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.992545 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:09:26.993483 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.993468 2555 policy_none.go:49] "None policy: Start" Sep 10 12:09:26.993538 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.993490 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 12:09:26.993538 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.993503 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 12:09:26.994774 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:26.994763 2555 policy_none.go:47] "Start" Sep 10 12:09:27.022859 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.022841 2555 manager.go:337] "Starting Device Plugin manager" Sep 10 12:09:27.038157 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:27.022884 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 12:09:27.038157 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.022897 2555 server.go:87] "Starting device plugin registration server" Sep 10 12:09:27.038157 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.023301 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 12:09:27.038157 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.023324 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 12:09:27.038157 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.023478 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 12:09:27.038157 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.023563 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 12:09:27.038157 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.023572 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 12:09:27.038157 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:27.024336 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 12:09:27.038157 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:27.024389 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-28.ec2.internal\" not found" Sep 10 12:09:27.106133 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.106088 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 12:09:27.107431 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.107408 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 12:09:27.107558 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.107480 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 12:09:27.107558 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.107523 2555 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 12:09:27.107660 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:27.107633 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 12:09:27.109538 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.109519 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:09:27.124197 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.124110 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:09:27.126885 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.126862 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:09:27.126998 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.126899 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:09:27.126998 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.126912 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:09:27.126998 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.126936 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.134979 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.134962 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.135029 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:27.134990 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-28.ec2.internal\": node \"ip-10-0-142-28.ec2.internal\" not found" Sep 10 12:09:27.154722 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:27.154694 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-28.ec2.internal\" not found" Sep 10 12:09:27.208325 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.208275 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-28.ec2.internal"] Sep 10 12:09:27.208500 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.208406 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:09:27.209821 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.209800 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:09:27.209942 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.209837 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:09:27.209942 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.209847 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:09:27.211239 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.211226 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:09:27.211352 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.211338 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.211399 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.211371 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:09:27.212315 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.212297 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:09:27.212432 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.212327 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:09:27.212432 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.212340 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:09:27.212432 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.212349 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:09:27.212432 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.212372 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:09:27.212432 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.212391 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:09:27.213578 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.213563 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.213667 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.213590 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:09:27.214326 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.214311 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:09:27.214387 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.214339 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:09:27.214387 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.214352 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:09:27.235677 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:27.235654 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-28.ec2.internal\" not found" node="ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.239667 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:27.239652 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-28.ec2.internal\" not found" node="ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.254813 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:27.254796 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-28.ec2.internal\" not found" Sep 10 12:09:27.269330 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.269310 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c2b7b4edc809446a4d71da960a89001f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal\" (UID: \"c2b7b4edc809446a4d71da960a89001f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.269411 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.269334 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2b7b4edc809446a4d71da960a89001f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal\" (UID: \"c2b7b4edc809446a4d71da960a89001f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.269411 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.269352 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/270566bf61107e37921a529016c765e7-config\") pod \"kube-apiserver-proxy-ip-10-0-142-28.ec2.internal\" (UID: \"270566bf61107e37921a529016c765e7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.355312 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:27.355282 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-28.ec2.internal\" not found" Sep 10 12:09:27.369600 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.369575 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c2b7b4edc809446a4d71da960a89001f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal\" (UID: \"c2b7b4edc809446a4d71da960a89001f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.369703 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.369603 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2b7b4edc809446a4d71da960a89001f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal\" (UID: \"c2b7b4edc809446a4d71da960a89001f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.369703 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.369621 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/270566bf61107e37921a529016c765e7-config\") pod \"kube-apiserver-proxy-ip-10-0-142-28.ec2.internal\" (UID: \"270566bf61107e37921a529016c765e7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.369703 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.369649 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/270566bf61107e37921a529016c765e7-config\") pod \"kube-apiserver-proxy-ip-10-0-142-28.ec2.internal\" (UID: \"270566bf61107e37921a529016c765e7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.369703 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.369675 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2b7b4edc809446a4d71da960a89001f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal\" (UID: \"c2b7b4edc809446a4d71da960a89001f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.369703 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.369674 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c2b7b4edc809446a4d71da960a89001f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal\" (UID: \"c2b7b4edc809446a4d71da960a89001f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.456118 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:27.456027 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-28.ec2.internal\" not found" Sep 10 12:09:27.539444 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.539405 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.542704 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.542676 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-28.ec2.internal" Sep 10 12:09:27.556683 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:27.556660 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-28.ec2.internal\" not found" Sep 10 12:09:27.660868 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:27.660816 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-28.ec2.internal\" not found" Sep 10 12:09:27.762341 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:27.762238 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-28.ec2.internal\" not found" Sep 10 12:09:27.833622 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.833593 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:09:27.863702 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:27.863670 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-28.ec2.internal\" not found" Sep 10 12:09:27.902019 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.901987 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 12:09:27.902482 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.902171 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 12:09:27.902482 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.902198 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 12:09:27.902482 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.902199 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 12:09:27.964721 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:27.964680 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-28.ec2.internal\" not found" Sep 10 12:09:27.971724 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.971682 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 12:04:27 +0000 UTC" deadline="2028-05-03 00:16:06.149530713 +0000 UTC" Sep 10 12:09:27.971724 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:27.971721 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14412h6m38.177813502s" Sep 10 12:09:28.065871 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:28.065789 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-28.ec2.internal\" not found" Sep 10 12:09:28.170188 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:28.170134 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-28.ec2.internal\" not found" Sep 10 12:09:28.250256 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.250224 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:09:28.268141 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.268112 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-28.ec2.internal" Sep 10 12:09:28.275870 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.275844 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 12:09:28.276996 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.276981 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal" Sep 10 12:09:28.286675 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.286656 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 12:09:28.464568 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:28.464536 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b7b4edc809446a4d71da960a89001f.slice/crio-496adf5071eccc01fb9bfc87df1686592797801f3d0b5393025799449e664a2d WatchSource:0}: Error finding container 496adf5071eccc01fb9bfc87df1686592797801f3d0b5393025799449e664a2d: Status 404 returned error can't find the container with id 496adf5071eccc01fb9bfc87df1686592797801f3d0b5393025799449e664a2d Sep 10 12:09:28.464790 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:28.464770 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270566bf61107e37921a529016c765e7.slice/crio-50399db3f69b7e67ead71a6316788e2da48bfc246c48906813f2c373011adcd5 WatchSource:0}: Error finding container 50399db3f69b7e67ead71a6316788e2da48bfc246c48906813f2c373011adcd5: Status 404 returned error can't find the container with id 50399db3f69b7e67ead71a6316788e2da48bfc246c48906813f2c373011adcd5 Sep 10 12:09:28.469902 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.469884 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:09:28.924372 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.924282 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:09:28.948833 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.948808 2555 apiserver.go:52] "Watching apiserver" Sep 10 12:09:28.959060 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.959029 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 12:09:28.960528 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.960501 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-wv4xx","kube-system/kube-apiserver-proxy-ip-10-0-142-28.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz","openshift-dns/node-resolver-znmg7","openshift-multus/multus-additional-cni-plugins-fh5k8","openshift-multus/multus-nxgbv","openshift-network-diagnostics/network-check-target-wkm26","openshift-cluster-node-tuning-operator/tuned-tlchb","openshift-image-registry/node-ca-k5r2r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal","openshift-multus/network-metrics-daemon-58d7t","openshift-network-operator/iptables-alerter-swhzw","openshift-ovn-kubernetes/ovnkube-node-49qv8","kube-system/global-pull-secret-syncer-xwkm4"] Sep 10 12:09:28.963018 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.962997 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:28.963166 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:28.963139 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:09:28.964380 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.964364 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.965561 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.965538 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:28.966749 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.966728 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-znmg7" Sep 10 12:09:28.966964 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.966944 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 12:09:28.967039 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.967020 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 12:09:28.967380 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.967363 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 12:09:28.967454 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.967441 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 12:09:28.967614 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.967526 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 12:09:28.967614 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.967363 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 12:09:28.967738 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.967663 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 12:09:28.967738 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.967727 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 12:09:28.967845 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.967767 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9568t\"" Sep 10 12:09:28.968110 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.968090 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 12:09:28.968334 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.968310 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:28.968452 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.968342 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 12:09:28.968793 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.968773 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jv4x5\"" Sep 10 12:09:28.969305 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.969287 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 12:09:28.969305 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.969293 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2g66l\"" Sep 10 12:09:28.969449 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.969317 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 12:09:28.969716 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.969701 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nxgbv" Sep 10 12:09:28.970393 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.970376 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 12:09:28.970474 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.970378 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2w9q5\"" Sep 10 12:09:28.970556 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.970540 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 12:09:28.970677 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.970647 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 12:09:28.970767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.970733 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 12:09:28.970821 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.970790 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 12:09:28.971237 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.971216 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k5r2r" Sep 10 12:09:28.971731 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.971713 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 12:09:28.971813 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.971796 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t5n45\"" Sep 10 12:09:28.972695 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.972675 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wv4xx" Sep 10 12:09:28.973415 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.973285 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 12:09:28.973573 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.973557 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 12:09:28.973676 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.973652 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fhx7m\"" Sep 10 12:09:28.973872 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.973823 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 12:09:28.973980 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.973961 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:28.974065 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:28.974043 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:09:28.974882 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.974861 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 12:09:28.974973 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.974958 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 12:09:28.975197 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.975176 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8rwkm\"" Sep 10 12:09:28.975539 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.975523 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:28.976853 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.976830 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 12:09:28.976931 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.976840 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:28.977018 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:28.976992 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:09:28.977464 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.977449 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5rb8z\"" Sep 10 12:09:28.977527 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.977452 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 12:09:28.977527 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.977498 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:09:28.978451 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.978433 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-swhzw" Sep 10 12:09:28.978760 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.978740 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.978826 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.978772 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-sys-fs\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:28.978826 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.978792 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-kubelet\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.978826 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.978816 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-etc-openvswitch\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.978969 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.978872 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-cni-netd\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.978969 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.978909 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:28.978969 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.978938 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-registration-dir\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:28.979102 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.978984 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7ng6\" (UniqueName: \"kubernetes.io/projected/1ecb68cc-bba4-4a6c-863f-5b946518e907-kube-api-access-d7ng6\") pod \"node-resolver-znmg7\" (UID: \"1ecb68cc-bba4-4a6c-863f-5b946518e907\") " pod="openshift-dns/node-resolver-znmg7" Sep 10 12:09:28.979102 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979022 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-run-netns\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.979102 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979052 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61bafc2e-da2c-4b35-8555-b19f06728459-system-cni-dir\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:28.979267 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979114 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-run-ovn-kubernetes\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.979267 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979139 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-socket-dir\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:28.979267 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979163 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-device-dir\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:28.979267 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979205 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ecb68cc-bba4-4a6c-863f-5b946518e907-hosts-file\") pod \"node-resolver-znmg7\" (UID: \"1ecb68cc-bba4-4a6c-863f-5b946518e907\") " pod="openshift-dns/node-resolver-znmg7" Sep 10 12:09:28.979267 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979238 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61bafc2e-da2c-4b35-8555-b19f06728459-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:28.979465 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979265 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4l4r\" (UniqueName: \"kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r\") pod \"network-check-target-wkm26\" (UID: \"1071b22c-5ab2-4e55-871c-05012ee83376\") " pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:28.979465 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979293 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-slash\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.979465 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979318 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-ovnkube-config\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.979465 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979360 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:28.979465 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979390 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bscn6\" (UniqueName: \"kubernetes.io/projected/7319176e-bc2d-45c3-8abe-34e928f9e0ee-kube-api-access-bscn6\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:28.979465 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979426 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksnnb\" (UniqueName: \"kubernetes.io/projected/61bafc2e-da2c-4b35-8555-b19f06728459-kube-api-access-ksnnb\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:28.979465 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979446 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-cni-bin\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.979764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979471 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-env-overrides\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.979764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979501 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-ovnkube-script-lib\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.979764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979536 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61bafc2e-da2c-4b35-8555-b19f06728459-cnibin\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:28.979764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979559 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61bafc2e-da2c-4b35-8555-b19f06728459-cni-binary-copy\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:28.979764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979587 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-log-socket\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.979764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979614 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-systemd-units\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.979764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979640 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-run-systemd\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.979764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979664 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-var-lib-openvswitch\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.979764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979687 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-ovn-node-metrics-cert\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.979764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979702 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7kwt\" (UniqueName: \"kubernetes.io/projected/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-kube-api-access-r7kwt\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.979764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979719 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61bafc2e-da2c-4b35-8555-b19f06728459-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:28.979764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979770 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ecb68cc-bba4-4a6c-863f-5b946518e907-tmp-dir\") pod \"node-resolver-znmg7\" (UID: \"1ecb68cc-bba4-4a6c-863f-5b946518e907\") " pod="openshift-dns/node-resolver-znmg7" Sep 10 12:09:28.980293 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979792 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61bafc2e-da2c-4b35-8555-b19f06728459-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:28.980293 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979815 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-run-ovn\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.980293 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979837 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-node-log\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.980293 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.979863 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-run-openvswitch\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:28.980856 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.980840 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 12:09:28.981287 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.981269 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8l6bw\"" Sep 10 12:09:28.981884 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.981863 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:09:28.981981 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.981912 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 12:09:28.999582 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:28.999552 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j9w5h" Sep 10 12:09:29.010715 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.010693 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j9w5h" Sep 10 12:09:29.069740 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.069704 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 12:09:29.080888 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.080861 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-cni-binary-copy\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.081039 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.080894 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pj88\" (UniqueName: \"kubernetes.io/projected/0f00f889-5c53-45e7-9b18-0d0f6cd156c2-kube-api-access-5pj88\") pod \"node-ca-k5r2r\" (UID: \"0f00f889-5c53-45e7-9b18-0d0f6cd156c2\") " pod="openshift-image-registry/node-ca-k5r2r" Sep 10 12:09:29.081039 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.080913 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-sysconfig\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.081039 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.080928 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-kubernetes\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.081039 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.080950 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-sysctl-conf\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.081039 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.080985 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-run-netns\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.081039 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081012 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61bafc2e-da2c-4b35-8555-b19f06728459-system-cni-dir\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:29.081039 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081030 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-multus-conf-dir\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.081381 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081047 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-sysctl-d\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.081381 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081063 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-run-ovn-kubernetes\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.081381 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081096 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61bafc2e-da2c-4b35-8555-b19f06728459-system-cni-dir\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:29.081381 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081104 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-run-netns\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.081381 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081094 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ecb68cc-bba4-4a6c-863f-5b946518e907-hosts-file\") pod \"node-resolver-znmg7\" (UID: \"1ecb68cc-bba4-4a6c-863f-5b946518e907\") " pod="openshift-dns/node-resolver-znmg7" Sep 10 12:09:29.081381 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081142 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-run-ovn-kubernetes\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.081381 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081160 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ecb68cc-bba4-4a6c-863f-5b946518e907-hosts-file\") pod \"node-resolver-znmg7\" (UID: \"1ecb68cc-bba4-4a6c-863f-5b946518e907\") " pod="openshift-dns/node-resolver-znmg7" Sep 10 12:09:29.081381 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081166 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61bafc2e-da2c-4b35-8555-b19f06728459-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:29.081381 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081195 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4l4r\" (UniqueName: \"kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r\") pod \"network-check-target-wkm26\" (UID: \"1071b22c-5ab2-4e55-871c-05012ee83376\") " pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:29.081381 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081215 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-multus-socket-dir-parent\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.081381 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081234 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-var-lib-cni-bin\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.081381 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081352 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs\") pod \"network-metrics-daemon-58d7t\" (UID: \"6909e322-42f0-4d07-af43-4b79e0e8fc17\") " pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:29.081381 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081379 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzbzn\" (UniqueName: \"kubernetes.io/projected/6909e322-42f0-4d07-af43-4b79e0e8fc17-kube-api-access-nzbzn\") pod \"network-metrics-daemon-58d7t\" (UID: \"6909e322-42f0-4d07-af43-4b79e0e8fc17\") " pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081413 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-ovnkube-config\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081442 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081468 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksnnb\" (UniqueName: \"kubernetes.io/projected/61bafc2e-da2c-4b35-8555-b19f06728459-kube-api-access-ksnnb\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081494 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-var-lib-kubelet\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081522 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f00f889-5c53-45e7-9b18-0d0f6cd156c2-host\") pod \"node-ca-k5r2r\" (UID: \"0f00f889-5c53-45e7-9b18-0d0f6cd156c2\") " pod="openshift-image-registry/node-ca-k5r2r" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081542 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081545 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0f00f889-5c53-45e7-9b18-0d0f6cd156c2-serviceca\") pod \"node-ca-k5r2r\" (UID: \"0f00f889-5c53-45e7-9b18-0d0f6cd156c2\") " pod="openshift-image-registry/node-ca-k5r2r" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081590 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret\") pod \"global-pull-secret-syncer-xwkm4\" (UID: \"9a81a977-6e78-4a35-bd30-af9397a90af6\") " pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081627 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-systemd\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081674 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-env-overrides\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081701 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61bafc2e-da2c-4b35-8555-b19f06728459-cni-binary-copy\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081728 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-modprobe-d\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081760 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-sys\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081786 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-tuned\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081809 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-log-socket\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081835 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-ovn-node-metrics-cert\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.082094 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081860 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7kwt\" (UniqueName: \"kubernetes.io/projected/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-kube-api-access-r7kwt\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081876 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-log-socket\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081885 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61bafc2e-da2c-4b35-8555-b19f06728459-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081903 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61bafc2e-da2c-4b35-8555-b19f06728459-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081932 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nftj8\" (UniqueName: \"kubernetes.io/projected/72304cb8-6dcc-44b4-9b6b-1018541070f3-kube-api-access-nftj8\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.081978 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d24ea48-63c8-4608-b61a-907e6689e67a-iptables-alerter-script\") pod \"iptables-alerter-swhzw\" (UID: \"3d24ea48-63c8-4608-b61a-907e6689e67a\") " pod="openshift-network-operator/iptables-alerter-swhzw" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082009 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61bafc2e-da2c-4b35-8555-b19f06728459-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082019 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-ovnkube-config\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082041 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-node-log\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082071 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-run-openvswitch\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082097 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-sys-fs\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082121 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-cnibin\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082132 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-env-overrides\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082146 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-multus-daemon-config\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082195 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-run-openvswitch\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082197 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-kubelet\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082207 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61bafc2e-da2c-4b35-8555-b19f06728459-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:29.082797 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082207 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-node-log\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082237 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-kubelet\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082238 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-etc-openvswitch\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082278 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-sys-fs\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082287 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61bafc2e-da2c-4b35-8555-b19f06728459-cni-binary-copy\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082331 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-etc-openvswitch\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082335 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-cni-netd\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082349 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61bafc2e-da2c-4b35-8555-b19f06728459-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082375 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-cni-netd\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082414 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082466 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-registration-dir\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082484 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082496 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-etc-kubernetes\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082522 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20293890-fc1c-4d9e-b3dd-d2e759f9006c-konnectivity-ca\") pod \"konnectivity-agent-wv4xx\" (UID: \"20293890-fc1c-4d9e-b3dd-d2e759f9006c\") " pod="kube-system/konnectivity-agent-wv4xx" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082526 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-registration-dir\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082543 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-system-cni-dir\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082563 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-host\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.083590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082589 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-socket-dir\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082617 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-device-dir\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082636 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a81a977-6e78-4a35-bd30-af9397a90af6-kubelet-config\") pod \"global-pull-secret-syncer-xwkm4\" (UID: \"9a81a977-6e78-4a35-bd30-af9397a90af6\") " pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082652 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-lib-modules\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082674 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-slash\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082697 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bscn6\" (UniqueName: \"kubernetes.io/projected/7319176e-bc2d-45c3-8abe-34e928f9e0ee-kube-api-access-bscn6\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082716 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a81a977-6e78-4a35-bd30-af9397a90af6-dbus\") pod \"global-pull-secret-syncer-xwkm4\" (UID: \"9a81a977-6e78-4a35-bd30-af9397a90af6\") " pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082733 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-device-dir\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082733 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d24ea48-63c8-4608-b61a-907e6689e67a-host-slash\") pod \"iptables-alerter-swhzw\" (UID: \"3d24ea48-63c8-4608-b61a-907e6689e67a\") " pod="openshift-network-operator/iptables-alerter-swhzw" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082765 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-slash\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082831 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-cni-bin\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082856 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-ovnkube-script-lib\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082874 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61bafc2e-da2c-4b35-8555-b19f06728459-cnibin\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082902 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20293890-fc1c-4d9e-b3dd-d2e759f9006c-agent-certs\") pod \"konnectivity-agent-wv4xx\" (UID: \"20293890-fc1c-4d9e-b3dd-d2e759f9006c\") " pod="kube-system/konnectivity-agent-wv4xx" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082913 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7319176e-bc2d-45c3-8abe-34e928f9e0ee-socket-dir\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082919 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-cni-bin\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082919 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-run-multus-certs\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.084205 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082945 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61bafc2e-da2c-4b35-8555-b19f06728459-cnibin\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082952 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.082996 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-systemd-units\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083025 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-run-systemd\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083052 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-systemd-units\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083062 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-run-systemd\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083066 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-var-lib-openvswitch\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083130 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-var-lib-cni-multus\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083150 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-run\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083166 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72304cb8-6dcc-44b4-9b6b-1018541070f3-tmp\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083184 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-var-lib-openvswitch\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083201 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ecb68cc-bba4-4a6c-863f-5b946518e907-tmp-dir\") pod \"node-resolver-znmg7\" (UID: \"1ecb68cc-bba4-4a6c-863f-5b946518e907\") " pod="openshift-dns/node-resolver-znmg7" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083243 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-multus-cni-dir\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083293 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-run-k8s-cni-cncf-io\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083323 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-run-netns\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083339 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-hostroot\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083356 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-run-ovn\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083383 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.084699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083416 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-ovnkube-script-lib\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.085256 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083419 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km6d4\" (UniqueName: \"kubernetes.io/projected/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-kube-api-access-km6d4\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.085256 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083438 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.085256 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083463 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-var-lib-kubelet\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.085256 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083422 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-run-ovn\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.085256 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083493 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcngs\" (UniqueName: \"kubernetes.io/projected/3d24ea48-63c8-4608-b61a-907e6689e67a-kube-api-access-vcngs\") pod \"iptables-alerter-swhzw\" (UID: \"3d24ea48-63c8-4608-b61a-907e6689e67a\") " pod="openshift-network-operator/iptables-alerter-swhzw" Sep 10 12:09:29.085256 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083510 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ecb68cc-bba4-4a6c-863f-5b946518e907-tmp-dir\") pod \"node-resolver-znmg7\" (UID: \"1ecb68cc-bba4-4a6c-863f-5b946518e907\") " pod="openshift-dns/node-resolver-znmg7" Sep 10 12:09:29.085256 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.083523 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7ng6\" (UniqueName: \"kubernetes.io/projected/1ecb68cc-bba4-4a6c-863f-5b946518e907-kube-api-access-d7ng6\") pod \"node-resolver-znmg7\" (UID: \"1ecb68cc-bba4-4a6c-863f-5b946518e907\") " pod="openshift-dns/node-resolver-znmg7" Sep 10 12:09:29.086738 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.086716 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-ovn-node-metrics-cert\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.091958 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:29.091933 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:09:29.092075 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:29.091962 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:09:29.092075 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:29.091978 2555 projected.go:196] Error preparing data for projected volume kube-api-access-r4l4r for pod openshift-network-diagnostics/network-check-target-wkm26: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:29.092075 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:29.092066 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r podName:1071b22c-5ab2-4e55-871c-05012ee83376 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:29.592040592 +0000 UTC m=+3.031928806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r4l4r" (UniqueName: "kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r") pod "network-check-target-wkm26" (UID: "1071b22c-5ab2-4e55-871c-05012ee83376") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:29.092711 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.092681 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksnnb\" (UniqueName: \"kubernetes.io/projected/61bafc2e-da2c-4b35-8555-b19f06728459-kube-api-access-ksnnb\") pod \"multus-additional-cni-plugins-fh5k8\" (UID: \"61bafc2e-da2c-4b35-8555-b19f06728459\") " pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:29.092847 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.092831 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7ng6\" (UniqueName: \"kubernetes.io/projected/1ecb68cc-bba4-4a6c-863f-5b946518e907-kube-api-access-d7ng6\") pod \"node-resolver-znmg7\" (UID: \"1ecb68cc-bba4-4a6c-863f-5b946518e907\") " pod="openshift-dns/node-resolver-znmg7" Sep 10 12:09:29.092951 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.092932 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bscn6\" (UniqueName: \"kubernetes.io/projected/7319176e-bc2d-45c3-8abe-34e928f9e0ee-kube-api-access-bscn6\") pod \"aws-ebs-csi-driver-node-8sjdz\" (UID: \"7319176e-bc2d-45c3-8abe-34e928f9e0ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:29.093873 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.093856 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7kwt\" (UniqueName: \"kubernetes.io/projected/0dd9a703-4cbe-48b5-9c53-5c5a69c97706-kube-api-access-r7kwt\") pod \"ovnkube-node-49qv8\" (UID: \"0dd9a703-4cbe-48b5-9c53-5c5a69c97706\") " pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.112350 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.112305 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal" event={"ID":"c2b7b4edc809446a4d71da960a89001f","Type":"ContainerStarted","Data":"496adf5071eccc01fb9bfc87df1686592797801f3d0b5393025799449e664a2d"} Sep 10 12:09:29.113463 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.113438 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-28.ec2.internal" event={"ID":"270566bf61107e37921a529016c765e7","Type":"ContainerStarted","Data":"50399db3f69b7e67ead71a6316788e2da48bfc246c48906813f2c373011adcd5"} Sep 10 12:09:29.183889 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.183785 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-multus-socket-dir-parent\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.183889 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.183826 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-var-lib-cni-bin\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.183889 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.183847 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs\") pod \"network-metrics-daemon-58d7t\" (UID: \"6909e322-42f0-4d07-af43-4b79e0e8fc17\") " pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:29.184210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.183929 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-multus-socket-dir-parent\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.184210 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:29.183971 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:29.184210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.183929 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-var-lib-cni-bin\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.184210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.183936 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzbzn\" (UniqueName: \"kubernetes.io/projected/6909e322-42f0-4d07-af43-4b79e0e8fc17-kube-api-access-nzbzn\") pod \"network-metrics-daemon-58d7t\" (UID: \"6909e322-42f0-4d07-af43-4b79e0e8fc17\") " pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:29.184210 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:29.184037 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs podName:6909e322-42f0-4d07-af43-4b79e0e8fc17 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:29.684017083 +0000 UTC m=+3.123905295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs") pod "network-metrics-daemon-58d7t" (UID: "6909e322-42f0-4d07-af43-4b79e0e8fc17") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:29.184210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184103 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-var-lib-kubelet\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.184210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184131 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f00f889-5c53-45e7-9b18-0d0f6cd156c2-host\") pod \"node-ca-k5r2r\" (UID: \"0f00f889-5c53-45e7-9b18-0d0f6cd156c2\") " pod="openshift-image-registry/node-ca-k5r2r" Sep 10 12:09:29.184210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184148 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0f00f889-5c53-45e7-9b18-0d0f6cd156c2-serviceca\") pod \"node-ca-k5r2r\" (UID: \"0f00f889-5c53-45e7-9b18-0d0f6cd156c2\") " pod="openshift-image-registry/node-ca-k5r2r" Sep 10 12:09:29.184210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184170 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret\") pod \"global-pull-secret-syncer-xwkm4\" (UID: \"9a81a977-6e78-4a35-bd30-af9397a90af6\") " pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:29.184210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184197 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-systemd\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.184210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184202 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-var-lib-kubelet\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.184210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184209 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f00f889-5c53-45e7-9b18-0d0f6cd156c2-host\") pod \"node-ca-k5r2r\" (UID: \"0f00f889-5c53-45e7-9b18-0d0f6cd156c2\") " pod="openshift-image-registry/node-ca-k5r2r" Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184225 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-modprobe-d\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184250 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-sys\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:29.184277 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184297 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-systemd\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184336 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-tuned\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184374 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nftj8\" (UniqueName: \"kubernetes.io/projected/72304cb8-6dcc-44b4-9b6b-1018541070f3-kube-api-access-nftj8\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184410 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d24ea48-63c8-4608-b61a-907e6689e67a-iptables-alerter-script\") pod \"iptables-alerter-swhzw\" (UID: \"3d24ea48-63c8-4608-b61a-907e6689e67a\") " pod="openshift-network-operator/iptables-alerter-swhzw" Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184447 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-cnibin\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184485 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-modprobe-d\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184504 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-multus-daemon-config\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:29.184511 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret podName:9a81a977-6e78-4a35-bd30-af9397a90af6 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:29.68449287 +0000 UTC m=+3.124381098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret") pod "global-pull-secret-syncer-xwkm4" (UID: "9a81a977-6e78-4a35-bd30-af9397a90af6") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184553 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-sys\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184610 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-etc-kubernetes\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184642 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20293890-fc1c-4d9e-b3dd-d2e759f9006c-konnectivity-ca\") pod \"konnectivity-agent-wv4xx\" (UID: \"20293890-fc1c-4d9e-b3dd-d2e759f9006c\") " pod="kube-system/konnectivity-agent-wv4xx" Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184650 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0f00f889-5c53-45e7-9b18-0d0f6cd156c2-serviceca\") pod \"node-ca-k5r2r\" (UID: \"0f00f889-5c53-45e7-9b18-0d0f6cd156c2\") " pod="openshift-image-registry/node-ca-k5r2r" Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184672 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-system-cni-dir\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184705 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-etc-kubernetes\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.184822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184736 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-host\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184759 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a81a977-6e78-4a35-bd30-af9397a90af6-kubelet-config\") pod \"global-pull-secret-syncer-xwkm4\" (UID: \"9a81a977-6e78-4a35-bd30-af9397a90af6\") " pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184791 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-lib-modules\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184816 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a81a977-6e78-4a35-bd30-af9397a90af6-dbus\") pod \"global-pull-secret-syncer-xwkm4\" (UID: \"9a81a977-6e78-4a35-bd30-af9397a90af6\") " pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184816 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-host\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184838 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d24ea48-63c8-4608-b61a-907e6689e67a-host-slash\") pod \"iptables-alerter-swhzw\" (UID: \"3d24ea48-63c8-4608-b61a-907e6689e67a\") " pod="openshift-network-operator/iptables-alerter-swhzw" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184876 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a81a977-6e78-4a35-bd30-af9397a90af6-kubelet-config\") pod \"global-pull-secret-syncer-xwkm4\" (UID: \"9a81a977-6e78-4a35-bd30-af9397a90af6\") " pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184886 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-system-cni-dir\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184925 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-cnibin\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184971 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a81a977-6e78-4a35-bd30-af9397a90af6-dbus\") pod \"global-pull-secret-syncer-xwkm4\" (UID: \"9a81a977-6e78-4a35-bd30-af9397a90af6\") " pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184982 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-lib-modules\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.184986 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d24ea48-63c8-4608-b61a-907e6689e67a-host-slash\") pod \"iptables-alerter-swhzw\" (UID: \"3d24ea48-63c8-4608-b61a-907e6689e67a\") " pod="openshift-network-operator/iptables-alerter-swhzw" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185015 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20293890-fc1c-4d9e-b3dd-d2e759f9006c-agent-certs\") pod \"konnectivity-agent-wv4xx\" (UID: \"20293890-fc1c-4d9e-b3dd-d2e759f9006c\") " pod="kube-system/konnectivity-agent-wv4xx" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185059 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-run-multus-certs\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185112 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-var-lib-cni-multus\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185134 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-run-multus-certs\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185179 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-var-lib-cni-multus\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185139 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-run\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.185823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185200 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-run\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185220 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72304cb8-6dcc-44b4-9b6b-1018541070f3-tmp\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185248 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-multus-cni-dir\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185253 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-multus-daemon-config\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185272 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-run-k8s-cni-cncf-io\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185313 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-run-netns\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185339 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-hostroot\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185357 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d24ea48-63c8-4608-b61a-907e6689e67a-iptables-alerter-script\") pod \"iptables-alerter-swhzw\" (UID: \"3d24ea48-63c8-4608-b61a-907e6689e67a\") " pod="openshift-network-operator/iptables-alerter-swhzw" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185368 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km6d4\" (UniqueName: \"kubernetes.io/projected/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-kube-api-access-km6d4\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185387 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-run-netns\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185410 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-var-lib-kubelet\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185436 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-host-run-k8s-cni-cncf-io\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185441 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcngs\" (UniqueName: \"kubernetes.io/projected/3d24ea48-63c8-4608-b61a-907e6689e67a-kube-api-access-vcngs\") pod \"iptables-alerter-swhzw\" (UID: \"3d24ea48-63c8-4608-b61a-907e6689e67a\") " pod="openshift-network-operator/iptables-alerter-swhzw" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185463 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20293890-fc1c-4d9e-b3dd-d2e759f9006c-konnectivity-ca\") pod \"konnectivity-agent-wv4xx\" (UID: \"20293890-fc1c-4d9e-b3dd-d2e759f9006c\") " pod="kube-system/konnectivity-agent-wv4xx" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185478 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-cni-binary-copy\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185516 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pj88\" (UniqueName: \"kubernetes.io/projected/0f00f889-5c53-45e7-9b18-0d0f6cd156c2-kube-api-access-5pj88\") pod \"node-ca-k5r2r\" (UID: \"0f00f889-5c53-45e7-9b18-0d0f6cd156c2\") " pod="openshift-image-registry/node-ca-k5r2r" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185550 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-sysconfig\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185340 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-multus-cni-dir\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.186767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185578 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-kubernetes\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.187705 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185550 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-var-lib-kubelet\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.187705 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185603 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-sysctl-conf\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.187705 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185601 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-hostroot\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.187705 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185659 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-multus-conf-dir\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.187705 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185681 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-sysconfig\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.187705 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185688 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-sysctl-d\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.187705 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185728 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-kubernetes\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.187705 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185730 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-sysctl-conf\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.187705 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185772 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-multus-conf-dir\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.187705 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.185834 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-sysctl-d\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.187705 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.186118 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-cni-binary-copy\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.187705 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.187497 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20293890-fc1c-4d9e-b3dd-d2e759f9006c-agent-certs\") pod \"konnectivity-agent-wv4xx\" (UID: \"20293890-fc1c-4d9e-b3dd-d2e759f9006c\") " pod="kube-system/konnectivity-agent-wv4xx" Sep 10 12:09:29.187705 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.187545 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72304cb8-6dcc-44b4-9b6b-1018541070f3-etc-tuned\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.188139 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.187942 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72304cb8-6dcc-44b4-9b6b-1018541070f3-tmp\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.194775 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.194743 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzbzn\" (UniqueName: \"kubernetes.io/projected/6909e322-42f0-4d07-af43-4b79e0e8fc17-kube-api-access-nzbzn\") pod \"network-metrics-daemon-58d7t\" (UID: \"6909e322-42f0-4d07-af43-4b79e0e8fc17\") " pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:29.195199 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.195141 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nftj8\" (UniqueName: \"kubernetes.io/projected/72304cb8-6dcc-44b4-9b6b-1018541070f3-kube-api-access-nftj8\") pod \"tuned-tlchb\" (UID: \"72304cb8-6dcc-44b4-9b6b-1018541070f3\") " pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.195344 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.195325 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pj88\" (UniqueName: \"kubernetes.io/projected/0f00f889-5c53-45e7-9b18-0d0f6cd156c2-kube-api-access-5pj88\") pod \"node-ca-k5r2r\" (UID: \"0f00f889-5c53-45e7-9b18-0d0f6cd156c2\") " pod="openshift-image-registry/node-ca-k5r2r" Sep 10 12:09:29.195740 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.195723 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km6d4\" (UniqueName: \"kubernetes.io/projected/73c9c1ff-fd19-429d-bfcb-858770cc3aa8-kube-api-access-km6d4\") pod \"multus-nxgbv\" (UID: \"73c9c1ff-fd19-429d-bfcb-858770cc3aa8\") " pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.196186 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.196170 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcngs\" (UniqueName: \"kubernetes.io/projected/3d24ea48-63c8-4608-b61a-907e6689e67a-kube-api-access-vcngs\") pod \"iptables-alerter-swhzw\" (UID: \"3d24ea48-63c8-4608-b61a-907e6689e67a\") " pod="openshift-network-operator/iptables-alerter-swhzw" Sep 10 12:09:29.276994 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.276945 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:29.284423 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.284394 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" Sep 10 12:09:29.286833 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:29.286802 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd9a703_4cbe_48b5_9c53_5c5a69c97706.slice/crio-51b67dbe39c1b2067f2053a5cbeaadc2b31ed09a10a2974133b1c9c54c464e3f WatchSource:0}: Error finding container 51b67dbe39c1b2067f2053a5cbeaadc2b31ed09a10a2974133b1c9c54c464e3f: Status 404 returned error can't find the container with id 51b67dbe39c1b2067f2053a5cbeaadc2b31ed09a10a2974133b1c9c54c464e3f Sep 10 12:09:29.292477 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.292454 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-znmg7" Sep 10 12:09:29.295701 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:29.295673 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7319176e_bc2d_45c3_8abe_34e928f9e0ee.slice/crio-fd7381858b049e61164898309d56daff1f3f2c71966d24fc1f92fa3e394ebf70 WatchSource:0}: Error finding container fd7381858b049e61164898309d56daff1f3f2c71966d24fc1f92fa3e394ebf70: Status 404 returned error can't find the container with id fd7381858b049e61164898309d56daff1f3f2c71966d24fc1f92fa3e394ebf70 Sep 10 12:09:29.296879 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.296859 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fh5k8" Sep 10 12:09:29.302648 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.302628 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nxgbv" Sep 10 12:09:29.304341 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:29.304082 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ecb68cc_bba4_4a6c_863f_5b946518e907.slice/crio-b48ee06808029648a11d971cdb6e6cb323b0b8585419bf60aa9cfcf7c8d97381 WatchSource:0}: Error finding container b48ee06808029648a11d971cdb6e6cb323b0b8585419bf60aa9cfcf7c8d97381: Status 404 returned error can't find the container with id b48ee06808029648a11d971cdb6e6cb323b0b8585419bf60aa9cfcf7c8d97381 Sep 10 12:09:29.307999 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.307955 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k5r2r" Sep 10 12:09:29.309834 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:29.309799 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61bafc2e_da2c_4b35_8555_b19f06728459.slice/crio-916a97aaa9282fd35fee97b08fe6bfd778265e7785b9c8dc9f1e33128290c7dd WatchSource:0}: Error finding container 916a97aaa9282fd35fee97b08fe6bfd778265e7785b9c8dc9f1e33128290c7dd: Status 404 returned error can't find the container with id 916a97aaa9282fd35fee97b08fe6bfd778265e7785b9c8dc9f1e33128290c7dd Sep 10 12:09:29.313653 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.313633 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wv4xx" Sep 10 12:09:29.315490 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:29.315458 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73c9c1ff_fd19_429d_bfcb_858770cc3aa8.slice/crio-6d55da774a9ee51e5f0a603f08e8655d39b48ef1827673ddd2aa208cd7a3ac60 WatchSource:0}: Error finding container 6d55da774a9ee51e5f0a603f08e8655d39b48ef1827673ddd2aa208cd7a3ac60: Status 404 returned error can't find the container with id 6d55da774a9ee51e5f0a603f08e8655d39b48ef1827673ddd2aa208cd7a3ac60 Sep 10 12:09:29.320527 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.320223 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tlchb" Sep 10 12:09:29.320527 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:29.320423 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f00f889_5c53_45e7_9b18_0d0f6cd156c2.slice/crio-79b6a57a9ee51080fb62d6b4a61a43757ea933ce329a643a2cce366279f9b7c7 WatchSource:0}: Error finding container 79b6a57a9ee51080fb62d6b4a61a43757ea933ce329a643a2cce366279f9b7c7: Status 404 returned error can't find the container with id 79b6a57a9ee51080fb62d6b4a61a43757ea933ce329a643a2cce366279f9b7c7 Sep 10 12:09:29.325282 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.325083 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-swhzw" Sep 10 12:09:29.327842 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:29.327586 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20293890_fc1c_4d9e_b3dd_d2e759f9006c.slice/crio-3787dda94bf747d15e907436218325386a80dc78e44363d6aa50429f870d4692 WatchSource:0}: Error finding container 3787dda94bf747d15e907436218325386a80dc78e44363d6aa50429f870d4692: Status 404 returned error can't find the container with id 3787dda94bf747d15e907436218325386a80dc78e44363d6aa50429f870d4692 Sep 10 12:09:29.333221 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:09:29.333200 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72304cb8_6dcc_44b4_9b6b_1018541070f3.slice/crio-074640fd9aa69ff2c22b9adf802a07396df21c3363db5467e4f3328a6f182b28 WatchSource:0}: Error finding container 074640fd9aa69ff2c22b9adf802a07396df21c3363db5467e4f3328a6f182b28: Status 404 returned error can't find the container with id 074640fd9aa69ff2c22b9adf802a07396df21c3363db5467e4f3328a6f182b28 Sep 10 12:09:29.414048 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.414009 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:09:29.689833 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.689789 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4l4r\" (UniqueName: \"kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r\") pod \"network-check-target-wkm26\" (UID: \"1071b22c-5ab2-4e55-871c-05012ee83376\") " pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:29.689833 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.689832 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs\") pod \"network-metrics-daemon-58d7t\" (UID: \"6909e322-42f0-4d07-af43-4b79e0e8fc17\") " pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:29.690057 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:29.689853 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret\") pod \"global-pull-secret-syncer-xwkm4\" (UID: \"9a81a977-6e78-4a35-bd30-af9397a90af6\") " pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:29.690057 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:29.689982 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:29.690057 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:29.690003 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:09:29.690057 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:29.690026 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:09:29.690057 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:29.690039 2555 projected.go:196] Error preparing data for projected volume kube-api-access-r4l4r for pod openshift-network-diagnostics/network-check-target-wkm26: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:29.690057 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:29.690056 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret podName:9a81a977-6e78-4a35-bd30-af9397a90af6 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:30.69003615 +0000 UTC m=+4.129924379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret") pod "global-pull-secret-syncer-xwkm4" (UID: "9a81a977-6e78-4a35-bd30-af9397a90af6") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:29.690393 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:29.689984 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:29.690393 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:29.690104 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r podName:1071b22c-5ab2-4e55-871c-05012ee83376 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:30.690070839 +0000 UTC m=+4.129959052 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4l4r" (UniqueName: "kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r") pod "network-check-target-wkm26" (UID: "1071b22c-5ab2-4e55-871c-05012ee83376") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:29.690393 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:29.690139 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs podName:6909e322-42f0-4d07-af43-4b79e0e8fc17 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:30.69012171 +0000 UTC m=+4.130009934 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs") pod "network-metrics-daemon-58d7t" (UID: "6909e322-42f0-4d07-af43-4b79e0e8fc17") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:30.013272 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:30.013154 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 12:04:29 +0000 UTC" deadline="2028-03-17 10:34:48.787569566 +0000 UTC" Sep 10 12:09:30.013272 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:30.013204 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13294h25m18.774371217s" Sep 10 12:09:30.108901 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:30.108374 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:30.108901 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:30.108507 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:09:30.118957 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:30.118850 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tlchb" event={"ID":"72304cb8-6dcc-44b4-9b6b-1018541070f3","Type":"ContainerStarted","Data":"074640fd9aa69ff2c22b9adf802a07396df21c3363db5467e4f3328a6f182b28"} Sep 10 12:09:30.123246 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:30.123149 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wv4xx" event={"ID":"20293890-fc1c-4d9e-b3dd-d2e759f9006c","Type":"ContainerStarted","Data":"3787dda94bf747d15e907436218325386a80dc78e44363d6aa50429f870d4692"} Sep 10 12:09:30.125014 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:30.124934 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nxgbv" event={"ID":"73c9c1ff-fd19-429d-bfcb-858770cc3aa8","Type":"ContainerStarted","Data":"6d55da774a9ee51e5f0a603f08e8655d39b48ef1827673ddd2aa208cd7a3ac60"} Sep 10 12:09:30.126683 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:30.126596 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh5k8" event={"ID":"61bafc2e-da2c-4b35-8555-b19f06728459","Type":"ContainerStarted","Data":"916a97aaa9282fd35fee97b08fe6bfd778265e7785b9c8dc9f1e33128290c7dd"} Sep 10 12:09:30.137282 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:30.137203 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" event={"ID":"7319176e-bc2d-45c3-8abe-34e928f9e0ee","Type":"ContainerStarted","Data":"fd7381858b049e61164898309d56daff1f3f2c71966d24fc1f92fa3e394ebf70"} Sep 10 12:09:30.140036 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:30.140009 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-swhzw" event={"ID":"3d24ea48-63c8-4608-b61a-907e6689e67a","Type":"ContainerStarted","Data":"cd9a60d57078c546fef062ee3bbfc6aa54799acb3193bee48bcd9052454a8117"} Sep 10 12:09:30.141845 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:30.141773 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k5r2r" event={"ID":"0f00f889-5c53-45e7-9b18-0d0f6cd156c2","Type":"ContainerStarted","Data":"79b6a57a9ee51080fb62d6b4a61a43757ea933ce329a643a2cce366279f9b7c7"} Sep 10 12:09:30.145634 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:30.145599 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-znmg7" event={"ID":"1ecb68cc-bba4-4a6c-863f-5b946518e907","Type":"ContainerStarted","Data":"b48ee06808029648a11d971cdb6e6cb323b0b8585419bf60aa9cfcf7c8d97381"} Sep 10 12:09:30.147987 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:30.147830 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" event={"ID":"0dd9a703-4cbe-48b5-9c53-5c5a69c97706","Type":"ContainerStarted","Data":"51b67dbe39c1b2067f2053a5cbeaadc2b31ed09a10a2974133b1c9c54c464e3f"} Sep 10 12:09:30.686627 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:30.686593 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:09:30.699079 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:30.699039 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4l4r\" (UniqueName: \"kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r\") pod \"network-check-target-wkm26\" (UID: \"1071b22c-5ab2-4e55-871c-05012ee83376\") " pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:30.699296 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:30.699119 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs\") pod \"network-metrics-daemon-58d7t\" (UID: \"6909e322-42f0-4d07-af43-4b79e0e8fc17\") " pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:30.699409 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:30.699166 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret\") pod \"global-pull-secret-syncer-xwkm4\" (UID: \"9a81a977-6e78-4a35-bd30-af9397a90af6\") " pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:30.704351 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:30.704323 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:30.704506 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:30.704369 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:09:30.704506 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:30.704396 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:09:30.704506 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:30.704413 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs podName:6909e322-42f0-4d07-af43-4b79e0e8fc17 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:32.704391496 +0000 UTC m=+6.144279725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs") pod "network-metrics-daemon-58d7t" (UID: "6909e322-42f0-4d07-af43-4b79e0e8fc17") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:30.704506 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:30.704415 2555 projected.go:196] Error preparing data for projected volume kube-api-access-r4l4r for pod openshift-network-diagnostics/network-check-target-wkm26: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:30.704506 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:30.704497 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r podName:1071b22c-5ab2-4e55-871c-05012ee83376 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:32.704486297 +0000 UTC m=+6.144374525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4l4r" (UniqueName: "kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r") pod "network-check-target-wkm26" (UID: "1071b22c-5ab2-4e55-871c-05012ee83376") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:30.704789 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:30.704670 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:30.704789 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:30.704717 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret podName:9a81a977-6e78-4a35-bd30-af9397a90af6 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:32.704704848 +0000 UTC m=+6.144593077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret") pod "global-pull-secret-syncer-xwkm4" (UID: "9a81a977-6e78-4a35-bd30-af9397a90af6") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:31.013823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:31.013748 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 12:04:29 +0000 UTC" deadline="2028-05-08 18:24:42.780374251 +0000 UTC" Sep 10 12:09:31.013823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:31.013820 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14550h15m11.766558751s" Sep 10 12:09:31.111466 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:31.110718 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:31.111466 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:31.110869 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:09:31.111466 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:31.111306 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:31.111466 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:31.111409 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:09:32.109310 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:32.108772 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:32.109310 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:32.108917 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:09:32.719293 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:32.718053 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4l4r\" (UniqueName: \"kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r\") pod \"network-check-target-wkm26\" (UID: \"1071b22c-5ab2-4e55-871c-05012ee83376\") " pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:32.719293 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:32.718127 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs\") pod \"network-metrics-daemon-58d7t\" (UID: \"6909e322-42f0-4d07-af43-4b79e0e8fc17\") " pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:32.719293 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:32.718164 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret\") pod \"global-pull-secret-syncer-xwkm4\" (UID: \"9a81a977-6e78-4a35-bd30-af9397a90af6\") " pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:32.719293 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:32.718459 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:32.719293 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:32.718532 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret podName:9a81a977-6e78-4a35-bd30-af9397a90af6 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:36.718510444 +0000 UTC m=+10.158398672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret") pod "global-pull-secret-syncer-xwkm4" (UID: "9a81a977-6e78-4a35-bd30-af9397a90af6") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:32.719293 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:32.718985 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:09:32.719293 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:32.719004 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:09:32.719293 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:32.719019 2555 projected.go:196] Error preparing data for projected volume kube-api-access-r4l4r for pod openshift-network-diagnostics/network-check-target-wkm26: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:32.719293 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:32.719063 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r podName:1071b22c-5ab2-4e55-871c-05012ee83376 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:36.71904931 +0000 UTC m=+10.158937539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4l4r" (UniqueName: "kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r") pod "network-check-target-wkm26" (UID: "1071b22c-5ab2-4e55-871c-05012ee83376") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:32.719293 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:32.719219 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:32.719293 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:32.719268 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs podName:6909e322-42f0-4d07-af43-4b79e0e8fc17 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:36.719253143 +0000 UTC m=+10.159141370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs") pod "network-metrics-daemon-58d7t" (UID: "6909e322-42f0-4d07-af43-4b79e0e8fc17") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:33.110926 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:33.110248 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:33.110926 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:33.110379 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:09:33.110926 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:33.110857 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:33.111549 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:33.110979 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:09:34.108251 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:34.108215 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:34.108424 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:34.108354 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:09:35.108713 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:35.108673 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:35.109187 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:35.108832 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:09:35.109187 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:35.108926 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:35.109187 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:35.109047 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:09:36.108033 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:36.107946 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:36.108259 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:36.108080 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:09:36.749350 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:36.749170 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4l4r\" (UniqueName: \"kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r\") pod \"network-check-target-wkm26\" (UID: \"1071b22c-5ab2-4e55-871c-05012ee83376\") " pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:36.749350 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:36.749222 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs\") pod \"network-metrics-daemon-58d7t\" (UID: \"6909e322-42f0-4d07-af43-4b79e0e8fc17\") " pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:36.749350 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:36.749258 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret\") pod \"global-pull-secret-syncer-xwkm4\" (UID: \"9a81a977-6e78-4a35-bd30-af9397a90af6\") " pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:36.749911 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:36.749418 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:36.749911 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:36.749420 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:36.749911 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:36.749481 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:09:36.749911 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:36.749505 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:09:36.749911 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:36.749520 2555 projected.go:196] Error preparing data for projected volume kube-api-access-r4l4r for pod openshift-network-diagnostics/network-check-target-wkm26: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:36.749911 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:36.749484 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs podName:6909e322-42f0-4d07-af43-4b79e0e8fc17 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:44.74946911 +0000 UTC m=+18.189357320 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs") pod "network-metrics-daemon-58d7t" (UID: "6909e322-42f0-4d07-af43-4b79e0e8fc17") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:36.749911 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:36.749584 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret podName:9a81a977-6e78-4a35-bd30-af9397a90af6 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:44.749570102 +0000 UTC m=+18.189458325 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret") pod "global-pull-secret-syncer-xwkm4" (UID: "9a81a977-6e78-4a35-bd30-af9397a90af6") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:36.749911 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:36.749599 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r podName:1071b22c-5ab2-4e55-871c-05012ee83376 nodeName:}" failed. No retries permitted until 2026-09-10 12:09:44.749592238 +0000 UTC m=+18.189480449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4l4r" (UniqueName: "kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r") pod "network-check-target-wkm26" (UID: "1071b22c-5ab2-4e55-871c-05012ee83376") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:37.109694 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:37.109586 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:37.110522 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:37.110490 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:37.110667 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:37.110608 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:09:37.110765 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:37.110736 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:09:38.108454 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:38.108421 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:38.108983 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:38.108552 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:09:39.108526 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:39.108493 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:39.108960 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:39.108493 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:39.108960 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:39.108639 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:09:39.108960 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:39.108673 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:09:40.108455 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:40.108372 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:40.108590 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:40.108510 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:09:41.108081 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:41.108031 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:41.108266 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:41.108199 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:09:41.108266 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:41.108257 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:41.108366 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:41.108346 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:09:42.108175 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:42.108138 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:42.108566 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:42.108278 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:09:43.108060 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:43.108024 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:43.108260 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:43.108190 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:09:43.108260 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:43.108241 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:43.108768 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:43.108365 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:09:44.108117 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:44.108089 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:44.108322 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:44.108212 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:09:44.804246 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:44.804208 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4l4r\" (UniqueName: \"kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r\") pod \"network-check-target-wkm26\" (UID: \"1071b22c-5ab2-4e55-871c-05012ee83376\") " pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:44.804418 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:44.804259 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs\") pod \"network-metrics-daemon-58d7t\" (UID: \"6909e322-42f0-4d07-af43-4b79e0e8fc17\") " pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:44.804418 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:44.804285 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret\") pod \"global-pull-secret-syncer-xwkm4\" (UID: \"9a81a977-6e78-4a35-bd30-af9397a90af6\") " pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:44.804507 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:44.804410 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:44.804507 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:44.804420 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:09:44.804507 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:44.804453 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:09:44.804507 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:44.804468 2555 projected.go:196] Error preparing data for projected volume kube-api-access-r4l4r for pod openshift-network-diagnostics/network-check-target-wkm26: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:44.804665 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:44.804414 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:44.804665 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:44.804530 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r podName:1071b22c-5ab2-4e55-871c-05012ee83376 nodeName:}" failed. No retries permitted until 2026-09-10 12:10:00.804510148 +0000 UTC m=+34.244398362 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4l4r" (UniqueName: "kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r") pod "network-check-target-wkm26" (UID: "1071b22c-5ab2-4e55-871c-05012ee83376") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:09:44.804665 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:44.804551 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs podName:6909e322-42f0-4d07-af43-4b79e0e8fc17 nodeName:}" failed. No retries permitted until 2026-09-10 12:10:00.80454063 +0000 UTC m=+34.244428850 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs") pod "network-metrics-daemon-58d7t" (UID: "6909e322-42f0-4d07-af43-4b79e0e8fc17") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:09:44.804665 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:44.804567 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret podName:9a81a977-6e78-4a35-bd30-af9397a90af6 nodeName:}" failed. No retries permitted until 2026-09-10 12:10:00.804557533 +0000 UTC m=+34.244445748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret") pod "global-pull-secret-syncer-xwkm4" (UID: "9a81a977-6e78-4a35-bd30-af9397a90af6") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:09:45.108278 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:45.108202 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:45.108411 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:45.108204 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:45.108411 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:45.108360 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:09:45.108411 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:45.108397 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:09:46.108662 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:46.108617 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:46.109086 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:46.108745 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:09:47.108821 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:47.108785 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:47.109273 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:47.108899 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:09:47.109273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:47.108932 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:47.109273 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:47.108996 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:09:48.108496 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:48.108256 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:48.108652 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:48.108590 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:09:48.216737 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:48.216697 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tlchb" event={"ID":"72304cb8-6dcc-44b4-9b6b-1018541070f3","Type":"ContainerStarted","Data":"a13065cdf4e1c3088f7bc5a60e03b4f024dd65e01a0ea3f136c788f1f3b24ed0"} Sep 10 12:09:48.228825 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:48.228787 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nxgbv" event={"ID":"73c9c1ff-fd19-429d-bfcb-858770cc3aa8","Type":"ContainerStarted","Data":"4f5dc8eb75f7bc84e2a1a492301ca739076622c39afda5cbe15ea482cb0eae87"} Sep 10 12:09:48.235657 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:48.235580 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-28.ec2.internal" event={"ID":"270566bf61107e37921a529016c765e7","Type":"ContainerStarted","Data":"de75cf84dcb5263092f930d5e53ab9ef72cc7d3b57bb0f56a4c6ee2c27683ec2"} Sep 10 12:09:48.236202 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:48.236102 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tlchb" podStartSLOduration=2.661815193 podStartE2EDuration="21.236082794s" totalImagesPullingTime="18.574267601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:48.234562438 +0000 UTC m=+21.674450695" watchObservedRunningTime="2026-09-10 12:09:48.236082794 +0000 UTC m=+21.675971022" Sep 10 12:09:48.245385 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:48.245225 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" event={"ID":"0dd9a703-4cbe-48b5-9c53-5c5a69c97706","Type":"ContainerStarted","Data":"6be836eb2f82c61cd3ab264a439be516dd697fdeaed6e30c877f0cc8acf89eff"} Sep 10 12:09:48.245385 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:48.245317 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" event={"ID":"0dd9a703-4cbe-48b5-9c53-5c5a69c97706","Type":"ContainerStarted","Data":"ed367552e686421a0b4d5b37e4eb04cb41896d22250bdea6bbb0f8268e5da5bb"} Sep 10 12:09:48.255269 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:48.255210 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nxgbv" podStartSLOduration=2.58032138 podStartE2EDuration="21.255186146s" totalImagesPullingTime="18.674864766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:48.25226017 +0000 UTC m=+21.692148403" watchObservedRunningTime="2026-09-10 12:09:48.255186146 +0000 UTC m=+21.695074380" Sep 10 12:09:49.108664 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.108461 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:49.108851 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.108474 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:49.108851 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:49.108761 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:09:49.108981 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:49.108881 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:09:49.250105 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.250006 2555 generic.go:356] "Generic (PLEG): container finished" podID="61bafc2e-da2c-4b35-8555-b19f06728459" containerID="9379a076762fa6bc14bca91c3eff5ae86a1a8a9ff17ccc859464d0c871dd4116" exitCode=0 Sep 10 12:09:49.250902 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.250122 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh5k8" event={"ID":"61bafc2e-da2c-4b35-8555-b19f06728459","Type":"ContainerDied","Data":"9379a076762fa6bc14bca91c3eff5ae86a1a8a9ff17ccc859464d0c871dd4116"} Sep 10 12:09:49.252012 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.251971 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" event={"ID":"7319176e-bc2d-45c3-8abe-34e928f9e0ee","Type":"ContainerStarted","Data":"331c4113b8d1d79eaabe03614ead3eaff2067939fac4c6d94a86ca125ae281ef"} Sep 10 12:09:49.253598 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.253571 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-swhzw" event={"ID":"3d24ea48-63c8-4608-b61a-907e6689e67a","Type":"ContainerStarted","Data":"60998261096d33137ad143079b1f9285e693bdba302e0e1e747cdbcda2cd93ab"} Sep 10 12:09:49.255230 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.255204 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k5r2r" event={"ID":"0f00f889-5c53-45e7-9b18-0d0f6cd156c2","Type":"ContainerStarted","Data":"22f2e9a0c71dadade336344b84d879bc3f318fd19870ce8168bca1f0dde9bb80"} Sep 10 12:09:49.256945 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.256918 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-znmg7" event={"ID":"1ecb68cc-bba4-4a6c-863f-5b946518e907","Type":"ContainerStarted","Data":"53d790884bd37dcb0e896432f5cc7bfc39eb8ffa9f169ad10d894da9b06a8307"} Sep 10 12:09:49.260449 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.260422 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" event={"ID":"0dd9a703-4cbe-48b5-9c53-5c5a69c97706","Type":"ContainerStarted","Data":"23262d2014c3bc6231ff722c2451ef4db4720dedf2a6fda471c949681118c095"} Sep 10 12:09:49.260542 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.260482 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" event={"ID":"0dd9a703-4cbe-48b5-9c53-5c5a69c97706","Type":"ContainerStarted","Data":"64bb031de243bc6930eeabc4aa71a0cdb06db5dcd36c83973e1c705354eedd5d"} Sep 10 12:09:49.260542 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.260519 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" event={"ID":"0dd9a703-4cbe-48b5-9c53-5c5a69c97706","Type":"ContainerStarted","Data":"9bf6afa01a05ad167ccf23f870b58f1d8d6948ff45af500391d8021aa85e7f49"} Sep 10 12:09:49.260619 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.260550 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" event={"ID":"0dd9a703-4cbe-48b5-9c53-5c5a69c97706","Type":"ContainerStarted","Data":"47166fc20da168dfaa792ab6afca5ecb734bf1e3f5fbf92b2362eab4e6f6a4b9"} Sep 10 12:09:49.262133 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.262080 2555 generic.go:356] "Generic (PLEG): container finished" podID="c2b7b4edc809446a4d71da960a89001f" containerID="fa946e34e1ae7df59f7c8173fd563d1988b3255a79aa6e5a61eb4cbae1973f83" exitCode=0 Sep 10 12:09:49.262302 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.262147 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal" event={"ID":"c2b7b4edc809446a4d71da960a89001f","Type":"ContainerDied","Data":"fa946e34e1ae7df59f7c8173fd563d1988b3255a79aa6e5a61eb4cbae1973f83"} Sep 10 12:09:49.263790 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.263734 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wv4xx" event={"ID":"20293890-fc1c-4d9e-b3dd-d2e759f9006c","Type":"ContainerStarted","Data":"a24e93b600a0c914a640358ba89f15b7325fe8614151e4e760b0b8f137a7a255"} Sep 10 12:09:49.276800 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.276753 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-28.ec2.internal" podStartSLOduration=21.276739573 podStartE2EDuration="21.276739573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:48.268265356 +0000 UTC m=+21.708153590" watchObservedRunningTime="2026-09-10 12:09:49.276739573 +0000 UTC m=+22.716627850" Sep 10 12:09:49.296257 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.296209 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-znmg7" podStartSLOduration=3.667888945 podStartE2EDuration="22.296189564s" totalImagesPullingTime="18.628300619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:49.295522792 +0000 UTC m=+22.735411045" watchObservedRunningTime="2026-09-10 12:09:49.296189564 +0000 UTC m=+22.736077801" Sep 10 12:09:49.313341 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.313061 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k5r2r" podStartSLOduration=3.723960256 podStartE2EDuration="22.313044152s" totalImagesPullingTime="18.589083896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:49.312302964 +0000 UTC m=+22.752191224" watchObservedRunningTime="2026-09-10 12:09:49.313044152 +0000 UTC m=+22.752932386" Sep 10 12:09:49.334698 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.334645 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wv4xx" podStartSLOduration=11.075194864 podStartE2EDuration="22.334625376s" totalImagesPullingTime="11.259430512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:49.334089507 +0000 UTC m=+22.773977761" watchObservedRunningTime="2026-09-10 12:09:49.334625376 +0000 UTC m=+22.774513610" Sep 10 12:09:49.355647 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.355602 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-swhzw" podStartSLOduration=3.782442041 podStartE2EDuration="22.355587242s" totalImagesPullingTime="18.573145201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:49.355518914 +0000 UTC m=+22.795407168" watchObservedRunningTime="2026-09-10 12:09:49.355587242 +0000 UTC m=+22.795475474" Sep 10 12:09:49.860810 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:49.860784 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 12:09:50.035791 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:50.035628 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T12:09:49.860805923Z","UUID":"f556f8da-08d3-4ed5-8026-e11ac934ef76","Handler":null,"Name":"","Endpoint":""} Sep 10 12:09:50.037335 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:50.037304 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 12:09:50.037335 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:50.037340 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 12:09:50.107768 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:50.107740 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:50.107950 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:50.107855 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:09:50.268597 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:50.268557 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal" event={"ID":"c2b7b4edc809446a4d71da960a89001f","Type":"ContainerStarted","Data":"26354b8b812c350ccbc306cae6afac555e2ed54577732e36aa92137cc0559f34"} Sep 10 12:09:50.270876 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:50.270811 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" event={"ID":"7319176e-bc2d-45c3-8abe-34e928f9e0ee","Type":"ContainerStarted","Data":"f22b5e28000a3ddca8839b05f9eb379f49960459a8b6d24d69d5917e8a82d3ce"} Sep 10 12:09:50.285903 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:50.285815 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-28.ec2.internal" podStartSLOduration=22.285795536 podStartE2EDuration="22.285795536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:50.28514512 +0000 UTC m=+23.725033384" watchObservedRunningTime="2026-09-10 12:09:50.285795536 +0000 UTC m=+23.725683770" Sep 10 12:09:51.109012 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:51.108727 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:51.109195 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:51.109016 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:09:51.109462 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:51.109445 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:51.109562 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:51.109542 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:09:51.276583 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:51.276549 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" event={"ID":"0dd9a703-4cbe-48b5-9c53-5c5a69c97706","Type":"ContainerStarted","Data":"a7111f79460144f6a9ed86e730d1bde3c606073637d95815d6096aeccc7feb61"} Sep 10 12:09:52.054414 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:52.054337 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-znmg7_1ecb68cc-bba4-4a6c-863f-5b946518e907/dns-node-resolver/0.log" Sep 10 12:09:52.108757 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:52.108722 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:52.108917 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:52.108828 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:09:52.281379 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:52.281338 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" event={"ID":"7319176e-bc2d-45c3-8abe-34e928f9e0ee","Type":"ContainerStarted","Data":"c55b2a7116f0ad0e5ee44804dfd2e4c6f7f7d6dae2a987fd9ff4d394f06172cb"} Sep 10 12:09:52.843172 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:52.843139 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k5r2r_0f00f889-5c53-45e7-9b18-0d0f6cd156c2/node-ca/0.log" Sep 10 12:09:53.108588 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:53.108506 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:53.108752 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:53.108512 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:53.108752 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:53.108630 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:09:53.108752 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:53.108738 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:09:53.517395 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:53.517310 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wv4xx" Sep 10 12:09:53.518117 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:53.518097 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wv4xx" Sep 10 12:09:53.535971 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:53.535884 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sjdz" podStartSLOduration=4.783416466 podStartE2EDuration="26.535860668s" totalImagesPullingTime="21.752444202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:52.303449211 +0000 UTC m=+25.743337481" watchObservedRunningTime="2026-09-10 12:09:53.535860668 +0000 UTC m=+26.975748902" Sep 10 12:09:54.107706 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:54.107652 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:54.107774 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:54.107749 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:09:54.288186 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:54.288152 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh5k8" event={"ID":"61bafc2e-da2c-4b35-8555-b19f06728459","Type":"ContainerStarted","Data":"e79869a67fa68fc1c91e9b278f90b6d33a95e1c3da5d68176cd864f935f947af"} Sep 10 12:09:54.291938 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:54.291914 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" event={"ID":"0dd9a703-4cbe-48b5-9c53-5c5a69c97706","Type":"ContainerStarted","Data":"f6f21db496934cb11385e80ff1a20356f57cda042045559d28237a4be7f3a0ec"} Sep 10 12:09:54.292229 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:54.292210 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wv4xx" Sep 10 12:09:54.292665 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:54.292650 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wv4xx" Sep 10 12:09:54.348428 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:54.348376 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" podStartSLOduration=8.654359626 podStartE2EDuration="27.348360008s" totalImagesPullingTime="18.694000382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:09:54.330774775 +0000 UTC m=+27.770663008" watchObservedRunningTime="2026-09-10 12:09:54.348360008 +0000 UTC m=+27.788248241" Sep 10 12:09:55.108480 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:55.108445 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:55.108866 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:55.108575 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:09:55.108866 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:55.108617 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:55.108866 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:55.108718 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:09:55.296086 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:55.296023 2555 generic.go:356] "Generic (PLEG): container finished" podID="61bafc2e-da2c-4b35-8555-b19f06728459" containerID="e79869a67fa68fc1c91e9b278f90b6d33a95e1c3da5d68176cd864f935f947af" exitCode=0 Sep 10 12:09:55.296246 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:55.296109 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh5k8" event={"ID":"61bafc2e-da2c-4b35-8555-b19f06728459","Type":"ContainerDied","Data":"e79869a67fa68fc1c91e9b278f90b6d33a95e1c3da5d68176cd864f935f947af"} Sep 10 12:09:55.296546 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:55.296528 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:55.296718 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:55.296699 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:55.296946 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:55.296770 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:55.312182 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:55.312159 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:55.312288 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:55.312256 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:09:56.108352 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:56.108327 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:56.108458 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:56.108419 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:09:56.300209 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:56.300115 2555 generic.go:356] "Generic (PLEG): container finished" podID="61bafc2e-da2c-4b35-8555-b19f06728459" containerID="1b67c398d22b54f21b98ceb0cf688f46e3d94d4b2c65fece2fbdbc03c37301c7" exitCode=0 Sep 10 12:09:56.300209 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:56.300170 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh5k8" event={"ID":"61bafc2e-da2c-4b35-8555-b19f06728459","Type":"ContainerDied","Data":"1b67c398d22b54f21b98ceb0cf688f46e3d94d4b2c65fece2fbdbc03c37301c7"} Sep 10 12:09:57.108877 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:57.108835 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:57.109116 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:57.108935 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:09:57.109116 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:57.108991 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:57.109231 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:57.109120 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:09:57.305256 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:57.305169 2555 generic.go:356] "Generic (PLEG): container finished" podID="61bafc2e-da2c-4b35-8555-b19f06728459" containerID="224b0f6b736a0a3286906ceea1ab91332399c9e4b0b9b4bb6144f86d349fcf84" exitCode=0 Sep 10 12:09:57.305765 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:57.305259 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh5k8" event={"ID":"61bafc2e-da2c-4b35-8555-b19f06728459","Type":"ContainerDied","Data":"224b0f6b736a0a3286906ceea1ab91332399c9e4b0b9b4bb6144f86d349fcf84"} Sep 10 12:09:58.108198 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:58.108165 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:09:58.108343 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:58.108302 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:09:59.108125 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:59.108093 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:09:59.108567 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:59.108246 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:09:59.108567 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:09:59.108273 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:09:59.108567 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:09:59.108395 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:10:00.107890 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:00.107860 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:10:00.108082 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:00.107961 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:10:00.825684 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:00.825641 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4l4r\" (UniqueName: \"kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r\") pod \"network-check-target-wkm26\" (UID: \"1071b22c-5ab2-4e55-871c-05012ee83376\") " pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:10:00.826212 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:00.825694 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs\") pod \"network-metrics-daemon-58d7t\" (UID: \"6909e322-42f0-4d07-af43-4b79e0e8fc17\") " pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:10:00.826212 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:00.825728 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret\") pod \"global-pull-secret-syncer-xwkm4\" (UID: \"9a81a977-6e78-4a35-bd30-af9397a90af6\") " pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:10:00.826212 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:00.825811 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:10:00.826212 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:00.825834 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:10:00.826212 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:00.825839 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:10:00.826212 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:00.825845 2555 projected.go:196] Error preparing data for projected volume kube-api-access-r4l4r for pod openshift-network-diagnostics/network-check-target-wkm26: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:10:00.826212 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:00.825877 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:10:00.826212 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:00.825904 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret podName:9a81a977-6e78-4a35-bd30-af9397a90af6 nodeName:}" failed. No retries permitted until 2026-09-10 12:10:32.825887092 +0000 UTC m=+66.265775318 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret") pod "global-pull-secret-syncer-xwkm4" (UID: "9a81a977-6e78-4a35-bd30-af9397a90af6") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:10:00.826212 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:00.825924 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r podName:1071b22c-5ab2-4e55-871c-05012ee83376 nodeName:}" failed. No retries permitted until 2026-09-10 12:10:32.825914616 +0000 UTC m=+66.265802840 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r4l4r" (UniqueName: "kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r") pod "network-check-target-wkm26" (UID: "1071b22c-5ab2-4e55-871c-05012ee83376") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:10:00.826212 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:00.825940 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs podName:6909e322-42f0-4d07-af43-4b79e0e8fc17 nodeName:}" failed. No retries permitted until 2026-09-10 12:10:32.825931416 +0000 UTC m=+66.265819631 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs") pod "network-metrics-daemon-58d7t" (UID: "6909e322-42f0-4d07-af43-4b79e0e8fc17") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:10:01.108729 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:01.108652 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:10:01.108986 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:01.108651 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:10:01.108986 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:01.108776 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:10:01.108986 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:01.108856 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:10:02.108166 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:02.108141 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:10:02.108549 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:02.108238 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:10:03.108040 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:03.108001 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:10:03.108263 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:03.108150 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:10:03.108263 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:03.108209 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:10:03.108679 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:03.108323 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:10:03.322228 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:03.322184 2555 generic.go:356] "Generic (PLEG): container finished" podID="61bafc2e-da2c-4b35-8555-b19f06728459" containerID="647aeb2fe148becf78842b5f96fd8171ad9c4c21770b2329a0a2a50c3693c088" exitCode=0 Sep 10 12:10:03.322403 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:03.322267 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh5k8" event={"ID":"61bafc2e-da2c-4b35-8555-b19f06728459","Type":"ContainerDied","Data":"647aeb2fe148becf78842b5f96fd8171ad9c4c21770b2329a0a2a50c3693c088"} Sep 10 12:10:04.108533 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:04.108488 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:10:04.108929 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:04.108610 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:10:04.327427 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:04.327388 2555 generic.go:356] "Generic (PLEG): container finished" podID="61bafc2e-da2c-4b35-8555-b19f06728459" containerID="1db4c55edda8715cae0f3e0fec9fb228314c5988129d23d2d6a29df9822c5dcd" exitCode=0 Sep 10 12:10:04.327589 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:04.327433 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh5k8" event={"ID":"61bafc2e-da2c-4b35-8555-b19f06728459","Type":"ContainerDied","Data":"1db4c55edda8715cae0f3e0fec9fb228314c5988129d23d2d6a29df9822c5dcd"} Sep 10 12:10:05.108480 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:05.108441 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:10:05.108657 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:05.108581 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:10:05.108657 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:05.108632 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:10:05.108981 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:05.108754 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:10:05.332582 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:05.332541 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fh5k8" event={"ID":"61bafc2e-da2c-4b35-8555-b19f06728459","Type":"ContainerStarted","Data":"3298371dd3325abf89c5cb7e03b9aaf9adb5a4e5f983c2f58fd9366a9f6bc0c8"} Sep 10 12:10:05.365600 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:05.365513 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fh5k8" podStartSLOduration=8.449928028 podStartE2EDuration="38.365498757s" totalImagesPullingTime="29.915570729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:05.365396576 +0000 UTC m=+38.805284808" watchObservedRunningTime="2026-09-10 12:10:05.365498757 +0000 UTC m=+38.805386989" Sep 10 12:10:06.108199 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:06.108163 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:10:06.108384 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:06.108263 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:10:07.110149 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:07.109861 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:10:07.110531 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:07.109911 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:10:07.110531 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:07.110260 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:10:07.110531 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:07.110288 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:10:08.108728 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:08.108698 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:10:08.108905 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:08.108790 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:10:09.107967 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:09.107940 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:10:09.108522 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:09.108233 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:10:09.108642 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:09.108565 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:10:09.108701 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:09.108643 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:10:09.302840 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:09.302806 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-58d7t"] Sep 10 12:10:09.306194 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:09.306168 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wkm26"] Sep 10 12:10:09.306351 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:09.306283 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:10:09.306414 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:09.306391 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:10:09.318289 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:09.318177 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xwkm4"] Sep 10 12:10:09.343627 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:09.343589 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:10:09.343798 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:09.343740 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:10:09.343962 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:09.343943 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:10:09.344083 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:09.344049 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:10:11.107898 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:11.107858 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:10:11.108304 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:11.107858 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:10:11.108304 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:11.107994 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:10:11.108304 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:11.108048 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:10:11.108304 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:11.108183 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:10:11.108304 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:11.108293 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:10:13.108579 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.108543 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:10:13.109065 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.108545 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:10:13.109065 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:13.108682 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58d7t" podUID="6909e322-42f0-4d07-af43-4b79e0e8fc17" Sep 10 12:10:13.109065 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.108548 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:10:13.109065 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:13.108718 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xwkm4" podUID="9a81a977-6e78-4a35-bd30-af9397a90af6" Sep 10 12:10:13.109065 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:13.108796 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wkm26" podUID="1071b22c-5ab2-4e55-871c-05012ee83376" Sep 10 12:10:13.789836 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.789747 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-28.ec2.internal" event="NodeReady" Sep 10 12:10:13.790005 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.789898 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 12:10:13.847948 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.847915 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vv8np"] Sep 10 12:10:13.864433 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.864405 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pshwm"] Sep 10 12:10:13.864570 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.864547 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vv8np" Sep 10 12:10:13.867127 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.867099 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 12:10:13.867273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.867148 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r24lb\"" Sep 10 12:10:13.867273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.867190 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 12:10:13.874423 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.874405 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vv8np"] Sep 10 12:10:13.874521 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.874435 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pshwm"] Sep 10 12:10:13.874521 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.874507 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pshwm" Sep 10 12:10:13.876826 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.876807 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 12:10:13.877142 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.877127 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 12:10:13.877242 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.877227 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 12:10:13.877369 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.877356 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zzmgg\"" Sep 10 12:10:13.939300 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.939249 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fm4t6"] Sep 10 12:10:13.960261 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.960233 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fm4t6"] Sep 10 12:10:13.960411 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.960341 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:13.962774 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.962751 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9zfc5\"" Sep 10 12:10:13.962774 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.962761 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 12:10:13.963162 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.962793 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 12:10:13.963162 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.962900 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 12:10:13.963162 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:13.963060 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 12:10:14.015869 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.015839 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b91d97b-3893-4ef0-a425-4cec10dbb7c6-cert\") pod \"ingress-canary-pshwm\" (UID: \"1b91d97b-3893-4ef0-a425-4cec10dbb7c6\") " pod="openshift-ingress-canary/ingress-canary-pshwm" Sep 10 12:10:14.015869 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.015873 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d63e3a79-328d-4ba5-85d9-061bf56bb22c-tmp-dir\") pod \"dns-default-vv8np\" (UID: \"d63e3a79-328d-4ba5-85d9-061bf56bb22c\") " pod="openshift-dns/dns-default-vv8np" Sep 10 12:10:14.016058 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.015902 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d63e3a79-328d-4ba5-85d9-061bf56bb22c-config-volume\") pod \"dns-default-vv8np\" (UID: \"d63e3a79-328d-4ba5-85d9-061bf56bb22c\") " pod="openshift-dns/dns-default-vv8np" Sep 10 12:10:14.016058 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.015939 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ts4m\" (UniqueName: \"kubernetes.io/projected/1b91d97b-3893-4ef0-a425-4cec10dbb7c6-kube-api-access-5ts4m\") pod \"ingress-canary-pshwm\" (UID: \"1b91d97b-3893-4ef0-a425-4cec10dbb7c6\") " pod="openshift-ingress-canary/ingress-canary-pshwm" Sep 10 12:10:14.016058 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.015997 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d63e3a79-328d-4ba5-85d9-061bf56bb22c-metrics-tls\") pod \"dns-default-vv8np\" (UID: \"d63e3a79-328d-4ba5-85d9-061bf56bb22c\") " pod="openshift-dns/dns-default-vv8np" Sep 10 12:10:14.016058 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.016015 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnd9f\" (UniqueName: \"kubernetes.io/projected/d63e3a79-328d-4ba5-85d9-061bf56bb22c-kube-api-access-gnd9f\") pod \"dns-default-vv8np\" (UID: \"d63e3a79-328d-4ba5-85d9-061bf56bb22c\") " pod="openshift-dns/dns-default-vv8np" Sep 10 12:10:14.117093 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.116990 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9369ef1c-feea-4223-9bcf-a1a4e094fd3d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fm4t6\" (UID: \"9369ef1c-feea-4223-9bcf-a1a4e094fd3d\") " pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:14.117093 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.117033 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b91d97b-3893-4ef0-a425-4cec10dbb7c6-cert\") pod \"ingress-canary-pshwm\" (UID: \"1b91d97b-3893-4ef0-a425-4cec10dbb7c6\") " pod="openshift-ingress-canary/ingress-canary-pshwm" Sep 10 12:10:14.117093 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.117056 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d63e3a79-328d-4ba5-85d9-061bf56bb22c-tmp-dir\") pod \"dns-default-vv8np\" (UID: \"d63e3a79-328d-4ba5-85d9-061bf56bb22c\") " pod="openshift-dns/dns-default-vv8np" Sep 10 12:10:14.117667 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.117103 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9369ef1c-feea-4223-9bcf-a1a4e094fd3d-crio-socket\") pod \"insights-runtime-extractor-fm4t6\" (UID: \"9369ef1c-feea-4223-9bcf-a1a4e094fd3d\") " pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:14.117667 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.117133 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d63e3a79-328d-4ba5-85d9-061bf56bb22c-config-volume\") pod \"dns-default-vv8np\" (UID: \"d63e3a79-328d-4ba5-85d9-061bf56bb22c\") " pod="openshift-dns/dns-default-vv8np" Sep 10 12:10:14.117667 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.117157 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ts4m\" (UniqueName: \"kubernetes.io/projected/1b91d97b-3893-4ef0-a425-4cec10dbb7c6-kube-api-access-5ts4m\") pod \"ingress-canary-pshwm\" (UID: \"1b91d97b-3893-4ef0-a425-4cec10dbb7c6\") " pod="openshift-ingress-canary/ingress-canary-pshwm" Sep 10 12:10:14.117667 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.117173 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4f2j\" (UniqueName: \"kubernetes.io/projected/9369ef1c-feea-4223-9bcf-a1a4e094fd3d-kube-api-access-d4f2j\") pod \"insights-runtime-extractor-fm4t6\" (UID: \"9369ef1c-feea-4223-9bcf-a1a4e094fd3d\") " pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:14.117667 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.117201 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d63e3a79-328d-4ba5-85d9-061bf56bb22c-metrics-tls\") pod \"dns-default-vv8np\" (UID: \"d63e3a79-328d-4ba5-85d9-061bf56bb22c\") " pod="openshift-dns/dns-default-vv8np" Sep 10 12:10:14.117667 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.117261 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnd9f\" (UniqueName: \"kubernetes.io/projected/d63e3a79-328d-4ba5-85d9-061bf56bb22c-kube-api-access-gnd9f\") pod \"dns-default-vv8np\" (UID: \"d63e3a79-328d-4ba5-85d9-061bf56bb22c\") " pod="openshift-dns/dns-default-vv8np" Sep 10 12:10:14.117667 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.117310 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9369ef1c-feea-4223-9bcf-a1a4e094fd3d-data-volume\") pod \"insights-runtime-extractor-fm4t6\" (UID: \"9369ef1c-feea-4223-9bcf-a1a4e094fd3d\") " pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:14.117667 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.117338 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9369ef1c-feea-4223-9bcf-a1a4e094fd3d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fm4t6\" (UID: \"9369ef1c-feea-4223-9bcf-a1a4e094fd3d\") " pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:14.118088 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.118050 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d63e3a79-328d-4ba5-85d9-061bf56bb22c-config-volume\") pod \"dns-default-vv8np\" (UID: \"d63e3a79-328d-4ba5-85d9-061bf56bb22c\") " pod="openshift-dns/dns-default-vv8np" Sep 10 12:10:14.121263 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.121139 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d63e3a79-328d-4ba5-85d9-061bf56bb22c-metrics-tls\") pod \"dns-default-vv8np\" (UID: \"d63e3a79-328d-4ba5-85d9-061bf56bb22c\") " pod="openshift-dns/dns-default-vv8np" Sep 10 12:10:14.121350 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.121181 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b91d97b-3893-4ef0-a425-4cec10dbb7c6-cert\") pod \"ingress-canary-pshwm\" (UID: \"1b91d97b-3893-4ef0-a425-4cec10dbb7c6\") " pod="openshift-ingress-canary/ingress-canary-pshwm" Sep 10 12:10:14.125985 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.125963 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnd9f\" (UniqueName: \"kubernetes.io/projected/d63e3a79-328d-4ba5-85d9-061bf56bb22c-kube-api-access-gnd9f\") pod \"dns-default-vv8np\" (UID: \"d63e3a79-328d-4ba5-85d9-061bf56bb22c\") " pod="openshift-dns/dns-default-vv8np" Sep 10 12:10:14.126143 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.126126 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ts4m\" (UniqueName: \"kubernetes.io/projected/1b91d97b-3893-4ef0-a425-4cec10dbb7c6-kube-api-access-5ts4m\") pod \"ingress-canary-pshwm\" (UID: \"1b91d97b-3893-4ef0-a425-4cec10dbb7c6\") " pod="openshift-ingress-canary/ingress-canary-pshwm" Sep 10 12:10:14.128082 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.128049 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d63e3a79-328d-4ba5-85d9-061bf56bb22c-tmp-dir\") pod \"dns-default-vv8np\" (UID: \"d63e3a79-328d-4ba5-85d9-061bf56bb22c\") " pod="openshift-dns/dns-default-vv8np" Sep 10 12:10:14.175082 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.175031 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vv8np" Sep 10 12:10:14.182148 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.182121 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pshwm" Sep 10 12:10:14.217823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.217797 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9369ef1c-feea-4223-9bcf-a1a4e094fd3d-crio-socket\") pod \"insights-runtime-extractor-fm4t6\" (UID: \"9369ef1c-feea-4223-9bcf-a1a4e094fd3d\") " pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:14.217929 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.217840 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4f2j\" (UniqueName: \"kubernetes.io/projected/9369ef1c-feea-4223-9bcf-a1a4e094fd3d-kube-api-access-d4f2j\") pod \"insights-runtime-extractor-fm4t6\" (UID: \"9369ef1c-feea-4223-9bcf-a1a4e094fd3d\") " pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:14.217929 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.217867 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9369ef1c-feea-4223-9bcf-a1a4e094fd3d-data-volume\") pod \"insights-runtime-extractor-fm4t6\" (UID: \"9369ef1c-feea-4223-9bcf-a1a4e094fd3d\") " pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:14.217929 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.217892 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9369ef1c-feea-4223-9bcf-a1a4e094fd3d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fm4t6\" (UID: \"9369ef1c-feea-4223-9bcf-a1a4e094fd3d\") " pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:14.218106 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.217953 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9369ef1c-feea-4223-9bcf-a1a4e094fd3d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fm4t6\" (UID: \"9369ef1c-feea-4223-9bcf-a1a4e094fd3d\") " pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:14.218106 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.218038 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9369ef1c-feea-4223-9bcf-a1a4e094fd3d-crio-socket\") pod \"insights-runtime-extractor-fm4t6\" (UID: \"9369ef1c-feea-4223-9bcf-a1a4e094fd3d\") " pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:14.218337 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.218254 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9369ef1c-feea-4223-9bcf-a1a4e094fd3d-data-volume\") pod \"insights-runtime-extractor-fm4t6\" (UID: \"9369ef1c-feea-4223-9bcf-a1a4e094fd3d\") " pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:14.218549 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.218526 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9369ef1c-feea-4223-9bcf-a1a4e094fd3d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fm4t6\" (UID: \"9369ef1c-feea-4223-9bcf-a1a4e094fd3d\") " pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:14.220531 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.220505 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9369ef1c-feea-4223-9bcf-a1a4e094fd3d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fm4t6\" (UID: \"9369ef1c-feea-4223-9bcf-a1a4e094fd3d\") " pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:14.231846 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.231810 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4f2j\" (UniqueName: \"kubernetes.io/projected/9369ef1c-feea-4223-9bcf-a1a4e094fd3d-kube-api-access-d4f2j\") pod \"insights-runtime-extractor-fm4t6\" (UID: \"9369ef1c-feea-4223-9bcf-a1a4e094fd3d\") " pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:14.272947 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.270384 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fm4t6" Sep 10 12:10:14.493888 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.493858 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vv8np"] Sep 10 12:10:14.497714 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:14.497682 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63e3a79_328d_4ba5_85d9_061bf56bb22c.slice/crio-ede4b3aa27b5f7dd77a11429426992a1cff6fbfc392387b9f5eff463bffaa55c WatchSource:0}: Error finding container ede4b3aa27b5f7dd77a11429426992a1cff6fbfc392387b9f5eff463bffaa55c: Status 404 returned error can't find the container with id ede4b3aa27b5f7dd77a11429426992a1cff6fbfc392387b9f5eff463bffaa55c Sep 10 12:10:14.499979 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.499956 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pshwm"] Sep 10 12:10:14.503128 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:14.503105 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b91d97b_3893_4ef0_a425_4cec10dbb7c6.slice/crio-ef21df4937058c1d43c484b2ff654369f872b92235eb4b06e5ea3ee0a0f84c0b WatchSource:0}: Error finding container ef21df4937058c1d43c484b2ff654369f872b92235eb4b06e5ea3ee0a0f84c0b: Status 404 returned error can't find the container with id ef21df4937058c1d43c484b2ff654369f872b92235eb4b06e5ea3ee0a0f84c0b Sep 10 12:10:14.562584 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:14.562552 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fm4t6"] Sep 10 12:10:14.566221 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:14.566196 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9369ef1c_feea_4223_9bcf_a1a4e094fd3d.slice/crio-7087454ecd53846b2a1cb289ce8c4dce1b9eb4f4d0f2bf74ff354f0374802084 WatchSource:0}: Error finding container 7087454ecd53846b2a1cb289ce8c4dce1b9eb4f4d0f2bf74ff354f0374802084: Status 404 returned error can't find the container with id 7087454ecd53846b2a1cb289ce8c4dce1b9eb4f4d0f2bf74ff354f0374802084 Sep 10 12:10:15.108270 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:15.108237 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:10:15.108419 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:15.108237 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:10:15.108474 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:15.108407 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:10:15.110728 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:15.110698 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 12:10:15.110728 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:15.110698 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 12:10:15.111394 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:15.111372 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4nkk9\"" Sep 10 12:10:15.111521 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:15.111373 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-twc65\"" Sep 10 12:10:15.111521 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:15.111405 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 12:10:15.111672 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:15.111429 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 12:10:15.360228 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:15.360144 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fm4t6" event={"ID":"9369ef1c-feea-4223-9bcf-a1a4e094fd3d","Type":"ContainerStarted","Data":"9e5493e4b464f9e17250bb376b919d3a29df5db71d6213ec629a098a1b0c9e55"} Sep 10 12:10:15.360228 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:15.360209 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fm4t6" event={"ID":"9369ef1c-feea-4223-9bcf-a1a4e094fd3d","Type":"ContainerStarted","Data":"7087454ecd53846b2a1cb289ce8c4dce1b9eb4f4d0f2bf74ff354f0374802084"} Sep 10 12:10:15.361530 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:15.361501 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pshwm" event={"ID":"1b91d97b-3893-4ef0-a425-4cec10dbb7c6","Type":"ContainerStarted","Data":"ef21df4937058c1d43c484b2ff654369f872b92235eb4b06e5ea3ee0a0f84c0b"} Sep 10 12:10:15.363062 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:15.363028 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vv8np" event={"ID":"d63e3a79-328d-4ba5-85d9-061bf56bb22c","Type":"ContainerStarted","Data":"ede4b3aa27b5f7dd77a11429426992a1cff6fbfc392387b9f5eff463bffaa55c"} Sep 10 12:10:16.181544 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:16.181463 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9fq5x"] Sep 10 12:10:16.198630 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:16.198601 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9fq5x"] Sep 10 12:10:16.198783 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:16.198717 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9fq5x" Sep 10 12:10:16.201019 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:16.200876 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 10 12:10:16.201019 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:16.200923 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pcmxf\"" Sep 10 12:10:16.334290 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:16.334250 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e289a864-7824-4ffe-b5a3-0587b4da5e0d-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-9fq5x\" (UID: \"e289a864-7824-4ffe-b5a3-0587b4da5e0d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9fq5x" Sep 10 12:10:16.368663 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:16.368621 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fm4t6" event={"ID":"9369ef1c-feea-4223-9bcf-a1a4e094fd3d","Type":"ContainerStarted","Data":"696687a0e8cba7d90be60d291dc8d6af7c84523c842847dc736f7227888e2fd5"} Sep 10 12:10:16.435371 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:16.435270 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e289a864-7824-4ffe-b5a3-0587b4da5e0d-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-9fq5x\" (UID: \"e289a864-7824-4ffe-b5a3-0587b4da5e0d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9fq5x" Sep 10 12:10:16.435535 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:16.435467 2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 10 12:10:16.435599 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:16.435545 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e289a864-7824-4ffe-b5a3-0587b4da5e0d-tls-certificates podName:e289a864-7824-4ffe-b5a3-0587b4da5e0d nodeName:}" failed. No retries permitted until 2026-09-10 12:10:16.935521316 +0000 UTC m=+50.375409530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e289a864-7824-4ffe-b5a3-0587b4da5e0d-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-9fq5x" (UID: "e289a864-7824-4ffe-b5a3-0587b4da5e0d") : secret "prometheus-operator-admission-webhook-tls" not found Sep 10 12:10:16.938288 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:16.938244 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e289a864-7824-4ffe-b5a3-0587b4da5e0d-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-9fq5x\" (UID: \"e289a864-7824-4ffe-b5a3-0587b4da5e0d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9fq5x" Sep 10 12:10:16.941365 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:16.941336 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e289a864-7824-4ffe-b5a3-0587b4da5e0d-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-9fq5x\" (UID: \"e289a864-7824-4ffe-b5a3-0587b4da5e0d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9fq5x" Sep 10 12:10:17.055990 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.055948 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c7fbc88d7-xm672"] Sep 10 12:10:17.070852 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.070822 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.074024 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.073998 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 12:10:17.074024 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.074015 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 12:10:17.074246 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.074054 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 12:10:17.074246 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.074108 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 12:10:17.074246 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.073999 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z7bj2\"" Sep 10 12:10:17.074246 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.074053 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 12:10:17.074246 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.074171 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 12:10:17.074492 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.074471 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 12:10:17.103548 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.103517 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7fbc88d7-xm672"] Sep 10 12:10:17.110580 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.110561 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9fq5x" Sep 10 12:10:17.138855 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.138831 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-serving-cert\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.138997 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.138868 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-oauth-serving-cert\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.138997 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.138898 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-config\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.138997 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.138957 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-oauth-config\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.138997 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.138985 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkqgd\" (UniqueName: \"kubernetes.io/projected/eb310996-fdc9-45b8-b2e8-74c441e0d69f-kube-api-access-qkqgd\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.139275 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.139050 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-service-ca\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.240346 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.240267 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-service-ca\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.240346 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.240341 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-serving-cert\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.240591 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.240360 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-oauth-serving-cert\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.240591 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.240530 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-config\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.240704 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.240595 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-oauth-config\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.240704 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.240628 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkqgd\" (UniqueName: \"kubernetes.io/projected/eb310996-fdc9-45b8-b2e8-74c441e0d69f-kube-api-access-qkqgd\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.241219 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.241176 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-oauth-serving-cert\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.241352 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.241230 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-service-ca\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.241525 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.241407 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-config\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.243614 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.243589 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-oauth-config\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.243834 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.243815 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-serving-cert\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.251784 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.251759 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkqgd\" (UniqueName: \"kubernetes.io/projected/eb310996-fdc9-45b8-b2e8-74c441e0d69f-kube-api-access-qkqgd\") pod \"console-5c7fbc88d7-xm672\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:17.383459 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:17.383412 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:18.195577 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:18.195547 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7fbc88d7-xm672"] Sep 10 12:10:18.204366 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:18.204340 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9fq5x"] Sep 10 12:10:18.328810 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:18.328768 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb310996_fdc9_45b8_b2e8_74c441e0d69f.slice/crio-11b206db4285061254269785cb3ecce7767634cf8a90c8383910bf37d2eb9148 WatchSource:0}: Error finding container 11b206db4285061254269785cb3ecce7767634cf8a90c8383910bf37d2eb9148: Status 404 returned error can't find the container with id 11b206db4285061254269785cb3ecce7767634cf8a90c8383910bf37d2eb9148 Sep 10 12:10:18.329642 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:18.329583 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode289a864_7824_4ffe_b5a3_0587b4da5e0d.slice/crio-e675e96c54831197ed9ffb678663e5c2a945a4b75799115bedbb1b61a2a78705 WatchSource:0}: Error finding container e675e96c54831197ed9ffb678663e5c2a945a4b75799115bedbb1b61a2a78705: Status 404 returned error can't find the container with id e675e96c54831197ed9ffb678663e5c2a945a4b75799115bedbb1b61a2a78705 Sep 10 12:10:18.376442 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:18.376407 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7fbc88d7-xm672" event={"ID":"eb310996-fdc9-45b8-b2e8-74c441e0d69f","Type":"ContainerStarted","Data":"11b206db4285061254269785cb3ecce7767634cf8a90c8383910bf37d2eb9148"} Sep 10 12:10:18.377889 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:18.377861 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9fq5x" event={"ID":"e289a864-7824-4ffe-b5a3-0587b4da5e0d","Type":"ContainerStarted","Data":"e675e96c54831197ed9ffb678663e5c2a945a4b75799115bedbb1b61a2a78705"} Sep 10 12:10:19.383408 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:19.383185 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pshwm" event={"ID":"1b91d97b-3893-4ef0-a425-4cec10dbb7c6","Type":"ContainerStarted","Data":"2d1a1a95e9cadf31580ab68f5e4b0aefb1f3a1e328dcb40f581d1c82ea528276"} Sep 10 12:10:19.385273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:19.385244 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fm4t6" event={"ID":"9369ef1c-feea-4223-9bcf-a1a4e094fd3d","Type":"ContainerStarted","Data":"f8b33d23b9af3f4d764fb064957250a7e54bb34f90316e06bcbdeb7c87ce3ba9"} Sep 10 12:10:19.387015 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:19.386993 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vv8np" event={"ID":"d63e3a79-328d-4ba5-85d9-061bf56bb22c","Type":"ContainerStarted","Data":"b38c6701d1ee48b65c3ccef56d335e861773bdf4ed18ec4299580fe9ddfda78d"} Sep 10 12:10:19.387111 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:19.387029 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vv8np" event={"ID":"d63e3a79-328d-4ba5-85d9-061bf56bb22c","Type":"ContainerStarted","Data":"1ba400126a2e3fbd1b1710695ae942e625148e8581e8915b4d608c68370a2e46"} Sep 10 12:10:19.387111 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:19.387100 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vv8np" Sep 10 12:10:19.414673 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:19.414631 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vv8np" podStartSLOduration=2.584970648 podStartE2EDuration="6.414616831s" totalImagesPullingTime="3.829646183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:19.414110405 +0000 UTC m=+52.853998658" watchObservedRunningTime="2026-09-10 12:10:19.414616831 +0000 UTC m=+52.854505117" Sep 10 12:10:19.414978 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:19.414959 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pshwm" podStartSLOduration=2.589945549 podStartE2EDuration="6.414953855s" totalImagesPullingTime="3.825008306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:19.398096617 +0000 UTC m=+52.837984867" watchObservedRunningTime="2026-09-10 12:10:19.414953855 +0000 UTC m=+52.854842104" Sep 10 12:10:19.431970 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:19.431923 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fm4t6" podStartSLOduration=2.888150821 podStartE2EDuration="6.431909341s" totalImagesPullingTime="3.54375852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:10:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:19.431557851 +0000 UTC m=+52.871446107" watchObservedRunningTime="2026-09-10 12:10:19.431909341 +0000 UTC m=+52.871797574" Sep 10 12:10:20.392500 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:20.392450 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9fq5x" event={"ID":"e289a864-7824-4ffe-b5a3-0587b4da5e0d","Type":"ContainerStarted","Data":"3c42d034ce0d28aa71ada246533b7dce555a18b940fedcb6e3d36d6c3e1633da"} Sep 10 12:10:20.393307 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:20.393222 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9fq5x" Sep 10 12:10:20.397921 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:20.397901 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9fq5x" Sep 10 12:10:20.408170 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:20.408121 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9fq5x" podStartSLOduration=2.920825565 podStartE2EDuration="4.408104129s" totalImagesPullingTime="1.487278564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:20.407596359 +0000 UTC m=+53.847484618" watchObservedRunningTime="2026-09-10 12:10:20.408104129 +0000 UTC m=+53.847992363" Sep 10 12:10:21.271114 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.271081 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-hz6z4"] Sep 10 12:10:21.273109 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.273086 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" Sep 10 12:10:21.275305 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.275284 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 10 12:10:21.275828 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.275291 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 10 12:10:21.276486 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.276464 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 12:10:21.277357 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.276829 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-79qnm\"" Sep 10 12:10:21.277357 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.276901 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 12:10:21.277357 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.277267 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 12:10:21.286694 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.286660 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-hz6z4"] Sep 10 12:10:21.376271 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.376225 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b92ee30d-637d-456c-ab0b-761b78e9f101-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-hz6z4\" (UID: \"b92ee30d-637d-456c-ab0b-761b78e9f101\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" Sep 10 12:10:21.376271 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.376275 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b92ee30d-637d-456c-ab0b-761b78e9f101-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-hz6z4\" (UID: \"b92ee30d-637d-456c-ab0b-761b78e9f101\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" Sep 10 12:10:21.376495 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.376347 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92ee30d-637d-456c-ab0b-761b78e9f101-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-hz6z4\" (UID: \"b92ee30d-637d-456c-ab0b-761b78e9f101\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" Sep 10 12:10:21.376495 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.376383 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf7wn\" (UniqueName: \"kubernetes.io/projected/b92ee30d-637d-456c-ab0b-761b78e9f101-kube-api-access-cf7wn\") pod \"prometheus-operator-6f4946db56-hz6z4\" (UID: \"b92ee30d-637d-456c-ab0b-761b78e9f101\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" Sep 10 12:10:21.477285 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.477247 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b92ee30d-637d-456c-ab0b-761b78e9f101-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-hz6z4\" (UID: \"b92ee30d-637d-456c-ab0b-761b78e9f101\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" Sep 10 12:10:21.477768 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.477301 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b92ee30d-637d-456c-ab0b-761b78e9f101-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-hz6z4\" (UID: \"b92ee30d-637d-456c-ab0b-761b78e9f101\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" Sep 10 12:10:21.477768 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.477340 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92ee30d-637d-456c-ab0b-761b78e9f101-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-hz6z4\" (UID: \"b92ee30d-637d-456c-ab0b-761b78e9f101\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" Sep 10 12:10:21.477768 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.477362 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf7wn\" (UniqueName: \"kubernetes.io/projected/b92ee30d-637d-456c-ab0b-761b78e9f101-kube-api-access-cf7wn\") pod \"prometheus-operator-6f4946db56-hz6z4\" (UID: \"b92ee30d-637d-456c-ab0b-761b78e9f101\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" Sep 10 12:10:21.478175 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.478150 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92ee30d-637d-456c-ab0b-761b78e9f101-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-hz6z4\" (UID: \"b92ee30d-637d-456c-ab0b-761b78e9f101\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" Sep 10 12:10:21.481404 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.481373 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b92ee30d-637d-456c-ab0b-761b78e9f101-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-hz6z4\" (UID: \"b92ee30d-637d-456c-ab0b-761b78e9f101\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" Sep 10 12:10:21.481529 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.481378 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b92ee30d-637d-456c-ab0b-761b78e9f101-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-hz6z4\" (UID: \"b92ee30d-637d-456c-ab0b-761b78e9f101\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" Sep 10 12:10:21.486097 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.486039 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf7wn\" (UniqueName: \"kubernetes.io/projected/b92ee30d-637d-456c-ab0b-761b78e9f101-kube-api-access-cf7wn\") pod \"prometheus-operator-6f4946db56-hz6z4\" (UID: \"b92ee30d-637d-456c-ab0b-761b78e9f101\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" Sep 10 12:10:21.587128 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:21.587040 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" Sep 10 12:10:22.511107 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.511059 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55f6c7d5b4-lsc4m"] Sep 10 12:10:22.513020 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.513002 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.520875 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.520856 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 12:10:22.528049 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.528031 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f6c7d5b4-lsc4m"] Sep 10 12:10:22.612626 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.612538 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-hz6z4"] Sep 10 12:10:22.616246 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:22.616217 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92ee30d_637d_456c_ab0b_761b78e9f101.slice/crio-b04551c6a07bdbe7d90a08346f1caa0d5991c9438458dc4948530b1a8b3e431f WatchSource:0}: Error finding container b04551c6a07bdbe7d90a08346f1caa0d5991c9438458dc4948530b1a8b3e431f: Status 404 returned error can't find the container with id b04551c6a07bdbe7d90a08346f1caa0d5991c9438458dc4948530b1a8b3e431f Sep 10 12:10:22.688352 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.688309 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-config\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.688352 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.688354 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-oauth-config\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.688583 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.688382 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-trusted-ca-bundle\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.688583 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.688399 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-service-ca\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.688583 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.688459 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-serving-cert\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.688583 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.688497 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99bwl\" (UniqueName: \"kubernetes.io/projected/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-kube-api-access-99bwl\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.688583 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.688536 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-oauth-serving-cert\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.789671 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.789628 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-trusted-ca-bundle\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.789671 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.789670 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-service-ca\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.789892 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.789705 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-serving-cert\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.789892 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.789722 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99bwl\" (UniqueName: \"kubernetes.io/projected/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-kube-api-access-99bwl\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.789892 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.789752 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-oauth-serving-cert\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.789892 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.789788 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-config\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.789892 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.789812 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-oauth-config\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.790627 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.790594 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-oauth-serving-cert\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.790756 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.790630 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-service-ca\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.790756 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.790720 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-config\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.791140 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.791117 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-trusted-ca-bundle\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.792239 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.792219 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-oauth-config\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.792343 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.792325 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-serving-cert\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.805833 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.805806 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99bwl\" (UniqueName: \"kubernetes.io/projected/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-kube-api-access-99bwl\") pod \"console-55f6c7d5b4-lsc4m\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:22.822710 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:22.822679 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:23.091576 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:23.091543 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f6c7d5b4-lsc4m"] Sep 10 12:10:23.094610 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:23.094575 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f3f7aba_1f2c_4a9b_b873_7042e96395b7.slice/crio-bbb06b793ef95a95d646779c11483bd4a237c0f436445828ea6f976f6e5d454b WatchSource:0}: Error finding container bbb06b793ef95a95d646779c11483bd4a237c0f436445828ea6f976f6e5d454b: Status 404 returned error can't find the container with id bbb06b793ef95a95d646779c11483bd4a237c0f436445828ea6f976f6e5d454b Sep 10 12:10:23.408261 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:23.408166 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7fbc88d7-xm672" event={"ID":"eb310996-fdc9-45b8-b2e8-74c441e0d69f","Type":"ContainerStarted","Data":"d7c1c5926b4ac805e9e768aff3ac969cfc752483641cac08b553b233e82289d6"} Sep 10 12:10:23.411853 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:23.411825 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f6c7d5b4-lsc4m" event={"ID":"1f3f7aba-1f2c-4a9b-b873-7042e96395b7","Type":"ContainerStarted","Data":"42a0bb2e3f44c729df69595fa95929b6c64e1057c8d112e095a9a5d14fde7814"} Sep 10 12:10:23.412007 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:23.411862 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f6c7d5b4-lsc4m" event={"ID":"1f3f7aba-1f2c-4a9b-b873-7042e96395b7","Type":"ContainerStarted","Data":"bbb06b793ef95a95d646779c11483bd4a237c0f436445828ea6f976f6e5d454b"} Sep 10 12:10:23.413017 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:23.412995 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" event={"ID":"b92ee30d-637d-456c-ab0b-761b78e9f101","Type":"ContainerStarted","Data":"b04551c6a07bdbe7d90a08346f1caa0d5991c9438458dc4948530b1a8b3e431f"} Sep 10 12:10:23.450158 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:23.450101 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c7fbc88d7-xm672" podStartSLOduration=2.407616047 podStartE2EDuration="6.45008343s" totalImagesPullingTime="4.042467383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:23.430818866 +0000 UTC m=+56.870707100" watchObservedRunningTime="2026-09-10 12:10:23.45008343 +0000 UTC m=+56.889971677" Sep 10 12:10:23.450350 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:23.450329 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55f6c7d5b4-lsc4m" podStartSLOduration=1.450323268 podStartE2EDuration="1.450323268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:23.449346206 +0000 UTC m=+56.889234460" watchObservedRunningTime="2026-09-10 12:10:23.450323268 +0000 UTC m=+56.890211501" Sep 10 12:10:25.421922 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:25.421838 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" event={"ID":"b92ee30d-637d-456c-ab0b-761b78e9f101","Type":"ContainerStarted","Data":"6d5d9022639d6eee07b97631f92631fe5313cca2c49ac23a71aa7f69862d62d5"} Sep 10 12:10:25.421922 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:25.421896 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" event={"ID":"b92ee30d-637d-456c-ab0b-761b78e9f101","Type":"ContainerStarted","Data":"a4e74709df01bb30cadb3fff601a03ae2212c43adabb20be0f0a28b653c01b25"} Sep 10 12:10:25.439601 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:25.439553 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-hz6z4" podStartSLOduration=2.347489817 podStartE2EDuration="4.439536708s" totalImagesPullingTime="2.092046891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:25.438470676 +0000 UTC m=+58.878358934" watchObservedRunningTime="2026-09-10 12:10:25.439536708 +0000 UTC m=+58.879424940" Sep 10 12:10:27.315777 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.315747 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-49qv8" Sep 10 12:10:27.383873 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.383832 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:27.384023 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.383906 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:27.388653 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.388630 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:27.432540 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.432510 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:10:27.706344 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.706310 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-df48q"] Sep 10 12:10:27.709331 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.709307 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" Sep 10 12:10:27.711399 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.711377 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 10 12:10:27.711617 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.711601 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-c7bqk\"" Sep 10 12:10:27.711708 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.711691 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 10 12:10:27.727119 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.727097 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-df48q"] Sep 10 12:10:27.798991 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.798957 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-xpb48"] Sep 10 12:10:27.801137 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.801122 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:27.803761 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.803739 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 10 12:10:27.803761 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.803744 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 10 12:10:27.803959 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.803798 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-shrd9\"" Sep 10 12:10:27.803959 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.803911 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 10 12:10:27.820097 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.820050 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-xpb48"] Sep 10 12:10:27.820909 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.820887 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pm9cx"] Sep 10 12:10:27.823139 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.823119 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:27.825219 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.825201 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 12:10:27.825781 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.825762 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2ksmx\"" Sep 10 12:10:27.825852 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.825766 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 12:10:27.825910 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.825884 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 12:10:27.831905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.831886 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/644b2ea1-47fe-438c-b99a-ca044e3ad3aa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-df48q\" (UID: \"644b2ea1-47fe-438c-b99a-ca044e3ad3aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" Sep 10 12:10:27.831984 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.831929 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/644b2ea1-47fe-438c-b99a-ca044e3ad3aa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-df48q\" (UID: \"644b2ea1-47fe-438c-b99a-ca044e3ad3aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" Sep 10 12:10:27.831984 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.831959 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hps8z\" (UniqueName: \"kubernetes.io/projected/644b2ea1-47fe-438c-b99a-ca044e3ad3aa-kube-api-access-hps8z\") pod \"openshift-state-metrics-657fd6c54-df48q\" (UID: \"644b2ea1-47fe-438c-b99a-ca044e3ad3aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" Sep 10 12:10:27.832061 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.832025 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/644b2ea1-47fe-438c-b99a-ca044e3ad3aa-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-df48q\" (UID: \"644b2ea1-47fe-438c-b99a-ca044e3ad3aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" Sep 10 12:10:27.932539 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.932492 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb122167-7438-4a13-8180-775494053f0d-node-exporter-accelerators-collector-config\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:27.932539 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.932540 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1277d546-5b24-422f-8cdf-8e948452297b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:27.932764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.932619 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/644b2ea1-47fe-438c-b99a-ca044e3ad3aa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-df48q\" (UID: \"644b2ea1-47fe-438c-b99a-ca044e3ad3aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" Sep 10 12:10:27.932764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.932652 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb122167-7438-4a13-8180-775494053f0d-node-exporter-wtmp\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:27.932764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.932684 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb122167-7438-4a13-8180-775494053f0d-sys\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:27.932764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.932734 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1277d546-5b24-422f-8cdf-8e948452297b-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:27.932937 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.932776 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/644b2ea1-47fe-438c-b99a-ca044e3ad3aa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-df48q\" (UID: \"644b2ea1-47fe-438c-b99a-ca044e3ad3aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" Sep 10 12:10:27.932937 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.932795 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1277d546-5b24-422f-8cdf-8e948452297b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:27.932937 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.932817 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb122167-7438-4a13-8180-775494053f0d-root\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:27.932937 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.932843 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb122167-7438-4a13-8180-775494053f0d-metrics-client-ca\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:27.932937 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.932919 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1277d546-5b24-422f-8cdf-8e948452297b-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:27.933196 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.932948 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb122167-7438-4a13-8180-775494053f0d-node-exporter-tls\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:27.933196 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.932967 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb122167-7438-4a13-8180-775494053f0d-node-exporter-textfile\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:27.933196 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.932992 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1277d546-5b24-422f-8cdf-8e948452297b-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:27.933196 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.933024 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb122167-7438-4a13-8180-775494053f0d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:27.933196 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.933090 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hps8z\" (UniqueName: \"kubernetes.io/projected/644b2ea1-47fe-438c-b99a-ca044e3ad3aa-kube-api-access-hps8z\") pod \"openshift-state-metrics-657fd6c54-df48q\" (UID: \"644b2ea1-47fe-438c-b99a-ca044e3ad3aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" Sep 10 12:10:27.933196 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.933134 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whdsx\" (UniqueName: \"kubernetes.io/projected/1277d546-5b24-422f-8cdf-8e948452297b-kube-api-access-whdsx\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:27.933196 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.933156 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/644b2ea1-47fe-438c-b99a-ca044e3ad3aa-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-df48q\" (UID: \"644b2ea1-47fe-438c-b99a-ca044e3ad3aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" Sep 10 12:10:27.933196 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.933177 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjz4h\" (UniqueName: \"kubernetes.io/projected/eb122167-7438-4a13-8180-775494053f0d-kube-api-access-cjz4h\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:27.933819 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.933798 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/644b2ea1-47fe-438c-b99a-ca044e3ad3aa-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-df48q\" (UID: \"644b2ea1-47fe-438c-b99a-ca044e3ad3aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" Sep 10 12:10:27.935277 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.935254 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/644b2ea1-47fe-438c-b99a-ca044e3ad3aa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-df48q\" (UID: \"644b2ea1-47fe-438c-b99a-ca044e3ad3aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" Sep 10 12:10:27.935277 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.935264 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/644b2ea1-47fe-438c-b99a-ca044e3ad3aa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-df48q\" (UID: \"644b2ea1-47fe-438c-b99a-ca044e3ad3aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" Sep 10 12:10:27.943214 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:27.943188 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hps8z\" (UniqueName: \"kubernetes.io/projected/644b2ea1-47fe-438c-b99a-ca044e3ad3aa-kube-api-access-hps8z\") pod \"openshift-state-metrics-657fd6c54-df48q\" (UID: \"644b2ea1-47fe-438c-b99a-ca044e3ad3aa\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" Sep 10 12:10:28.018359 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.018259 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" Sep 10 12:10:28.034500 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.034474 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb122167-7438-4a13-8180-775494053f0d-node-exporter-accelerators-collector-config\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.034615 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.034506 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1277d546-5b24-422f-8cdf-8e948452297b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:28.034615 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.034533 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb122167-7438-4a13-8180-775494053f0d-node-exporter-wtmp\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.034741 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.034645 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb122167-7438-4a13-8180-775494053f0d-node-exporter-wtmp\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.034741 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.034664 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb122167-7438-4a13-8180-775494053f0d-sys\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.034741 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.034696 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1277d546-5b24-422f-8cdf-8e948452297b-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:28.034741 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.034726 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1277d546-5b24-422f-8cdf-8e948452297b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:28.034931 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.034755 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb122167-7438-4a13-8180-775494053f0d-root\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.034931 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.034756 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb122167-7438-4a13-8180-775494053f0d-sys\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.034931 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.034806 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb122167-7438-4a13-8180-775494053f0d-root\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.034931 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.034810 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb122167-7438-4a13-8180-775494053f0d-metrics-client-ca\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.034931 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.034860 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1277d546-5b24-422f-8cdf-8e948452297b-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:28.034931 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.034887 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb122167-7438-4a13-8180-775494053f0d-node-exporter-tls\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.034931 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.034915 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb122167-7438-4a13-8180-775494053f0d-node-exporter-textfile\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.035278 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.034945 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1277d546-5b24-422f-8cdf-8e948452297b-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:28.035278 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.034971 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb122167-7438-4a13-8180-775494053f0d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.035278 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:28.035085 2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 12:10:28.035278 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:28.035161 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb122167-7438-4a13-8180-775494053f0d-node-exporter-tls podName:eb122167-7438-4a13-8180-775494053f0d nodeName:}" failed. No retries permitted until 2026-09-10 12:10:28.535141228 +0000 UTC m=+61.975029454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/eb122167-7438-4a13-8180-775494053f0d-node-exporter-tls") pod "node-exporter-pm9cx" (UID: "eb122167-7438-4a13-8180-775494053f0d") : secret "node-exporter-tls" not found Sep 10 12:10:28.035278 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.035206 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb122167-7438-4a13-8180-775494053f0d-node-exporter-accelerators-collector-config\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.035278 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.035277 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whdsx\" (UniqueName: \"kubernetes.io/projected/1277d546-5b24-422f-8cdf-8e948452297b-kube-api-access-whdsx\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:28.035550 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.035316 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjz4h\" (UniqueName: \"kubernetes.io/projected/eb122167-7438-4a13-8180-775494053f0d-kube-api-access-cjz4h\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.035550 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.035354 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb122167-7438-4a13-8180-775494053f0d-metrics-client-ca\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.035550 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:28.035450 2555 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 10 12:10:28.035550 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.035454 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1277d546-5b24-422f-8cdf-8e948452297b-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:28.035550 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.035462 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1277d546-5b24-422f-8cdf-8e948452297b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:28.035550 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:28.035516 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1277d546-5b24-422f-8cdf-8e948452297b-kube-state-metrics-tls podName:1277d546-5b24-422f-8cdf-8e948452297b nodeName:}" failed. No retries permitted until 2026-09-10 12:10:28.535500361 +0000 UTC m=+61.975388587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1277d546-5b24-422f-8cdf-8e948452297b-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-xpb48" (UID: "1277d546-5b24-422f-8cdf-8e948452297b") : secret "kube-state-metrics-tls" not found Sep 10 12:10:28.035780 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.035645 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb122167-7438-4a13-8180-775494053f0d-node-exporter-textfile\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.035780 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.035728 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1277d546-5b24-422f-8cdf-8e948452297b-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:28.037350 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.037329 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb122167-7438-4a13-8180-775494053f0d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.037683 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.037661 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1277d546-5b24-422f-8cdf-8e948452297b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:28.056865 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.056809 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whdsx\" (UniqueName: \"kubernetes.io/projected/1277d546-5b24-422f-8cdf-8e948452297b-kube-api-access-whdsx\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:28.057007 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.056983 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjz4h\" (UniqueName: \"kubernetes.io/projected/eb122167-7438-4a13-8180-775494053f0d-kube-api-access-cjz4h\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.292270 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.292180 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-df48q"] Sep 10 12:10:28.295313 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:28.295286 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod644b2ea1_47fe_438c_b99a_ca044e3ad3aa.slice/crio-fe23a436306136bdc3c4ceb9c1e7780d01cd40ad793ed0087ed4812025f0c593 WatchSource:0}: Error finding container fe23a436306136bdc3c4ceb9c1e7780d01cd40ad793ed0087ed4812025f0c593: Status 404 returned error can't find the container with id fe23a436306136bdc3c4ceb9c1e7780d01cd40ad793ed0087ed4812025f0c593 Sep 10 12:10:28.434820 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.434783 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" event={"ID":"644b2ea1-47fe-438c-b99a-ca044e3ad3aa","Type":"ContainerStarted","Data":"1a57dcd42e35a4440705177445649ca30cfaa19a7d000769d0014f2384023a47"} Sep 10 12:10:28.435170 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.434866 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" event={"ID":"644b2ea1-47fe-438c-b99a-ca044e3ad3aa","Type":"ContainerStarted","Data":"5c84567f25c6c2eef077ef5ff78f0148fa5ac7acf1b6ba0c02b83eb74f586783"} Sep 10 12:10:28.435170 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.434893 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" event={"ID":"644b2ea1-47fe-438c-b99a-ca044e3ad3aa","Type":"ContainerStarted","Data":"fe23a436306136bdc3c4ceb9c1e7780d01cd40ad793ed0087ed4812025f0c593"} Sep 10 12:10:28.538008 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.537973 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb122167-7438-4a13-8180-775494053f0d-node-exporter-tls\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.538230 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.538119 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1277d546-5b24-422f-8cdf-8e948452297b-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:28.540340 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.540311 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb122167-7438-4a13-8180-775494053f0d-node-exporter-tls\") pod \"node-exporter-pm9cx\" (UID: \"eb122167-7438-4a13-8180-775494053f0d\") " pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.540452 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.540401 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1277d546-5b24-422f-8cdf-8e948452297b-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-xpb48\" (UID: \"1277d546-5b24-422f-8cdf-8e948452297b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:28.710418 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.710378 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" Sep 10 12:10:28.731325 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.731295 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pm9cx" Sep 10 12:10:28.737680 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.737652 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:10:28.740361 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.740339 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.741397 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:28.741373 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb122167_7438_4a13_8180_775494053f0d.slice/crio-28cc95f99c91d33bb419ab82df208db11d5fb39cbab594a40f19550e7f0932df WatchSource:0}: Error finding container 28cc95f99c91d33bb419ab82df208db11d5fb39cbab594a40f19550e7f0932df: Status 404 returned error can't find the container with id 28cc95f99c91d33bb419ab82df208db11d5fb39cbab594a40f19550e7f0932df Sep 10 12:10:28.743043 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.743022 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 12:10:28.743149 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.743022 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 12:10:28.743309 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.743228 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 12:10:28.743360 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.743320 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 12:10:28.743531 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.743514 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 12:10:28.743600 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.743545 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 12:10:28.743600 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.743561 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 12:10:28.743600 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.743567 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 12:10:28.743751 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.743515 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jpnr5\"" Sep 10 12:10:28.743908 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.743885 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 12:10:28.763721 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.763692 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:10:28.841039 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.841009 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7b605dc-ff44-440b-a637-71516c5d996a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.841039 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.841041 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7b605dc-ff44-440b-a637-71516c5d996a-config-out\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.841265 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.841061 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.841265 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.841093 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.841265 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.841169 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.841265 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.841225 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.841265 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.841257 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7b605dc-ff44-440b-a637-71516c5d996a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.841410 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.841290 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b605dc-ff44-440b-a637-71516c5d996a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.841410 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.841312 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzmvh\" (UniqueName: \"kubernetes.io/projected/b7b605dc-ff44-440b-a637-71516c5d996a-kube-api-access-tzmvh\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.841410 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.841332 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7b605dc-ff44-440b-a637-71516c5d996a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.841410 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.841348 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-config-volume\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.841410 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.841365 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.841410 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.841383 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-web-config\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.942579 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.942531 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.942747 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.942622 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.942747 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.942666 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7b605dc-ff44-440b-a637-71516c5d996a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.942747 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.942696 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b605dc-ff44-440b-a637-71516c5d996a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.942747 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.942718 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzmvh\" (UniqueName: \"kubernetes.io/projected/b7b605dc-ff44-440b-a637-71516c5d996a-kube-api-access-tzmvh\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.942951 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.942744 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7b605dc-ff44-440b-a637-71516c5d996a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.942951 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.942773 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-config-volume\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.942951 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:10:28.942839 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b7b605dc-ff44-440b-a637-71516c5d996a-alertmanager-trusted-ca-bundle podName:b7b605dc-ff44-440b-a637-71516c5d996a nodeName:}" failed. No retries permitted until 2026-09-10 12:10:29.442816339 +0000 UTC m=+62.882704554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/b7b605dc-ff44-440b-a637-71516c5d996a-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "b7b605dc-ff44-440b-a637-71516c5d996a") : configmap references non-existent config key: ca-bundle.crt Sep 10 12:10:28.942951 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.942873 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.942951 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.942911 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-web-config\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.943235 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.942988 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7b605dc-ff44-440b-a637-71516c5d996a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.943235 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.943014 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7b605dc-ff44-440b-a637-71516c5d996a-config-out\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.943235 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.943040 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.943235 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.943104 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.943235 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.943216 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7b605dc-ff44-440b-a637-71516c5d996a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.944011 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.943985 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7b605dc-ff44-440b-a637-71516c5d996a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.945828 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.945802 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.945959 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.945848 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7b605dc-ff44-440b-a637-71516c5d996a-config-out\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.946248 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.946230 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.946348 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.946296 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-web-config\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.946617 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.946595 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.946710 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.946694 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-config-volume\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.947229 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.947212 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.947628 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.947598 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7b605dc-ff44-440b-a637-71516c5d996a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.948146 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.948129 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.953943 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.953921 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzmvh\" (UniqueName: \"kubernetes.io/projected/b7b605dc-ff44-440b-a637-71516c5d996a-kube-api-access-tzmvh\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:28.986834 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:28.986810 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-xpb48"] Sep 10 12:10:28.989190 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:28.989163 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1277d546_5b24_422f_8cdf_8e948452297b.slice/crio-95958b59234148b196fab09fdaa523245b9e7e157e25d3e4c42d8212ddc22639 WatchSource:0}: Error finding container 95958b59234148b196fab09fdaa523245b9e7e157e25d3e4c42d8212ddc22639: Status 404 returned error can't find the container with id 95958b59234148b196fab09fdaa523245b9e7e157e25d3e4c42d8212ddc22639 Sep 10 12:10:29.394942 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.394860 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vv8np" Sep 10 12:10:29.439824 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.439785 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pm9cx" event={"ID":"eb122167-7438-4a13-8180-775494053f0d","Type":"ContainerStarted","Data":"28cc95f99c91d33bb419ab82df208db11d5fb39cbab594a40f19550e7f0932df"} Sep 10 12:10:29.441003 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.440978 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" event={"ID":"1277d546-5b24-422f-8cdf-8e948452297b","Type":"ContainerStarted","Data":"95958b59234148b196fab09fdaa523245b9e7e157e25d3e4c42d8212ddc22639"} Sep 10 12:10:29.447762 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.447735 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b605dc-ff44-440b-a637-71516c5d996a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:29.448540 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.448515 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b605dc-ff44-440b-a637-71516c5d996a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:29.652517 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.652433 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:10:29.766473 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.766438 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc"] Sep 10 12:10:29.769457 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.769435 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.772088 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.772047 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-q7wn8\"" Sep 10 12:10:29.772450 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.772208 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 10 12:10:29.772450 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.772289 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dg5d04qad299q\"" Sep 10 12:10:29.772450 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.772293 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 10 12:10:29.772450 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.772437 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 10 12:10:29.773010 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.772882 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 10 12:10:29.773010 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.772887 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 10 12:10:29.785558 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.785534 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc"] Sep 10 12:10:29.852833 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.852794 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-424zb\" (UniqueName: \"kubernetes.io/projected/edf46728-d985-4362-816a-a591652a6122-kube-api-access-424zb\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.852990 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.852862 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.852990 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.852883 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.852990 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.852900 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-grpc-tls\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.852990 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.852919 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.852990 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.852935 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edf46728-d985-4362-816a-a591652a6122-metrics-client-ca\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.853272 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.853014 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-thanos-querier-tls\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.853272 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.853045 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.943396 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.943223 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:10:29.946036 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:29.946007 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b605dc_ff44_440b_a637_71516c5d996a.slice/crio-2134c654194718d004cd42b9ac0c2542fef854850d7d42d8e22afa3a0d4fda40 WatchSource:0}: Error finding container 2134c654194718d004cd42b9ac0c2542fef854850d7d42d8e22afa3a0d4fda40: Status 404 returned error can't find the container with id 2134c654194718d004cd42b9ac0c2542fef854850d7d42d8e22afa3a0d4fda40 Sep 10 12:10:29.954284 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.954262 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-424zb\" (UniqueName: \"kubernetes.io/projected/edf46728-d985-4362-816a-a591652a6122-kube-api-access-424zb\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.954398 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.954322 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.954398 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.954344 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.954398 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.954365 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-grpc-tls\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.954548 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.954397 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.954548 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.954422 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edf46728-d985-4362-816a-a591652a6122-metrics-client-ca\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.954548 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.954476 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-thanos-querier-tls\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.954548 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.954496 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.955610 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.955580 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edf46728-d985-4362-816a-a591652a6122-metrics-client-ca\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.957761 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.957714 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-grpc-tls\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.958269 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.958244 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.958513 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.958490 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.958574 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.958552 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-thanos-querier-tls\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.958915 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.958871 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.960153 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.960121 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/edf46728-d985-4362-816a-a591652a6122-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:29.964295 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:29.964272 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-424zb\" (UniqueName: \"kubernetes.io/projected/edf46728-d985-4362-816a-a591652a6122-kube-api-access-424zb\") pod \"thanos-querier-84fb7b76cd-pfcbc\" (UID: \"edf46728-d985-4362-816a-a591652a6122\") " pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:30.080583 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:30.080543 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:30.377808 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:30.377656 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc"] Sep 10 12:10:30.448150 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:30.448101 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b605dc-ff44-440b-a637-71516c5d996a","Type":"ContainerStarted","Data":"2134c654194718d004cd42b9ac0c2542fef854850d7d42d8e22afa3a0d4fda40"} Sep 10 12:10:30.450739 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:30.450702 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" event={"ID":"644b2ea1-47fe-438c-b99a-ca044e3ad3aa","Type":"ContainerStarted","Data":"dcbbe58104d3d9a9458d3fe533625ca41633d6a2f65495bb926328f0a5df37d7"} Sep 10 12:10:30.472537 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:30.472485 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-df48q" podStartSLOduration=1.930128211 podStartE2EDuration="3.472465623s" totalImagesPullingTime="1.542337412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:30.472107862 +0000 UTC m=+63.911996115" watchObservedRunningTime="2026-09-10 12:10:30.472465623 +0000 UTC m=+63.912353861" Sep 10 12:10:30.555768 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:30.555736 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf46728_d985_4362_816a_a591652a6122.slice/crio-991f3c995ab94a38f7227b1640f59c98f1e0321a7325ff49c1dfb4c0bceb2468 WatchSource:0}: Error finding container 991f3c995ab94a38f7227b1640f59c98f1e0321a7325ff49c1dfb4c0bceb2468: Status 404 returned error can't find the container with id 991f3c995ab94a38f7227b1640f59c98f1e0321a7325ff49c1dfb4c0bceb2468 Sep 10 12:10:31.457602 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:31.457557 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" event={"ID":"1277d546-5b24-422f-8cdf-8e948452297b","Type":"ContainerStarted","Data":"470c1519e8f29c672a1605b9451d84425234f9e9f6048b30e699c8743bab1ecc"} Sep 10 12:10:31.458058 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:31.457639 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" event={"ID":"1277d546-5b24-422f-8cdf-8e948452297b","Type":"ContainerStarted","Data":"e916572c46c16e85c79cb7d3afb168352e27fd9836becbcc813225d03561ee73"} Sep 10 12:10:31.458058 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:31.457669 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" event={"ID":"1277d546-5b24-422f-8cdf-8e948452297b","Type":"ContainerStarted","Data":"f20c2fd737607e262d9ce82106504be2680bb86ba6721cec38d002963098326a"} Sep 10 12:10:31.459688 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:31.459655 2555 generic.go:356] "Generic (PLEG): container finished" podID="eb122167-7438-4a13-8180-775494053f0d" containerID="34c35d1d6953b638cd81c4a6bb10b54d6c3b7cb930ee2f599a991de7652ccfc9" exitCode=0 Sep 10 12:10:31.459792 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:31.459772 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pm9cx" event={"ID":"eb122167-7438-4a13-8180-775494053f0d","Type":"ContainerDied","Data":"34c35d1d6953b638cd81c4a6bb10b54d6c3b7cb930ee2f599a991de7652ccfc9"} Sep 10 12:10:31.461213 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:31.461153 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" event={"ID":"edf46728-d985-4362-816a-a591652a6122","Type":"ContainerStarted","Data":"991f3c995ab94a38f7227b1640f59c98f1e0321a7325ff49c1dfb4c0bceb2468"} Sep 10 12:10:31.476993 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:31.476932 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xpb48" podStartSLOduration=2.680963288 podStartE2EDuration="4.476912624s" totalImagesPullingTime="1.795949336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:31.476452974 +0000 UTC m=+64.916341206" watchObservedRunningTime="2026-09-10 12:10:31.476912624 +0000 UTC m=+64.916800855" Sep 10 12:10:32.133378 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.133344 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6d5599ff9f-7hmds"] Sep 10 12:10:32.149498 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.149463 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d5599ff9f-7hmds"] Sep 10 12:10:32.149675 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.149575 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.152335 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.152314 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d2rrsvp183hab\"" Sep 10 12:10:32.152496 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.152314 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mrdfz\"" Sep 10 12:10:32.152496 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.152370 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 10 12:10:32.152496 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.152486 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 10 12:10:32.152834 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.152817 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 12:10:32.152905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.152854 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 10 12:10:32.176946 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.176919 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-audit-log\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.177139 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.176958 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-client-ca-bundle\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.177139 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.176988 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.177139 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.177107 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-secret-metrics-server-tls\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.177266 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.177162 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r7th\" (UniqueName: \"kubernetes.io/projected/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-kube-api-access-8r7th\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.177266 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.177200 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-metrics-server-audit-profiles\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.177266 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.177256 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-secret-metrics-server-client-certs\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.278235 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.278145 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-secret-metrics-server-client-certs\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.278393 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.278244 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-audit-log\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.278393 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.278266 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-client-ca-bundle\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.278393 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.278292 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.278393 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.278345 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-secret-metrics-server-tls\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.278393 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.278386 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r7th\" (UniqueName: \"kubernetes.io/projected/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-kube-api-access-8r7th\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.278646 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.278410 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-metrics-server-audit-profiles\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.279039 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.278684 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-audit-log\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.279375 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.279343 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.279459 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.279422 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-metrics-server-audit-profiles\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.281266 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.281244 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-secret-metrics-server-tls\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.281266 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.281262 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-secret-metrics-server-client-certs\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.281410 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.281304 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-client-ca-bundle\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.287163 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.287134 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r7th\" (UniqueName: \"kubernetes.io/projected/565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f-kube-api-access-8r7th\") pod \"metrics-server-6d5599ff9f-7hmds\" (UID: \"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f\") " pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.448803 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.448767 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-72qxb"] Sep 10 12:10:32.472191 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.472118 2555 generic.go:356] "Generic (PLEG): container finished" podID="b7b605dc-ff44-440b-a637-71516c5d996a" containerID="bcd7ba2303755e1ea6c6d6c96404c4a5ace999c2e9ff1cbbbc4afce6b2076d5a" exitCode=0 Sep 10 12:10:32.481315 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.481290 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pm9cx" event={"ID":"eb122167-7438-4a13-8180-775494053f0d","Type":"ContainerStarted","Data":"3b3bb89d17f4339ba294bcaac44dbd47235e8fe19b7660751d2947990cdc736e"} Sep 10 12:10:32.481416 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.481326 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f6c7d5b4-lsc4m"] Sep 10 12:10:32.481416 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.481355 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-72qxb"] Sep 10 12:10:32.481416 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.481373 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85d547869d-dhsn4"] Sep 10 12:10:32.481660 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.481636 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-72qxb" Sep 10 12:10:32.484187 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.484118 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6b92c\"" Sep 10 12:10:32.484697 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.484485 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 10 12:10:32.486530 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.486344 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:32.491788 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.491743 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pm9cx" podStartSLOduration=3.368661268 podStartE2EDuration="5.491725629s" totalImagesPullingTime="2.045021824s" totalInitContainerRuntime="78.042537ms" isStatefulPod=true podCreationTimestamp="2026-09-10 12:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:32.490549626 +0000 UTC m=+65.930437877" watchObservedRunningTime="2026-09-10 12:10:32.491725629 +0000 UTC m=+65.931613864" Sep 10 12:10:32.501498 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.501465 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pm9cx" event={"ID":"eb122167-7438-4a13-8180-775494053f0d","Type":"ContainerStarted","Data":"c146b3a5db12cb889b7cf80479e3931b58c2696bbb569264c5c723d2cb09f2a8"} Sep 10 12:10:32.501609 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.501514 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b605dc-ff44-440b-a637-71516c5d996a","Type":"ContainerDied","Data":"bcd7ba2303755e1ea6c6d6c96404c4a5ace999c2e9ff1cbbbc4afce6b2076d5a"} Sep 10 12:10:32.501609 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.501568 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85d547869d-dhsn4"] Sep 10 12:10:32.501745 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.501667 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.581781 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.581747 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-trusted-ca-bundle\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.583160 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.581948 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn2wp\" (UniqueName: \"kubernetes.io/projected/d259a3b3-fa17-4b02-8e97-b6be268e8f64-kube-api-access-fn2wp\") pod \"monitoring-plugin-85bbbbbf4-72qxb\" (UID: \"d259a3b3-fa17-4b02-8e97-b6be268e8f64\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-72qxb" Sep 10 12:10:32.583160 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.581997 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-serving-cert\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.583160 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.582355 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-oauth-config\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.583160 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.582439 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-oauth-serving-cert\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.583160 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.582492 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnxhz\" (UniqueName: \"kubernetes.io/projected/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-kube-api-access-vnxhz\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.583160 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.582627 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-service-ca\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.583160 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.582745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-config\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.583160 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.582874 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d259a3b3-fa17-4b02-8e97-b6be268e8f64-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-72qxb\" (UID: \"d259a3b3-fa17-4b02-8e97-b6be268e8f64\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-72qxb" Sep 10 12:10:32.683552 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.683515 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn2wp\" (UniqueName: \"kubernetes.io/projected/d259a3b3-fa17-4b02-8e97-b6be268e8f64-kube-api-access-fn2wp\") pod \"monitoring-plugin-85bbbbbf4-72qxb\" (UID: \"d259a3b3-fa17-4b02-8e97-b6be268e8f64\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-72qxb" Sep 10 12:10:32.683723 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.683568 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-serving-cert\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.683787 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.683775 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-oauth-config\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.683861 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.683824 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-oauth-serving-cert\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.683908 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.683864 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnxhz\" (UniqueName: \"kubernetes.io/projected/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-kube-api-access-vnxhz\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.683908 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.683896 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-service-ca\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.683999 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.683933 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-config\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.683999 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.683955 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d259a3b3-fa17-4b02-8e97-b6be268e8f64-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-72qxb\" (UID: \"d259a3b3-fa17-4b02-8e97-b6be268e8f64\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-72qxb" Sep 10 12:10:32.684131 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.684017 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-trusted-ca-bundle\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.684794 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.684742 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-service-ca\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.684923 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.684804 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-oauth-serving-cert\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.685155 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.685042 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-config\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.685672 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.685647 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-trusted-ca-bundle\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.686687 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.686661 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-oauth-config\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.686802 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.686783 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d259a3b3-fa17-4b02-8e97-b6be268e8f64-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-72qxb\" (UID: \"d259a3b3-fa17-4b02-8e97-b6be268e8f64\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-72qxb" Sep 10 12:10:32.687343 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.687320 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-serving-cert\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.692393 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.692370 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnxhz\" (UniqueName: \"kubernetes.io/projected/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-kube-api-access-vnxhz\") pod \"console-85d547869d-dhsn4\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.692573 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.692553 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn2wp\" (UniqueName: \"kubernetes.io/projected/d259a3b3-fa17-4b02-8e97-b6be268e8f64-kube-api-access-fn2wp\") pod \"monitoring-plugin-85bbbbbf4-72qxb\" (UID: \"d259a3b3-fa17-4b02-8e97-b6be268e8f64\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-72qxb" Sep 10 12:10:32.783434 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.783403 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d5599ff9f-7hmds"] Sep 10 12:10:32.786106 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:32.786084 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod565c4aa9_3ff1_48af_8bcf_cc6f2cb41c9f.slice/crio-7346dfc4e1c1a8039c71c8180d855fd31d6e45d2d44da993e9b59916e5208d30 WatchSource:0}: Error finding container 7346dfc4e1c1a8039c71c8180d855fd31d6e45d2d44da993e9b59916e5208d30: Status 404 returned error can't find the container with id 7346dfc4e1c1a8039c71c8180d855fd31d6e45d2d44da993e9b59916e5208d30 Sep 10 12:10:32.796390 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.796364 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-72qxb" Sep 10 12:10:32.814471 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.814403 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:32.823582 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.823555 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:32.885739 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.885634 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4l4r\" (UniqueName: \"kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r\") pod \"network-check-target-wkm26\" (UID: \"1071b22c-5ab2-4e55-871c-05012ee83376\") " pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:10:32.885823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.885743 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs\") pod \"network-metrics-daemon-58d7t\" (UID: \"6909e322-42f0-4d07-af43-4b79e0e8fc17\") " pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:10:32.885823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.885779 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret\") pod \"global-pull-secret-syncer-xwkm4\" (UID: \"9a81a977-6e78-4a35-bd30-af9397a90af6\") " pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:10:32.889459 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.888160 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 12:10:32.889459 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.888439 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 12:10:32.889459 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.889255 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 12:10:32.899570 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.899348 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 12:10:32.900528 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.900477 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a81a977-6e78-4a35-bd30-af9397a90af6-original-pull-secret\") pod \"global-pull-secret-syncer-xwkm4\" (UID: \"9a81a977-6e78-4a35-bd30-af9397a90af6\") " pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:10:32.903806 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.903750 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6909e322-42f0-4d07-af43-4b79e0e8fc17-metrics-certs\") pod \"network-metrics-daemon-58d7t\" (UID: \"6909e322-42f0-4d07-af43-4b79e0e8fc17\") " pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:10:32.910516 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.910462 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4l4r\" (UniqueName: \"kubernetes.io/projected/1071b22c-5ab2-4e55-871c-05012ee83376-kube-api-access-r4l4r\") pod \"network-check-target-wkm26\" (UID: \"1071b22c-5ab2-4e55-871c-05012ee83376\") " pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:10:32.961613 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.961568 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c7466b7cf-psxjp"] Sep 10 12:10:32.965109 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.965062 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:32.967783 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.967457 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 10 12:10:32.967783 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.967503 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 10 12:10:32.967783 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.967516 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 10 12:10:32.967783 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.967444 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8fkf9\"" Sep 10 12:10:32.967783 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.967617 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 10 12:10:32.967783 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.967686 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 10 12:10:32.973291 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.973268 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 10 12:10:32.980773 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.980750 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c7466b7cf-psxjp"] Sep 10 12:10:32.986216 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.986193 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61360982-b7dd-442d-93c0-9cda13501a1f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:32.986345 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.986236 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61360982-b7dd-442d-93c0-9cda13501a1f-federate-client-tls\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:32.986345 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.986305 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61360982-b7dd-442d-93c0-9cda13501a1f-telemeter-client-tls\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:32.986461 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.986374 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61360982-b7dd-442d-93c0-9cda13501a1f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:32.986461 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.986412 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61360982-b7dd-442d-93c0-9cda13501a1f-metrics-client-ca\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:32.986461 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.986450 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61360982-b7dd-442d-93c0-9cda13501a1f-serving-certs-ca-bundle\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:32.986592 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.986524 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61360982-b7dd-442d-93c0-9cda13501a1f-secret-telemeter-client\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:32.986592 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:32.986550 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkhpw\" (UniqueName: \"kubernetes.io/projected/61360982-b7dd-442d-93c0-9cda13501a1f-kube-api-access-fkhpw\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.087305 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.087206 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61360982-b7dd-442d-93c0-9cda13501a1f-federate-client-tls\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.087305 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.087296 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61360982-b7dd-442d-93c0-9cda13501a1f-telemeter-client-tls\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.087551 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.087344 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61360982-b7dd-442d-93c0-9cda13501a1f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.087551 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.087384 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61360982-b7dd-442d-93c0-9cda13501a1f-metrics-client-ca\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.087551 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.087420 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61360982-b7dd-442d-93c0-9cda13501a1f-serving-certs-ca-bundle\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.087551 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.087467 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61360982-b7dd-442d-93c0-9cda13501a1f-secret-telemeter-client\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.087551 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.087500 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkhpw\" (UniqueName: \"kubernetes.io/projected/61360982-b7dd-442d-93c0-9cda13501a1f-kube-api-access-fkhpw\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.087551 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.087544 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61360982-b7dd-442d-93c0-9cda13501a1f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.088198 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.088135 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61360982-b7dd-442d-93c0-9cda13501a1f-serving-certs-ca-bundle\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.088325 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.088202 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61360982-b7dd-442d-93c0-9cda13501a1f-metrics-client-ca\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.088563 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.088518 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61360982-b7dd-442d-93c0-9cda13501a1f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.090304 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.090246 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61360982-b7dd-442d-93c0-9cda13501a1f-secret-telemeter-client\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.090304 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.090267 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61360982-b7dd-442d-93c0-9cda13501a1f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.090449 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.090421 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61360982-b7dd-442d-93c0-9cda13501a1f-federate-client-tls\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.090812 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.090784 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61360982-b7dd-442d-93c0-9cda13501a1f-telemeter-client-tls\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.096709 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.096680 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkhpw\" (UniqueName: \"kubernetes.io/projected/61360982-b7dd-442d-93c0-9cda13501a1f-kube-api-access-fkhpw\") pod \"telemeter-client-5c7466b7cf-psxjp\" (UID: \"61360982-b7dd-442d-93c0-9cda13501a1f\") " pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.115970 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.115716 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-72qxb"] Sep 10 12:10:33.119283 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.119125 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xwkm4" Sep 10 12:10:33.136592 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.136529 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-twc65\"" Sep 10 12:10:33.140265 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.140242 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4nkk9\"" Sep 10 12:10:33.141812 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.141748 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85d547869d-dhsn4"] Sep 10 12:10:33.144905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.144884 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:10:33.148994 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.148974 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58d7t" Sep 10 12:10:33.276450 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.276415 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" Sep 10 12:10:33.485607 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.485563 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" event={"ID":"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f","Type":"ContainerStarted","Data":"7346dfc4e1c1a8039c71c8180d855fd31d6e45d2d44da993e9b59916e5208d30"} Sep 10 12:10:33.531780 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:33.531741 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd259a3b3_fa17_4b02_8e97_b6be268e8f64.slice/crio-1fe8c9bc57a2953148b6505187d39319cc2f37c24bfd5fd2001d0b7be5524266 WatchSource:0}: Error finding container 1fe8c9bc57a2953148b6505187d39319cc2f37c24bfd5fd2001d0b7be5524266: Status 404 returned error can't find the container with id 1fe8c9bc57a2953148b6505187d39319cc2f37c24bfd5fd2001d0b7be5524266 Sep 10 12:10:33.532518 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:33.532481 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9457b9d_e9ff_4485_971c_8eb2ebf38b78.slice/crio-47d6cc738819a671ec0c81a36e1e3438d430a7b111eb21def07b4032699aa7b5 WatchSource:0}: Error finding container 47d6cc738819a671ec0c81a36e1e3438d430a7b111eb21def07b4032699aa7b5: Status 404 returned error can't find the container with id 47d6cc738819a671ec0c81a36e1e3438d430a7b111eb21def07b4032699aa7b5 Sep 10 12:10:33.852980 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.852891 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xwkm4"] Sep 10 12:10:33.854916 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:33.854880 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a81a977_6e78_4a35_bd30_af9397a90af6.slice/crio-c5fb4cd16b484d2648a0603ad92232c8ce1d232f5f86316e76a238f7e2abd81c WatchSource:0}: Error finding container c5fb4cd16b484d2648a0603ad92232c8ce1d232f5f86316e76a238f7e2abd81c: Status 404 returned error can't find the container with id c5fb4cd16b484d2648a0603ad92232c8ce1d232f5f86316e76a238f7e2abd81c Sep 10 12:10:33.865943 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.865901 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wkm26"] Sep 10 12:10:33.871228 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.871195 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-58d7t"] Sep 10 12:10:33.874367 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:33.872387 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1071b22c_5ab2_4e55_871c_05012ee83376.slice/crio-bcf4cf1bbef4c58dfbcc4b968f9a1067ea74fad0621ec032d19b59e218d95ed8 WatchSource:0}: Error finding container bcf4cf1bbef4c58dfbcc4b968f9a1067ea74fad0621ec032d19b59e218d95ed8: Status 404 returned error can't find the container with id bcf4cf1bbef4c58dfbcc4b968f9a1067ea74fad0621ec032d19b59e218d95ed8 Sep 10 12:10:33.875037 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:33.874950 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c7466b7cf-psxjp"] Sep 10 12:10:33.875834 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:33.875735 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6909e322_42f0_4d07_af43_4b79e0e8fc17.slice/crio-2e8eab41d7ffb752ed3188e8297db0e8f3bda6504eb4cfd20f300f04dc4bfc16 WatchSource:0}: Error finding container 2e8eab41d7ffb752ed3188e8297db0e8f3bda6504eb4cfd20f300f04dc4bfc16: Status 404 returned error can't find the container with id 2e8eab41d7ffb752ed3188e8297db0e8f3bda6504eb4cfd20f300f04dc4bfc16 Sep 10 12:10:33.882948 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:33.882731 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61360982_b7dd_442d_93c0_9cda13501a1f.slice/crio-a44e75c6638578be1a2dc197cbcd8ebf83e0f7edcad910a6f97e9ca3dc636cf0 WatchSource:0}: Error finding container a44e75c6638578be1a2dc197cbcd8ebf83e0f7edcad910a6f97e9ca3dc636cf0: Status 404 returned error can't find the container with id a44e75c6638578be1a2dc197cbcd8ebf83e0f7edcad910a6f97e9ca3dc636cf0 Sep 10 12:10:34.041525 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.041402 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:10:34.046420 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.046392 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.048977 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.048950 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 12:10:34.049156 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.048979 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ci8o7g7j0cbs6\"" Sep 10 12:10:34.049778 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.049351 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 12:10:34.049778 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.049036 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 12:10:34.049778 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.049616 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 12:10:34.050335 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.050274 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 12:10:34.050929 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.050446 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 12:10:34.050929 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.050598 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 12:10:34.050929 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.050710 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 12:10:34.050929 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.050787 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 12:10:34.052095 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.051170 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 12:10:34.052095 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.051557 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 12:10:34.052095 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.051911 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 12:10:34.053777 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.053125 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6f2p4\"" Sep 10 12:10:34.054524 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.054499 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 12:10:34.058736 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.058714 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 12:10:34.062661 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.062640 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:10:34.097448 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097407 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.097647 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097455 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.097647 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097488 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.097647 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097519 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.097647 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097553 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.097647 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097585 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.097647 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097644 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-config\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.098243 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097664 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-config-out\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.098243 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097680 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.098243 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097724 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.098243 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097751 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.098243 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097774 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.098243 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097798 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.098243 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097820 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.098243 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097842 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2gjm\" (UniqueName: \"kubernetes.io/projected/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-kube-api-access-j2gjm\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.098243 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097916 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.098243 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097970 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.098243 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.097997 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.098243 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.098048 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-web-config\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.098243 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.098130 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.199162 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.198984 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.199162 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199036 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.199482 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199454 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.199606 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199507 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.199606 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199560 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-config\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.199606 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199582 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-config-out\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.199761 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199607 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.199761 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199657 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.199761 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199681 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.199761 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199706 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.199761 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199731 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.199761 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199753 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.200129 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199776 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2gjm\" (UniqueName: \"kubernetes.io/projected/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-kube-api-access-j2gjm\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.200129 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199824 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.200129 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199864 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.200129 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199888 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.200129 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199944 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-web-config\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.200129 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.199972 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.200129 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.200004 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.200129 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.200032 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.200514 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.200354 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.200569 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.200551 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.201825 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.201788 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.203611 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.203418 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.203611 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.203487 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.204936 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.203901 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.204936 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.204288 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-config-out\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.204936 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.204493 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.204936 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.204621 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.204936 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.204900 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.205412 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.205389 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-web-config\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.206256 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.205776 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.206256 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.206215 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.207376 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.207116 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.207376 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.207116 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.208837 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.208801 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.208935 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.208801 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.209563 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.209505 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.210256 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.210210 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2gjm\" (UniqueName: \"kubernetes.io/projected/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-kube-api-access-j2gjm\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.212525 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.212502 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-config\") pod \"prometheus-k8s-0\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.362394 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.362286 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:34.497823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.497522 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" event={"ID":"edf46728-d985-4362-816a-a591652a6122","Type":"ContainerStarted","Data":"4f73e94628b9e962a29e229ac0c8fd0400a582c723b1ce39e482ce0a679e6085"} Sep 10 12:10:34.497823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.497702 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" event={"ID":"edf46728-d985-4362-816a-a591652a6122","Type":"ContainerStarted","Data":"1a2ea13acff524ca20772b7d69ecc7e44849e0ab090a406604868d0faf8a1d31"} Sep 10 12:10:34.497823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.497753 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" event={"ID":"edf46728-d985-4362-816a-a591652a6122","Type":"ContainerStarted","Data":"263d33607217e103f2159a12e5b0005fd2c390a0d6bd5d9721a4f4a9c1dc35fb"} Sep 10 12:10:34.500633 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.500564 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-72qxb" event={"ID":"d259a3b3-fa17-4b02-8e97-b6be268e8f64","Type":"ContainerStarted","Data":"1fe8c9bc57a2953148b6505187d39319cc2f37c24bfd5fd2001d0b7be5524266"} Sep 10 12:10:34.502243 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.502182 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" event={"ID":"61360982-b7dd-442d-93c0-9cda13501a1f","Type":"ContainerStarted","Data":"a44e75c6638578be1a2dc197cbcd8ebf83e0f7edcad910a6f97e9ca3dc636cf0"} Sep 10 12:10:34.504242 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.504208 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xwkm4" event={"ID":"9a81a977-6e78-4a35-bd30-af9397a90af6","Type":"ContainerStarted","Data":"c5fb4cd16b484d2648a0603ad92232c8ce1d232f5f86316e76a238f7e2abd81c"} Sep 10 12:10:34.506596 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.506558 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d547869d-dhsn4" event={"ID":"e9457b9d-e9ff-4485-971c-8eb2ebf38b78","Type":"ContainerStarted","Data":"0491318b349ea100b8bef0b916d9fcbe555e33ba780b4d8e76d404a5ff39e2c5"} Sep 10 12:10:34.506697 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.506608 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d547869d-dhsn4" event={"ID":"e9457b9d-e9ff-4485-971c-8eb2ebf38b78","Type":"ContainerStarted","Data":"47d6cc738819a671ec0c81a36e1e3438d430a7b111eb21def07b4032699aa7b5"} Sep 10 12:10:34.510302 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.510275 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wkm26" event={"ID":"1071b22c-5ab2-4e55-871c-05012ee83376","Type":"ContainerStarted","Data":"bcf4cf1bbef4c58dfbcc4b968f9a1067ea74fad0621ec032d19b59e218d95ed8"} Sep 10 12:10:34.511902 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.511875 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58d7t" event={"ID":"6909e322-42f0-4d07-af43-4b79e0e8fc17","Type":"ContainerStarted","Data":"2e8eab41d7ffb752ed3188e8297db0e8f3bda6504eb4cfd20f300f04dc4bfc16"} Sep 10 12:10:34.526524 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:34.526473 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85d547869d-dhsn4" podStartSLOduration=2.526452378 podStartE2EDuration="2.526452378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:34.524752846 +0000 UTC m=+67.964641103" watchObservedRunningTime="2026-09-10 12:10:34.526452378 +0000 UTC m=+67.966340611" Sep 10 12:10:36.004608 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.004565 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:10:36.016704 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:36.016667 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e5e2a1_1bbe_43a6_81b2_e3fcb176e299.slice/crio-e0777140e13339943cd374570f2e78a621a7a7756807fe01f70b29878a973d22 WatchSource:0}: Error finding container e0777140e13339943cd374570f2e78a621a7a7756807fe01f70b29878a973d22: Status 404 returned error can't find the container with id e0777140e13339943cd374570f2e78a621a7a7756807fe01f70b29878a973d22 Sep 10 12:10:36.532928 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.532099 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" event={"ID":"edf46728-d985-4362-816a-a591652a6122","Type":"ContainerStarted","Data":"4c35c54b64e1c67b38a72b24319b946eda4d49fc525994f305bdcabe4f81c375"} Sep 10 12:10:36.532928 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.532180 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" event={"ID":"edf46728-d985-4362-816a-a591652a6122","Type":"ContainerStarted","Data":"44ac6758db20b84789f2372700493fefced00ddc6999664b3be437071e5a90ad"} Sep 10 12:10:36.532928 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.532222 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" event={"ID":"edf46728-d985-4362-816a-a591652a6122","Type":"ContainerStarted","Data":"1dcd92ae75a8cf312de93b517fd8e71eb39600129e60da612253457fe8da4a5a"} Sep 10 12:10:36.532928 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.532504 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:36.534491 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.534459 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-72qxb" event={"ID":"d259a3b3-fa17-4b02-8e97-b6be268e8f64","Type":"ContainerStarted","Data":"90d47c586a86c2a9daa45aa774bc58ad5ff36cecb955fd716e8e440489c5377c"} Sep 10 12:10:36.535301 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.535282 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-72qxb" Sep 10 12:10:36.542990 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.542090 2555 generic.go:356] "Generic (PLEG): container finished" podID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerID="efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6" exitCode=0 Sep 10 12:10:36.542990 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.542234 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299","Type":"ContainerDied","Data":"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6"} Sep 10 12:10:36.542990 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.542301 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299","Type":"ContainerStarted","Data":"e0777140e13339943cd374570f2e78a621a7a7756807fe01f70b29878a973d22"} Sep 10 12:10:36.544434 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.544190 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-72qxb" Sep 10 12:10:36.548762 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.548738 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b605dc-ff44-440b-a637-71516c5d996a","Type":"ContainerStarted","Data":"9d52f09a65198a3104e2ac8b74b2995ffa0d9643960354ced9d3f2397f8c582b"} Sep 10 12:10:36.548932 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.548906 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b605dc-ff44-440b-a637-71516c5d996a","Type":"ContainerStarted","Data":"41b312498bbe305bd0d8027041947955247c9f492064c236a5e770f9ff6d98fd"} Sep 10 12:10:36.549028 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.548964 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b605dc-ff44-440b-a637-71516c5d996a","Type":"ContainerStarted","Data":"dc5cbe55939ca745ee56255c33a9160a92cb2894210065375a7216b3918a904f"} Sep 10 12:10:36.549028 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.549001 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b605dc-ff44-440b-a637-71516c5d996a","Type":"ContainerStarted","Data":"6d53a81f054a2cefcc35d919f5fd46ef65ea06dc40e1a0587aed21c1856187fa"} Sep 10 12:10:36.552214 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.552188 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" event={"ID":"565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f","Type":"ContainerStarted","Data":"566bf8c148b5bbf3261a42b84ea8fd67f6355b2f658b2b0901ec4264825daaed"} Sep 10 12:10:36.557235 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.557190 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" podStartSLOduration=2.658690465 podStartE2EDuration="7.5571744s" totalImagesPullingTime="4.898483935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:36.555559068 +0000 UTC m=+69.995447322" watchObservedRunningTime="2026-09-10 12:10:36.5571744 +0000 UTC m=+69.997062632" Sep 10 12:10:36.609704 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.609639 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" podStartSLOduration=1.705164804 podStartE2EDuration="4.609616599s" totalImagesPullingTime="2.904451795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:36.591392808 +0000 UTC m=+70.031281044" watchObservedRunningTime="2026-09-10 12:10:36.609616599 +0000 UTC m=+70.049504833" Sep 10 12:10:36.610597 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:36.610556 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-72qxb" podStartSLOduration=2.456990471 podStartE2EDuration="4.61054108s" totalImagesPullingTime="2.153550609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:36.608548881 +0000 UTC m=+70.048437116" watchObservedRunningTime="2026-09-10 12:10:36.61054108 +0000 UTC m=+70.050429316" Sep 10 12:10:37.564801 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:37.564238 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b605dc-ff44-440b-a637-71516c5d996a","Type":"ContainerStarted","Data":"ad2ebf1ee9cbfc339ca8bd9e8da3228ea122ffa806f9af2d3fab5e44ba3a9092"} Sep 10 12:10:37.564801 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:37.564332 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b605dc-ff44-440b-a637-71516c5d996a","Type":"ContainerStarted","Data":"146796b14ae6f758851df2405fdbfb6ccafd3b187fa302b84b68ca2818dbabc0"} Sep 10 12:10:37.567158 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:37.567123 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58d7t" event={"ID":"6909e322-42f0-4d07-af43-4b79e0e8fc17","Type":"ContainerStarted","Data":"72ed697223fa62be93bf967d71f586323134877bc9d5cba855d1e01370aa28b5"} Sep 10 12:10:37.567316 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:37.567182 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58d7t" event={"ID":"6909e322-42f0-4d07-af43-4b79e0e8fc17","Type":"ContainerStarted","Data":"f305326d6d0f5f79e1c65460d606f0ea5eac9f1ef976b040699e5ced5d6e10de"} Sep 10 12:10:37.596808 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:37.596740 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.297895623 podStartE2EDuration="9.596719837s" totalImagesPullingTime="5.27194882s" totalInitContainerRuntime="26.875394ms" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:37.595302442 +0000 UTC m=+71.035190701" watchObservedRunningTime="2026-09-10 12:10:37.596719837 +0000 UTC m=+71.036608072" Sep 10 12:10:37.619092 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:37.618576 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-58d7t" podStartSLOduration=67.895172148 podStartE2EDuration="1m10.618552239s" totalImagesPullingTime="2.723380091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:37.61787059 +0000 UTC m=+71.057758843" watchObservedRunningTime="2026-09-10 12:10:37.618552239 +0000 UTC m=+71.058440474" Sep 10 12:10:40.584644 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.584536 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" event={"ID":"61360982-b7dd-442d-93c0-9cda13501a1f","Type":"ContainerStarted","Data":"47f2b60822a02721130663c08bda07748c1877d990a30ed7bbd98c42eedfdad4"} Sep 10 12:10:40.584644 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.584614 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" event={"ID":"61360982-b7dd-442d-93c0-9cda13501a1f","Type":"ContainerStarted","Data":"78e32216baa2f4d576864e9b3c819c5579768bada251a1e46ed27c08e30c9337"} Sep 10 12:10:40.584644 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.584642 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" event={"ID":"61360982-b7dd-442d-93c0-9cda13501a1f","Type":"ContainerStarted","Data":"46af2e3b335b6bd08ba20ca348e99b0bfa1a3e3ead74a703803efbb682f97f5a"} Sep 10 12:10:40.586244 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.586215 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xwkm4" event={"ID":"9a81a977-6e78-4a35-bd30-af9397a90af6","Type":"ContainerStarted","Data":"194c0bd0d43ec43cd029ee768359acdec78a573882ae6208a3346aaff518de90"} Sep 10 12:10:40.587924 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.587897 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wkm26" event={"ID":"1071b22c-5ab2-4e55-871c-05012ee83376","Type":"ContainerStarted","Data":"480e3885b9388894d9cd5a6cacf28dd2139b110ebaa7cb38af12767c47fecf1a"} Sep 10 12:10:40.588101 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.588054 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:10:40.609829 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.608195 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c7466b7cf-psxjp" podStartSLOduration=2.259516615 podStartE2EDuration="8.608175597s" totalImagesPullingTime="6.348658982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:40.605613141 +0000 UTC m=+74.045501391" watchObservedRunningTime="2026-09-10 12:10:40.608175597 +0000 UTC m=+74.048063830" Sep 10 12:10:40.621834 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.621785 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wkm26" podStartSLOduration=67.257996064 podStartE2EDuration="1m13.621764483s" totalImagesPullingTime="6.363768419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:40.62094058 +0000 UTC m=+74.060828835" watchObservedRunningTime="2026-09-10 12:10:40.621764483 +0000 UTC m=+74.061652716" Sep 10 12:10:40.639191 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.639131 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xwkm4" podStartSLOduration=67.249454637 podStartE2EDuration="1m13.639116062s" totalImagesPullingTime="6.389661425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:40.638051417 +0000 UTC m=+74.077939648" watchObservedRunningTime="2026-09-10 12:10:40.639116062 +0000 UTC m=+74.079004298" Sep 10 12:10:40.697978 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.697937 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85d547869d-dhsn4"] Sep 10 12:10:40.731502 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.731467 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7df8dd95c9-xzzzj"] Sep 10 12:10:40.733859 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.733839 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.746497 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.746470 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7df8dd95c9-xzzzj"] Sep 10 12:10:40.776350 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.776316 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-oauth-config\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.776544 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.776362 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-oauth-serving-cert\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.776544 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.776407 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-config\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.776544 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.776493 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-serving-cert\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.776544 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.776513 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-service-ca\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.776687 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.776552 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-trusted-ca-bundle\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.776687 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.776626 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5vj2\" (UniqueName: \"kubernetes.io/projected/271b3f95-0c1b-465c-bc09-05b7ca436c67-kube-api-access-p5vj2\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.877320 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.877228 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-trusted-ca-bundle\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.877320 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.877296 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5vj2\" (UniqueName: \"kubernetes.io/projected/271b3f95-0c1b-465c-bc09-05b7ca436c67-kube-api-access-p5vj2\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.877554 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.877360 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-oauth-config\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.877554 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.877386 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-oauth-serving-cert\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.877554 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.877421 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-config\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.877554 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.877485 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-serving-cert\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.877554 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.877510 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-service-ca\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.878297 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.878240 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-config\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.878297 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.878259 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-service-ca\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.878463 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.878301 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-trusted-ca-bundle\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.878463 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.878407 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-oauth-serving-cert\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.880344 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.880322 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-serving-cert\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.880492 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.880470 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-oauth-config\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:40.885978 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:40.885958 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5vj2\" (UniqueName: \"kubernetes.io/projected/271b3f95-0c1b-465c-bc09-05b7ca436c67-kube-api-access-p5vj2\") pod \"console-7df8dd95c9-xzzzj\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:41.045388 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:41.045348 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:41.338357 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:41.338303 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7df8dd95c9-xzzzj"] Sep 10 12:10:41.341854 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:10:41.341821 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod271b3f95_0c1b_465c_bc09_05b7ca436c67.slice/crio-ba71cdf5ae1015d96cf33945baff45c43d82c01f72003c49512433b780b13b1c WatchSource:0}: Error finding container ba71cdf5ae1015d96cf33945baff45c43d82c01f72003c49512433b780b13b1c: Status 404 returned error can't find the container with id ba71cdf5ae1015d96cf33945baff45c43d82c01f72003c49512433b780b13b1c Sep 10 12:10:41.596700 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:41.596589 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7df8dd95c9-xzzzj" event={"ID":"271b3f95-0c1b-465c-bc09-05b7ca436c67","Type":"ContainerStarted","Data":"ab536f850bedc2d3af746d993f9acbda55d5111455f15d385a70b2686863538a"} Sep 10 12:10:41.596700 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:41.596654 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7df8dd95c9-xzzzj" event={"ID":"271b3f95-0c1b-465c-bc09-05b7ca436c67","Type":"ContainerStarted","Data":"ba71cdf5ae1015d96cf33945baff45c43d82c01f72003c49512433b780b13b1c"} Sep 10 12:10:41.622117 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:41.622052 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7df8dd95c9-xzzzj" podStartSLOduration=1.622035716 podStartE2EDuration="1.622035716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:41.619879084 +0000 UTC m=+75.059767337" watchObservedRunningTime="2026-09-10 12:10:41.622035716 +0000 UTC m=+75.061923948" Sep 10 12:10:42.574759 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:42.574727 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-84fb7b76cd-pfcbc" Sep 10 12:10:42.815430 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:42.815392 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:10:43.610561 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:43.610479 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299","Type":"ContainerStarted","Data":"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1"} Sep 10 12:10:43.610689 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:43.610570 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299","Type":"ContainerStarted","Data":"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9"} Sep 10 12:10:43.610689 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:43.610611 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299","Type":"ContainerStarted","Data":"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c"} Sep 10 12:10:43.610689 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:43.610640 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299","Type":"ContainerStarted","Data":"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71"} Sep 10 12:10:43.610689 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:43.610662 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299","Type":"ContainerStarted","Data":"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2"} Sep 10 12:10:43.610809 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:43.610698 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299","Type":"ContainerStarted","Data":"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba"} Sep 10 12:10:43.644922 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:43.644858 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.061999364 podStartE2EDuration="9.644836149s" totalImagesPullingTime="6.557819713s" totalInitContainerRuntime="25.017072ms" isStatefulPod=false podCreationTimestamp="2026-09-10 12:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:10:43.642525954 +0000 UTC m=+77.082414215" watchObservedRunningTime="2026-09-10 12:10:43.644836149 +0000 UTC m=+77.084724384" Sep 10 12:10:44.362913 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:44.362863 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:10:51.046442 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:51.046285 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:51.046442 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:51.046376 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:51.050973 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:51.050951 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:51.653650 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:51.653617 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:10:51.699770 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:51.699739 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c7fbc88d7-xm672"] Sep 10 12:10:52.487327 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:52.487299 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:52.487681 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:52.487378 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:10:57.507223 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.507171 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55f6c7d5b4-lsc4m" podUID="1f3f7aba-1f2c-4a9b-b873-7042e96395b7" containerName="console" containerID="cri-o://42a0bb2e3f44c729df69595fa95929b6c64e1057c8d112e095a9a5d14fde7814" gracePeriod=15 Sep 10 12:10:57.678588 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.678556 2555 generic.go:356] "Generic (PLEG): container finished" podID="1f3f7aba-1f2c-4a9b-b873-7042e96395b7" containerID="42a0bb2e3f44c729df69595fa95929b6c64e1057c8d112e095a9a5d14fde7814" exitCode=0 Sep 10 12:10:57.678755 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.678610 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f6c7d5b4-lsc4m" event={"ID":"1f3f7aba-1f2c-4a9b-b873-7042e96395b7","Type":"ContainerDied","Data":"42a0bb2e3f44c729df69595fa95929b6c64e1057c8d112e095a9a5d14fde7814"} Sep 10 12:10:57.749939 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.749914 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:57.837210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.837118 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-config\") pod \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " Sep 10 12:10:57.837210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.837167 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-trusted-ca-bundle\") pod \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " Sep 10 12:10:57.837210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.837193 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-oauth-serving-cert\") pod \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " Sep 10 12:10:57.837448 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.837253 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-oauth-config\") pod \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " Sep 10 12:10:57.837448 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.837298 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-service-ca\") pod \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " Sep 10 12:10:57.837448 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.837320 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-serving-cert\") pod \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " Sep 10 12:10:57.837448 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.837348 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99bwl\" (UniqueName: \"kubernetes.io/projected/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-kube-api-access-99bwl\") pod \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\" (UID: \"1f3f7aba-1f2c-4a9b-b873-7042e96395b7\") " Sep 10 12:10:57.837730 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.837669 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-config" (OuterVolumeSpecName: "console-config") pod "1f3f7aba-1f2c-4a9b-b873-7042e96395b7" (UID: "1f3f7aba-1f2c-4a9b-b873-7042e96395b7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:10:57.837730 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.837692 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f3f7aba-1f2c-4a9b-b873-7042e96395b7" (UID: "1f3f7aba-1f2c-4a9b-b873-7042e96395b7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:10:57.837730 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.837669 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f3f7aba-1f2c-4a9b-b873-7042e96395b7" (UID: "1f3f7aba-1f2c-4a9b-b873-7042e96395b7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:10:57.837730 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.837706 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f3f7aba-1f2c-4a9b-b873-7042e96395b7" (UID: "1f3f7aba-1f2c-4a9b-b873-7042e96395b7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:10:57.839893 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.839858 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f3f7aba-1f2c-4a9b-b873-7042e96395b7" (UID: "1f3f7aba-1f2c-4a9b-b873-7042e96395b7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:10:57.839893 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.839870 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-kube-api-access-99bwl" (OuterVolumeSpecName: "kube-api-access-99bwl") pod "1f3f7aba-1f2c-4a9b-b873-7042e96395b7" (UID: "1f3f7aba-1f2c-4a9b-b873-7042e96395b7"). InnerVolumeSpecName "kube-api-access-99bwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:10:57.840108 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.839949 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f3f7aba-1f2c-4a9b-b873-7042e96395b7" (UID: "1f3f7aba-1f2c-4a9b-b873-7042e96395b7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:10:57.938774 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.938736 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-serving-cert\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:10:57.938774 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.938768 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99bwl\" (UniqueName: \"kubernetes.io/projected/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-kube-api-access-99bwl\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:10:57.938774 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.938779 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-config\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:10:57.938998 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.938788 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-trusted-ca-bundle\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:10:57.938998 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.938820 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-oauth-serving-cert\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:10:57.938998 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.938829 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-console-oauth-config\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:10:57.938998 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:57.938837 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f3f7aba-1f2c-4a9b-b873-7042e96395b7-service-ca\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:10:58.684469 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:58.684428 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f6c7d5b4-lsc4m" event={"ID":"1f3f7aba-1f2c-4a9b-b873-7042e96395b7","Type":"ContainerDied","Data":"bbb06b793ef95a95d646779c11483bd4a237c0f436445828ea6f976f6e5d454b"} Sep 10 12:10:58.684469 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:58.684457 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f6c7d5b4-lsc4m" Sep 10 12:10:58.684942 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:58.684503 2555 scope.go:117] "RemoveContainer" containerID="42a0bb2e3f44c729df69595fa95929b6c64e1057c8d112e095a9a5d14fde7814" Sep 10 12:10:58.705322 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:58.705293 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f6c7d5b4-lsc4m"] Sep 10 12:10:58.709654 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:58.709621 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55f6c7d5b4-lsc4m"] Sep 10 12:10:59.113276 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:10:59.113242 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f3f7aba-1f2c-4a9b-b873-7042e96395b7" path="/var/lib/kubelet/pods/1f3f7aba-1f2c-4a9b-b873-7042e96395b7/volumes" Sep 10 12:11:05.722394 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:05.722348 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85d547869d-dhsn4" podUID="e9457b9d-e9ff-4485-971c-8eb2ebf38b78" containerName="console" containerID="cri-o://0491318b349ea100b8bef0b916d9fcbe555e33ba780b4d8e76d404a5ff39e2c5" gracePeriod=15 Sep 10 12:11:05.962396 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:05.962369 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:11:06.114689 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.114591 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-service-ca\") pod \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " Sep 10 12:11:06.114689 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.114639 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-trusted-ca-bundle\") pod \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " Sep 10 12:11:06.114689 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.114659 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-serving-cert\") pod \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " Sep 10 12:11:06.114980 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.114700 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnxhz\" (UniqueName: \"kubernetes.io/projected/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-kube-api-access-vnxhz\") pod \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " Sep 10 12:11:06.114980 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.114764 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-config\") pod \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " Sep 10 12:11:06.114980 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.114825 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-oauth-serving-cert\") pod \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " Sep 10 12:11:06.114980 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.114853 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-oauth-config\") pod \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\" (UID: \"e9457b9d-e9ff-4485-971c-8eb2ebf38b78\") " Sep 10 12:11:06.115202 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.115001 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-service-ca" (OuterVolumeSpecName: "service-ca") pod "e9457b9d-e9ff-4485-971c-8eb2ebf38b78" (UID: "e9457b9d-e9ff-4485-971c-8eb2ebf38b78"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:11:06.115202 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.115145 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e9457b9d-e9ff-4485-971c-8eb2ebf38b78" (UID: "e9457b9d-e9ff-4485-971c-8eb2ebf38b78"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:11:06.115318 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.115246 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-config" (OuterVolumeSpecName: "console-config") pod "e9457b9d-e9ff-4485-971c-8eb2ebf38b78" (UID: "e9457b9d-e9ff-4485-971c-8eb2ebf38b78"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:11:06.115318 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.115243 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e9457b9d-e9ff-4485-971c-8eb2ebf38b78" (UID: "e9457b9d-e9ff-4485-971c-8eb2ebf38b78"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:11:06.115440 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.115423 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-config\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:06.115479 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.115442 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-oauth-serving-cert\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:06.115479 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.115451 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-service-ca\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:06.115479 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.115461 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-trusted-ca-bundle\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:06.116989 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.116967 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-kube-api-access-vnxhz" (OuterVolumeSpecName: "kube-api-access-vnxhz") pod "e9457b9d-e9ff-4485-971c-8eb2ebf38b78" (UID: "e9457b9d-e9ff-4485-971c-8eb2ebf38b78"). InnerVolumeSpecName "kube-api-access-vnxhz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:11:06.117517 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.117498 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e9457b9d-e9ff-4485-971c-8eb2ebf38b78" (UID: "e9457b9d-e9ff-4485-971c-8eb2ebf38b78"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:06.117603 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.117564 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e9457b9d-e9ff-4485-971c-8eb2ebf38b78" (UID: "e9457b9d-e9ff-4485-971c-8eb2ebf38b78"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:06.216451 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.216413 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-oauth-config\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:06.216451 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.216445 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-console-serving-cert\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:06.216451 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.216459 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnxhz\" (UniqueName: \"kubernetes.io/projected/e9457b9d-e9ff-4485-971c-8eb2ebf38b78-kube-api-access-vnxhz\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:06.723940 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.723903 2555 generic.go:356] "Generic (PLEG): container finished" podID="e9457b9d-e9ff-4485-971c-8eb2ebf38b78" containerID="0491318b349ea100b8bef0b916d9fcbe555e33ba780b4d8e76d404a5ff39e2c5" exitCode=0 Sep 10 12:11:06.723940 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.723944 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d547869d-dhsn4" event={"ID":"e9457b9d-e9ff-4485-971c-8eb2ebf38b78","Type":"ContainerDied","Data":"0491318b349ea100b8bef0b916d9fcbe555e33ba780b4d8e76d404a5ff39e2c5"} Sep 10 12:11:06.724475 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.723963 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d547869d-dhsn4" Sep 10 12:11:06.724475 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.724023 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d547869d-dhsn4" event={"ID":"e9457b9d-e9ff-4485-971c-8eb2ebf38b78","Type":"ContainerDied","Data":"47d6cc738819a671ec0c81a36e1e3438d430a7b111eb21def07b4032699aa7b5"} Sep 10 12:11:06.724475 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.724054 2555 scope.go:117] "RemoveContainer" containerID="0491318b349ea100b8bef0b916d9fcbe555e33ba780b4d8e76d404a5ff39e2c5" Sep 10 12:11:06.732965 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.732948 2555 scope.go:117] "RemoveContainer" containerID="0491318b349ea100b8bef0b916d9fcbe555e33ba780b4d8e76d404a5ff39e2c5" Sep 10 12:11:06.733337 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:11:06.733314 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0491318b349ea100b8bef0b916d9fcbe555e33ba780b4d8e76d404a5ff39e2c5\": container with ID starting with 0491318b349ea100b8bef0b916d9fcbe555e33ba780b4d8e76d404a5ff39e2c5 not found: ID does not exist" containerID="0491318b349ea100b8bef0b916d9fcbe555e33ba780b4d8e76d404a5ff39e2c5" Sep 10 12:11:06.733385 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.733346 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0491318b349ea100b8bef0b916d9fcbe555e33ba780b4d8e76d404a5ff39e2c5"} err="failed to get container status \"0491318b349ea100b8bef0b916d9fcbe555e33ba780b4d8e76d404a5ff39e2c5\": rpc error: code = NotFound desc = could not find container \"0491318b349ea100b8bef0b916d9fcbe555e33ba780b4d8e76d404a5ff39e2c5\": container with ID starting with 0491318b349ea100b8bef0b916d9fcbe555e33ba780b4d8e76d404a5ff39e2c5 not found: ID does not exist" Sep 10 12:11:06.744637 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.744605 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85d547869d-dhsn4"] Sep 10 12:11:06.748517 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:06.748489 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85d547869d-dhsn4"] Sep 10 12:11:07.113734 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:07.113643 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9457b9d-e9ff-4485-971c-8eb2ebf38b78" path="/var/lib/kubelet/pods/e9457b9d-e9ff-4485-971c-8eb2ebf38b78/volumes" Sep 10 12:11:11.599747 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:11.599701 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wkm26" Sep 10 12:11:12.492420 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:12.492394 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:11:12.496267 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:12.496244 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6d5599ff9f-7hmds" Sep 10 12:11:16.719804 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:16.719751 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c7fbc88d7-xm672" podUID="eb310996-fdc9-45b8-b2e8-74c441e0d69f" containerName="console" containerID="cri-o://d7c1c5926b4ac805e9e768aff3ac969cfc752483641cac08b553b233e82289d6" gracePeriod=15 Sep 10 12:11:16.984606 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:16.984549 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:11:17.024209 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.024181 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-oauth-serving-cert\") pod \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " Sep 10 12:11:17.024349 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.024238 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-service-ca\") pod \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " Sep 10 12:11:17.024349 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.024269 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-oauth-config\") pod \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " Sep 10 12:11:17.024349 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.024302 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkqgd\" (UniqueName: \"kubernetes.io/projected/eb310996-fdc9-45b8-b2e8-74c441e0d69f-kube-api-access-qkqgd\") pod \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " Sep 10 12:11:17.024349 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.024320 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-config\") pod \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " Sep 10 12:11:17.024349 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.024348 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-serving-cert\") pod \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\" (UID: \"eb310996-fdc9-45b8-b2e8-74c441e0d69f\") " Sep 10 12:11:17.026096 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.025025 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-service-ca" (OuterVolumeSpecName: "service-ca") pod "eb310996-fdc9-45b8-b2e8-74c441e0d69f" (UID: "eb310996-fdc9-45b8-b2e8-74c441e0d69f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:11:17.026096 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.025557 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eb310996-fdc9-45b8-b2e8-74c441e0d69f" (UID: "eb310996-fdc9-45b8-b2e8-74c441e0d69f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:11:17.026096 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.025595 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-config" (OuterVolumeSpecName: "console-config") pod "eb310996-fdc9-45b8-b2e8-74c441e0d69f" (UID: "eb310996-fdc9-45b8-b2e8-74c441e0d69f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:11:17.026096 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.025758 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-service-ca\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:17.031704 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.031671 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb310996-fdc9-45b8-b2e8-74c441e0d69f-kube-api-access-qkqgd" (OuterVolumeSpecName: "kube-api-access-qkqgd") pod "eb310996-fdc9-45b8-b2e8-74c441e0d69f" (UID: "eb310996-fdc9-45b8-b2e8-74c441e0d69f"). InnerVolumeSpecName "kube-api-access-qkqgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:11:17.031704 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.031687 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eb310996-fdc9-45b8-b2e8-74c441e0d69f" (UID: "eb310996-fdc9-45b8-b2e8-74c441e0d69f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:17.031847 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.031746 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eb310996-fdc9-45b8-b2e8-74c441e0d69f" (UID: "eb310996-fdc9-45b8-b2e8-74c441e0d69f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:17.138697 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.138588 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkqgd\" (UniqueName: \"kubernetes.io/projected/eb310996-fdc9-45b8-b2e8-74c441e0d69f-kube-api-access-qkqgd\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:17.138697 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.138630 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-config\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:17.138697 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.138644 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-serving-cert\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:17.138697 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.138656 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb310996-fdc9-45b8-b2e8-74c441e0d69f-oauth-serving-cert\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:17.138697 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.138668 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb310996-fdc9-45b8-b2e8-74c441e0d69f-console-oauth-config\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:17.776051 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.776015 2555 generic.go:356] "Generic (PLEG): container finished" podID="eb310996-fdc9-45b8-b2e8-74c441e0d69f" containerID="d7c1c5926b4ac805e9e768aff3ac969cfc752483641cac08b553b233e82289d6" exitCode=0 Sep 10 12:11:17.776578 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.776088 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7fbc88d7-xm672" Sep 10 12:11:17.776578 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.776118 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7fbc88d7-xm672" event={"ID":"eb310996-fdc9-45b8-b2e8-74c441e0d69f","Type":"ContainerDied","Data":"d7c1c5926b4ac805e9e768aff3ac969cfc752483641cac08b553b233e82289d6"} Sep 10 12:11:17.776578 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.776182 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7fbc88d7-xm672" event={"ID":"eb310996-fdc9-45b8-b2e8-74c441e0d69f","Type":"ContainerDied","Data":"11b206db4285061254269785cb3ecce7767634cf8a90c8383910bf37d2eb9148"} Sep 10 12:11:17.776578 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.776211 2555 scope.go:117] "RemoveContainer" containerID="d7c1c5926b4ac805e9e768aff3ac969cfc752483641cac08b553b233e82289d6" Sep 10 12:11:17.784858 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.784843 2555 scope.go:117] "RemoveContainer" containerID="d7c1c5926b4ac805e9e768aff3ac969cfc752483641cac08b553b233e82289d6" Sep 10 12:11:17.785140 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:11:17.785112 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7c1c5926b4ac805e9e768aff3ac969cfc752483641cac08b553b233e82289d6\": container with ID starting with d7c1c5926b4ac805e9e768aff3ac969cfc752483641cac08b553b233e82289d6 not found: ID does not exist" containerID="d7c1c5926b4ac805e9e768aff3ac969cfc752483641cac08b553b233e82289d6" Sep 10 12:11:17.785236 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.785144 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c1c5926b4ac805e9e768aff3ac969cfc752483641cac08b553b233e82289d6"} err="failed to get container status \"d7c1c5926b4ac805e9e768aff3ac969cfc752483641cac08b553b233e82289d6\": rpc error: code = NotFound desc = could not find container \"d7c1c5926b4ac805e9e768aff3ac969cfc752483641cac08b553b233e82289d6\": container with ID starting with d7c1c5926b4ac805e9e768aff3ac969cfc752483641cac08b553b233e82289d6 not found: ID does not exist" Sep 10 12:11:17.791822 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.791798 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c7fbc88d7-xm672"] Sep 10 12:11:17.795933 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:17.795910 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c7fbc88d7-xm672"] Sep 10 12:11:19.113181 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:19.113151 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb310996-fdc9-45b8-b2e8-74c441e0d69f" path="/var/lib/kubelet/pods/eb310996-fdc9-45b8-b2e8-74c441e0d69f/volumes" Sep 10 12:11:34.363330 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:34.363289 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:34.382863 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:34.382836 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:34.866613 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:34.866588 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:48.083888 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.083851 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:11:48.084392 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.084195 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="alertmanager" containerID="cri-o://6d53a81f054a2cefcc35d919f5fd46ef65ea06dc40e1a0587aed21c1856187fa" gracePeriod=120 Sep 10 12:11:48.084392 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.084244 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="kube-rbac-proxy-web" containerID="cri-o://41b312498bbe305bd0d8027041947955247c9f492064c236a5e770f9ff6d98fd" gracePeriod=120 Sep 10 12:11:48.084392 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.084266 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="prom-label-proxy" containerID="cri-o://ad2ebf1ee9cbfc339ca8bd9e8da3228ea122ffa806f9af2d3fab5e44ba3a9092" gracePeriod=120 Sep 10 12:11:48.084392 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.084305 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="kube-rbac-proxy" containerID="cri-o://9d52f09a65198a3104e2ac8b74b2995ffa0d9643960354ced9d3f2397f8c582b" gracePeriod=120 Sep 10 12:11:48.084392 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.084225 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="kube-rbac-proxy-metric" containerID="cri-o://146796b14ae6f758851df2405fdbfb6ccafd3b187fa302b84b68ca2818dbabc0" gracePeriod=120 Sep 10 12:11:48.084392 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.084364 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="config-reloader" containerID="cri-o://dc5cbe55939ca745ee56255c33a9160a92cb2894210065375a7216b3918a904f" gracePeriod=120 Sep 10 12:11:48.912940 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.912908 2555 generic.go:356] "Generic (PLEG): container finished" podID="b7b605dc-ff44-440b-a637-71516c5d996a" containerID="ad2ebf1ee9cbfc339ca8bd9e8da3228ea122ffa806f9af2d3fab5e44ba3a9092" exitCode=0 Sep 10 12:11:48.912940 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.912931 2555 generic.go:356] "Generic (PLEG): container finished" podID="b7b605dc-ff44-440b-a637-71516c5d996a" containerID="146796b14ae6f758851df2405fdbfb6ccafd3b187fa302b84b68ca2818dbabc0" exitCode=0 Sep 10 12:11:48.912940 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.912938 2555 generic.go:356] "Generic (PLEG): container finished" podID="b7b605dc-ff44-440b-a637-71516c5d996a" containerID="9d52f09a65198a3104e2ac8b74b2995ffa0d9643960354ced9d3f2397f8c582b" exitCode=0 Sep 10 12:11:48.912940 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.912944 2555 generic.go:356] "Generic (PLEG): container finished" podID="b7b605dc-ff44-440b-a637-71516c5d996a" containerID="dc5cbe55939ca745ee56255c33a9160a92cb2894210065375a7216b3918a904f" exitCode=0 Sep 10 12:11:48.912940 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.912949 2555 generic.go:356] "Generic (PLEG): container finished" podID="b7b605dc-ff44-440b-a637-71516c5d996a" containerID="6d53a81f054a2cefcc35d919f5fd46ef65ea06dc40e1a0587aed21c1856187fa" exitCode=0 Sep 10 12:11:48.913240 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.912975 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b605dc-ff44-440b-a637-71516c5d996a","Type":"ContainerDied","Data":"ad2ebf1ee9cbfc339ca8bd9e8da3228ea122ffa806f9af2d3fab5e44ba3a9092"} Sep 10 12:11:48.913240 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.913037 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b605dc-ff44-440b-a637-71516c5d996a","Type":"ContainerDied","Data":"146796b14ae6f758851df2405fdbfb6ccafd3b187fa302b84b68ca2818dbabc0"} Sep 10 12:11:48.913240 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.913064 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b605dc-ff44-440b-a637-71516c5d996a","Type":"ContainerDied","Data":"9d52f09a65198a3104e2ac8b74b2995ffa0d9643960354ced9d3f2397f8c582b"} Sep 10 12:11:48.913240 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.913101 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b605dc-ff44-440b-a637-71516c5d996a","Type":"ContainerDied","Data":"dc5cbe55939ca745ee56255c33a9160a92cb2894210065375a7216b3918a904f"} Sep 10 12:11:48.913240 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:48.913124 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b605dc-ff44-440b-a637-71516c5d996a","Type":"ContainerDied","Data":"6d53a81f054a2cefcc35d919f5fd46ef65ea06dc40e1a0587aed21c1856187fa"} Sep 10 12:11:49.322651 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.322628 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:49.413896 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.413864 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-web-config\") pod \"b7b605dc-ff44-440b-a637-71516c5d996a\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " Sep 10 12:11:49.414088 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.413914 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy-web\") pod \"b7b605dc-ff44-440b-a637-71516c5d996a\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " Sep 10 12:11:49.414088 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.413957 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-main-tls\") pod \"b7b605dc-ff44-440b-a637-71516c5d996a\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " Sep 10 12:11:49.414088 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.413981 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b605dc-ff44-440b-a637-71516c5d996a-alertmanager-trusted-ca-bundle\") pod \"b7b605dc-ff44-440b-a637-71516c5d996a\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " Sep 10 12:11:49.414088 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.414005 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7b605dc-ff44-440b-a637-71516c5d996a-metrics-client-ca\") pod \"b7b605dc-ff44-440b-a637-71516c5d996a\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " Sep 10 12:11:49.414088 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.414042 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7b605dc-ff44-440b-a637-71516c5d996a-config-out\") pod \"b7b605dc-ff44-440b-a637-71516c5d996a\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " Sep 10 12:11:49.414088 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.414083 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7b605dc-ff44-440b-a637-71516c5d996a-alertmanager-main-db\") pod \"b7b605dc-ff44-440b-a637-71516c5d996a\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " Sep 10 12:11:49.414393 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.414114 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy\") pod \"b7b605dc-ff44-440b-a637-71516c5d996a\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " Sep 10 12:11:49.414393 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.414149 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-cluster-tls-config\") pod \"b7b605dc-ff44-440b-a637-71516c5d996a\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " Sep 10 12:11:49.414393 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.414181 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzmvh\" (UniqueName: \"kubernetes.io/projected/b7b605dc-ff44-440b-a637-71516c5d996a-kube-api-access-tzmvh\") pod \"b7b605dc-ff44-440b-a637-71516c5d996a\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " Sep 10 12:11:49.414393 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.414214 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b7b605dc-ff44-440b-a637-71516c5d996a\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " Sep 10 12:11:49.414393 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.414265 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-config-volume\") pod \"b7b605dc-ff44-440b-a637-71516c5d996a\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " Sep 10 12:11:49.414393 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.414308 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7b605dc-ff44-440b-a637-71516c5d996a-tls-assets\") pod \"b7b605dc-ff44-440b-a637-71516c5d996a\" (UID: \"b7b605dc-ff44-440b-a637-71516c5d996a\") " Sep 10 12:11:49.414732 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.414444 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7b605dc-ff44-440b-a637-71516c5d996a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b7b605dc-ff44-440b-a637-71516c5d996a" (UID: "b7b605dc-ff44-440b-a637-71516c5d996a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:11:49.414732 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.414669 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7b605dc-ff44-440b-a637-71516c5d996a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b7b605dc-ff44-440b-a637-71516c5d996a" (UID: "b7b605dc-ff44-440b-a637-71516c5d996a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:11:49.414732 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.414687 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b605dc-ff44-440b-a637-71516c5d996a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:49.415142 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.415115 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7b605dc-ff44-440b-a637-71516c5d996a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b7b605dc-ff44-440b-a637-71516c5d996a" (UID: "b7b605dc-ff44-440b-a637-71516c5d996a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:11:49.417064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.417027 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b7b605dc-ff44-440b-a637-71516c5d996a" (UID: "b7b605dc-ff44-440b-a637-71516c5d996a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:49.417539 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.417499 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7b605dc-ff44-440b-a637-71516c5d996a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b7b605dc-ff44-440b-a637-71516c5d996a" (UID: "b7b605dc-ff44-440b-a637-71516c5d996a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:11:49.417639 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.417532 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b7b605dc-ff44-440b-a637-71516c5d996a" (UID: "b7b605dc-ff44-440b-a637-71516c5d996a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:49.417900 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.417859 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b7b605dc-ff44-440b-a637-71516c5d996a" (UID: "b7b605dc-ff44-440b-a637-71516c5d996a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:49.417977 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.417918 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7b605dc-ff44-440b-a637-71516c5d996a-config-out" (OuterVolumeSpecName: "config-out") pod "b7b605dc-ff44-440b-a637-71516c5d996a" (UID: "b7b605dc-ff44-440b-a637-71516c5d996a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:11:49.417977 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.417945 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-config-volume" (OuterVolumeSpecName: "config-volume") pod "b7b605dc-ff44-440b-a637-71516c5d996a" (UID: "b7b605dc-ff44-440b-a637-71516c5d996a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:49.418689 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.418661 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7b605dc-ff44-440b-a637-71516c5d996a-kube-api-access-tzmvh" (OuterVolumeSpecName: "kube-api-access-tzmvh") pod "b7b605dc-ff44-440b-a637-71516c5d996a" (UID: "b7b605dc-ff44-440b-a637-71516c5d996a"). InnerVolumeSpecName "kube-api-access-tzmvh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:11:49.418807 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.418782 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b7b605dc-ff44-440b-a637-71516c5d996a" (UID: "b7b605dc-ff44-440b-a637-71516c5d996a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:49.422226 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.422178 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b7b605dc-ff44-440b-a637-71516c5d996a" (UID: "b7b605dc-ff44-440b-a637-71516c5d996a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:49.428525 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.428499 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-web-config" (OuterVolumeSpecName: "web-config") pod "b7b605dc-ff44-440b-a637-71516c5d996a" (UID: "b7b605dc-ff44-440b-a637-71516c5d996a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:49.515291 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.515206 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:49.515291 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.515235 2555 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-cluster-tls-config\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:49.515291 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.515245 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzmvh\" (UniqueName: \"kubernetes.io/projected/b7b605dc-ff44-440b-a637-71516c5d996a-kube-api-access-tzmvh\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:49.515291 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.515255 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:49.515291 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.515265 2555 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-config-volume\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:49.515291 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.515274 2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7b605dc-ff44-440b-a637-71516c5d996a-tls-assets\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:49.515291 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.515282 2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-web-config\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:49.515291 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.515289 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:49.515291 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.515298 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7b605dc-ff44-440b-a637-71516c5d996a-secret-alertmanager-main-tls\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:49.515663 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.515306 2555 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7b605dc-ff44-440b-a637-71516c5d996a-metrics-client-ca\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:49.515663 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.515314 2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7b605dc-ff44-440b-a637-71516c5d996a-config-out\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:49.515663 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.515322 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7b605dc-ff44-440b-a637-71516c5d996a-alertmanager-main-db\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:49.920637 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.920555 2555 generic.go:356] "Generic (PLEG): container finished" podID="b7b605dc-ff44-440b-a637-71516c5d996a" containerID="41b312498bbe305bd0d8027041947955247c9f492064c236a5e770f9ff6d98fd" exitCode=0 Sep 10 12:11:49.920760 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.920637 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:49.920760 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.920636 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b605dc-ff44-440b-a637-71516c5d996a","Type":"ContainerDied","Data":"41b312498bbe305bd0d8027041947955247c9f492064c236a5e770f9ff6d98fd"} Sep 10 12:11:49.920760 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.920722 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b605dc-ff44-440b-a637-71516c5d996a","Type":"ContainerDied","Data":"2134c654194718d004cd42b9ac0c2542fef854850d7d42d8e22afa3a0d4fda40"} Sep 10 12:11:49.920908 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.920771 2555 scope.go:117] "RemoveContainer" containerID="ad2ebf1ee9cbfc339ca8bd9e8da3228ea122ffa806f9af2d3fab5e44ba3a9092" Sep 10 12:11:49.928503 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.928480 2555 scope.go:117] "RemoveContainer" containerID="146796b14ae6f758851df2405fdbfb6ccafd3b187fa302b84b68ca2818dbabc0" Sep 10 12:11:49.936899 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.936878 2555 scope.go:117] "RemoveContainer" containerID="9d52f09a65198a3104e2ac8b74b2995ffa0d9643960354ced9d3f2397f8c582b" Sep 10 12:11:49.944501 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.944482 2555 scope.go:117] "RemoveContainer" containerID="41b312498bbe305bd0d8027041947955247c9f492064c236a5e770f9ff6d98fd" Sep 10 12:11:49.945124 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.945102 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:11:49.948817 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.948797 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:11:49.952209 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.952190 2555 scope.go:117] "RemoveContainer" containerID="dc5cbe55939ca745ee56255c33a9160a92cb2894210065375a7216b3918a904f" Sep 10 12:11:49.959060 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.959045 2555 scope.go:117] "RemoveContainer" containerID="6d53a81f054a2cefcc35d919f5fd46ef65ea06dc40e1a0587aed21c1856187fa" Sep 10 12:11:49.965995 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.965976 2555 scope.go:117] "RemoveContainer" containerID="bcd7ba2303755e1ea6c6d6c96404c4a5ace999c2e9ff1cbbbc4afce6b2076d5a" Sep 10 12:11:49.972621 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.972606 2555 scope.go:117] "RemoveContainer" containerID="ad2ebf1ee9cbfc339ca8bd9e8da3228ea122ffa806f9af2d3fab5e44ba3a9092" Sep 10 12:11:49.972884 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:11:49.972861 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad2ebf1ee9cbfc339ca8bd9e8da3228ea122ffa806f9af2d3fab5e44ba3a9092\": container with ID starting with ad2ebf1ee9cbfc339ca8bd9e8da3228ea122ffa806f9af2d3fab5e44ba3a9092 not found: ID does not exist" containerID="ad2ebf1ee9cbfc339ca8bd9e8da3228ea122ffa806f9af2d3fab5e44ba3a9092" Sep 10 12:11:49.972953 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.972901 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad2ebf1ee9cbfc339ca8bd9e8da3228ea122ffa806f9af2d3fab5e44ba3a9092"} err="failed to get container status \"ad2ebf1ee9cbfc339ca8bd9e8da3228ea122ffa806f9af2d3fab5e44ba3a9092\": rpc error: code = NotFound desc = could not find container \"ad2ebf1ee9cbfc339ca8bd9e8da3228ea122ffa806f9af2d3fab5e44ba3a9092\": container with ID starting with ad2ebf1ee9cbfc339ca8bd9e8da3228ea122ffa806f9af2d3fab5e44ba3a9092 not found: ID does not exist" Sep 10 12:11:49.972953 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.972927 2555 scope.go:117] "RemoveContainer" containerID="146796b14ae6f758851df2405fdbfb6ccafd3b187fa302b84b68ca2818dbabc0" Sep 10 12:11:49.973328 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:11:49.973302 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"146796b14ae6f758851df2405fdbfb6ccafd3b187fa302b84b68ca2818dbabc0\": container with ID starting with 146796b14ae6f758851df2405fdbfb6ccafd3b187fa302b84b68ca2818dbabc0 not found: ID does not exist" containerID="146796b14ae6f758851df2405fdbfb6ccafd3b187fa302b84b68ca2818dbabc0" Sep 10 12:11:49.973427 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.973337 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"146796b14ae6f758851df2405fdbfb6ccafd3b187fa302b84b68ca2818dbabc0"} err="failed to get container status \"146796b14ae6f758851df2405fdbfb6ccafd3b187fa302b84b68ca2818dbabc0\": rpc error: code = NotFound desc = could not find container \"146796b14ae6f758851df2405fdbfb6ccafd3b187fa302b84b68ca2818dbabc0\": container with ID starting with 146796b14ae6f758851df2405fdbfb6ccafd3b187fa302b84b68ca2818dbabc0 not found: ID does not exist" Sep 10 12:11:49.973427 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.973358 2555 scope.go:117] "RemoveContainer" containerID="9d52f09a65198a3104e2ac8b74b2995ffa0d9643960354ced9d3f2397f8c582b" Sep 10 12:11:49.973983 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:11:49.973953 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d52f09a65198a3104e2ac8b74b2995ffa0d9643960354ced9d3f2397f8c582b\": container with ID starting with 9d52f09a65198a3104e2ac8b74b2995ffa0d9643960354ced9d3f2397f8c582b not found: ID does not exist" containerID="9d52f09a65198a3104e2ac8b74b2995ffa0d9643960354ced9d3f2397f8c582b" Sep 10 12:11:49.974090 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.973990 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d52f09a65198a3104e2ac8b74b2995ffa0d9643960354ced9d3f2397f8c582b"} err="failed to get container status \"9d52f09a65198a3104e2ac8b74b2995ffa0d9643960354ced9d3f2397f8c582b\": rpc error: code = NotFound desc = could not find container \"9d52f09a65198a3104e2ac8b74b2995ffa0d9643960354ced9d3f2397f8c582b\": container with ID starting with 9d52f09a65198a3104e2ac8b74b2995ffa0d9643960354ced9d3f2397f8c582b not found: ID does not exist" Sep 10 12:11:49.974090 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.974012 2555 scope.go:117] "RemoveContainer" containerID="41b312498bbe305bd0d8027041947955247c9f492064c236a5e770f9ff6d98fd" Sep 10 12:11:49.974337 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:11:49.974315 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41b312498bbe305bd0d8027041947955247c9f492064c236a5e770f9ff6d98fd\": container with ID starting with 41b312498bbe305bd0d8027041947955247c9f492064c236a5e770f9ff6d98fd not found: ID does not exist" containerID="41b312498bbe305bd0d8027041947955247c9f492064c236a5e770f9ff6d98fd" Sep 10 12:11:49.974408 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.974343 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41b312498bbe305bd0d8027041947955247c9f492064c236a5e770f9ff6d98fd"} err="failed to get container status \"41b312498bbe305bd0d8027041947955247c9f492064c236a5e770f9ff6d98fd\": rpc error: code = NotFound desc = could not find container \"41b312498bbe305bd0d8027041947955247c9f492064c236a5e770f9ff6d98fd\": container with ID starting with 41b312498bbe305bd0d8027041947955247c9f492064c236a5e770f9ff6d98fd not found: ID does not exist" Sep 10 12:11:49.974408 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.974363 2555 scope.go:117] "RemoveContainer" containerID="dc5cbe55939ca745ee56255c33a9160a92cb2894210065375a7216b3918a904f" Sep 10 12:11:49.974646 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:11:49.974628 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc5cbe55939ca745ee56255c33a9160a92cb2894210065375a7216b3918a904f\": container with ID starting with dc5cbe55939ca745ee56255c33a9160a92cb2894210065375a7216b3918a904f not found: ID does not exist" containerID="dc5cbe55939ca745ee56255c33a9160a92cb2894210065375a7216b3918a904f" Sep 10 12:11:49.974709 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.974655 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc5cbe55939ca745ee56255c33a9160a92cb2894210065375a7216b3918a904f"} err="failed to get container status \"dc5cbe55939ca745ee56255c33a9160a92cb2894210065375a7216b3918a904f\": rpc error: code = NotFound desc = could not find container \"dc5cbe55939ca745ee56255c33a9160a92cb2894210065375a7216b3918a904f\": container with ID starting with dc5cbe55939ca745ee56255c33a9160a92cb2894210065375a7216b3918a904f not found: ID does not exist" Sep 10 12:11:49.974709 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.974669 2555 scope.go:117] "RemoveContainer" containerID="6d53a81f054a2cefcc35d919f5fd46ef65ea06dc40e1a0587aed21c1856187fa" Sep 10 12:11:49.974902 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:11:49.974877 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d53a81f054a2cefcc35d919f5fd46ef65ea06dc40e1a0587aed21c1856187fa\": container with ID starting with 6d53a81f054a2cefcc35d919f5fd46ef65ea06dc40e1a0587aed21c1856187fa not found: ID does not exist" containerID="6d53a81f054a2cefcc35d919f5fd46ef65ea06dc40e1a0587aed21c1856187fa" Sep 10 12:11:49.974957 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.974906 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d53a81f054a2cefcc35d919f5fd46ef65ea06dc40e1a0587aed21c1856187fa"} err="failed to get container status \"6d53a81f054a2cefcc35d919f5fd46ef65ea06dc40e1a0587aed21c1856187fa\": rpc error: code = NotFound desc = could not find container \"6d53a81f054a2cefcc35d919f5fd46ef65ea06dc40e1a0587aed21c1856187fa\": container with ID starting with 6d53a81f054a2cefcc35d919f5fd46ef65ea06dc40e1a0587aed21c1856187fa not found: ID does not exist" Sep 10 12:11:49.974957 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.974919 2555 scope.go:117] "RemoveContainer" containerID="bcd7ba2303755e1ea6c6d6c96404c4a5ace999c2e9ff1cbbbc4afce6b2076d5a" Sep 10 12:11:49.975218 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:11:49.975196 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcd7ba2303755e1ea6c6d6c96404c4a5ace999c2e9ff1cbbbc4afce6b2076d5a\": container with ID starting with bcd7ba2303755e1ea6c6d6c96404c4a5ace999c2e9ff1cbbbc4afce6b2076d5a not found: ID does not exist" containerID="bcd7ba2303755e1ea6c6d6c96404c4a5ace999c2e9ff1cbbbc4afce6b2076d5a" Sep 10 12:11:49.975269 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975225 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcd7ba2303755e1ea6c6d6c96404c4a5ace999c2e9ff1cbbbc4afce6b2076d5a"} err="failed to get container status \"bcd7ba2303755e1ea6c6d6c96404c4a5ace999c2e9ff1cbbbc4afce6b2076d5a\": rpc error: code = NotFound desc = could not find container \"bcd7ba2303755e1ea6c6d6c96404c4a5ace999c2e9ff1cbbbc4afce6b2076d5a\": container with ID starting with bcd7ba2303755e1ea6c6d6c96404c4a5ace999c2e9ff1cbbbc4afce6b2076d5a not found: ID does not exist" Sep 10 12:11:49.975451 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975438 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:11:49.975731 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975721 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="kube-rbac-proxy-web" Sep 10 12:11:49.975765 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975733 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="kube-rbac-proxy-web" Sep 10 12:11:49.975765 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975744 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="init-config-reloader" Sep 10 12:11:49.975765 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975750 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="init-config-reloader" Sep 10 12:11:49.975765 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975757 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9457b9d-e9ff-4485-971c-8eb2ebf38b78" containerName="console" Sep 10 12:11:49.975765 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975762 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9457b9d-e9ff-4485-971c-8eb2ebf38b78" containerName="console" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975769 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb310996-fdc9-45b8-b2e8-74c441e0d69f" containerName="console" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975774 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb310996-fdc9-45b8-b2e8-74c441e0d69f" containerName="console" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975780 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="kube-rbac-proxy" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975785 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="kube-rbac-proxy" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975792 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="kube-rbac-proxy-metric" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975797 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="kube-rbac-proxy-metric" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975806 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f3f7aba-1f2c-4a9b-b873-7042e96395b7" containerName="console" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975810 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f3f7aba-1f2c-4a9b-b873-7042e96395b7" containerName="console" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975817 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="config-reloader" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975822 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="config-reloader" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975829 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="alertmanager" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975834 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="alertmanager" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975839 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="prom-label-proxy" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975843 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="prom-label-proxy" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975891 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="kube-rbac-proxy-metric" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975899 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9457b9d-e9ff-4485-971c-8eb2ebf38b78" containerName="console" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975905 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f3f7aba-1f2c-4a9b-b873-7042e96395b7" containerName="console" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975910 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="alertmanager" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975918 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="config-reloader" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975923 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="kube-rbac-proxy" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975927 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="prom-label-proxy" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975932 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb310996-fdc9-45b8-b2e8-74c441e0d69f" containerName="console" Sep 10 12:11:49.975905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.975939 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" containerName="kube-rbac-proxy-web" Sep 10 12:11:49.979902 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.979887 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:49.982592 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.982574 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 12:11:49.982686 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.982594 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jpnr5\"" Sep 10 12:11:49.982686 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.982608 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 12:11:49.982686 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.982625 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 12:11:49.982826 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.982719 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 12:11:49.982943 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.982925 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 12:11:49.983038 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.982960 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 12:11:49.983479 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.983458 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 12:11:49.984423 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.983841 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 12:11:49.993227 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.992975 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 12:11:49.995964 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:49.995943 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:11:50.018360 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.018337 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-config-out\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.018449 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.018364 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-config-volume\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.018449 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.018387 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.018519 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.018473 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-tls-assets\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.018519 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.018512 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.018583 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.018532 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l85b\" (UniqueName: \"kubernetes.io/projected/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-kube-api-access-6l85b\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.018583 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.018573 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.018642 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.018604 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.018642 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.018622 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.018642 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.018637 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.018728 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.018652 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.018728 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.018714 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-web-config\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.018793 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.018743 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.119649 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.119613 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.119649 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.119661 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.119880 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.119686 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.119880 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.119732 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-web-config\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.119880 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.119763 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.119880 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.119795 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-config-out\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.119880 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.119818 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-config-volume\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.119880 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.119853 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.120187 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.119888 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-tls-assets\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.120187 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.119943 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.120187 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.119969 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l85b\" (UniqueName: \"kubernetes.io/projected/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-kube-api-access-6l85b\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.120187 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.119995 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.120187 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.120033 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.120733 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.120356 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.120733 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.120568 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.120883 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.120858 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.121582 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.121560 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55968b787f-6snwb"] Sep 10 12:11:50.123379 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.123251 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-config-out\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.123481 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.123411 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-config-volume\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.123699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.123675 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.123780 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.123669 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.123780 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.123771 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-web-config\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.123992 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.123970 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.124148 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.124128 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.124750 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.124729 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-tls-assets\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.124900 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.124884 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.126022 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.126008 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.128490 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.128466 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l85b\" (UniqueName: \"kubernetes.io/projected/50ddb12b-1f50-4b1e-a5ae-7ad8875db358-kube-api-access-6l85b\") pod \"alertmanager-main-0\" (UID: \"50ddb12b-1f50-4b1e-a5ae-7ad8875db358\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.140182 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.140160 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55968b787f-6snwb"] Sep 10 12:11:50.221178 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.221149 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-service-ca\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.221324 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.221182 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4f6c\" (UniqueName: \"kubernetes.io/projected/3492c8e4-4179-4fcd-b733-2042442c16c1-kube-api-access-x4f6c\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.221324 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.221213 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3492c8e4-4179-4fcd-b733-2042442c16c1-console-oauth-config\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.221324 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.221280 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-console-config\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.221324 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.221319 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-trusted-ca-bundle\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.221452 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.221340 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-oauth-serving-cert\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.221452 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.221406 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3492c8e4-4179-4fcd-b733-2042442c16c1-console-serving-cert\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.295258 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.295228 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:11:50.322733 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.322700 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-service-ca\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.323144 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.322744 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4f6c\" (UniqueName: \"kubernetes.io/projected/3492c8e4-4179-4fcd-b733-2042442c16c1-kube-api-access-x4f6c\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.323144 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.322790 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3492c8e4-4179-4fcd-b733-2042442c16c1-console-oauth-config\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.323144 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.322816 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-console-config\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.323144 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.322840 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-trusted-ca-bundle\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.323144 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.322865 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-oauth-serving-cert\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.323144 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.322926 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3492c8e4-4179-4fcd-b733-2042442c16c1-console-serving-cert\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.323532 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.323507 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-service-ca\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.323713 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.323692 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-console-config\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.323851 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.323822 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-trusted-ca-bundle\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.323918 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.323897 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-oauth-serving-cert\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.325151 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.325129 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3492c8e4-4179-4fcd-b733-2042442c16c1-console-oauth-config\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.325306 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.325288 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3492c8e4-4179-4fcd-b733-2042442c16c1-console-serving-cert\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.334199 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.334179 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4f6c\" (UniqueName: \"kubernetes.io/projected/3492c8e4-4179-4fcd-b733-2042442c16c1-kube-api-access-x4f6c\") pod \"console-55968b787f-6snwb\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.435294 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.435256 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:11:50.576142 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.576115 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:11:50.577659 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:11:50.577634 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ddb12b_1f50_4b1e_a5ae_7ad8875db358.slice/crio-50b06f7f2775d0fae25a668d135d90185a10920446fc4ca0a3ec6a2fcbd51274 WatchSource:0}: Error finding container 50b06f7f2775d0fae25a668d135d90185a10920446fc4ca0a3ec6a2fcbd51274: Status 404 returned error can't find the container with id 50b06f7f2775d0fae25a668d135d90185a10920446fc4ca0a3ec6a2fcbd51274 Sep 10 12:11:50.704657 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.704633 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55968b787f-6snwb"] Sep 10 12:11:50.714875 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:11:50.714845 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3492c8e4_4179_4fcd_b733_2042442c16c1.slice/crio-7d7d80e5bf52e8b3de662fb7eda071b8268422381d0d87a74ea9ee343195d6dc WatchSource:0}: Error finding container 7d7d80e5bf52e8b3de662fb7eda071b8268422381d0d87a74ea9ee343195d6dc: Status 404 returned error can't find the container with id 7d7d80e5bf52e8b3de662fb7eda071b8268422381d0d87a74ea9ee343195d6dc Sep 10 12:11:50.926243 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.926212 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55968b787f-6snwb" event={"ID":"3492c8e4-4179-4fcd-b733-2042442c16c1","Type":"ContainerStarted","Data":"1ce484dc04f2fcab803615da404f869d0a2f6467faab63ec8abf4aa9748c7b80"} Sep 10 12:11:50.926400 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.926261 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55968b787f-6snwb" event={"ID":"3492c8e4-4179-4fcd-b733-2042442c16c1","Type":"ContainerStarted","Data":"7d7d80e5bf52e8b3de662fb7eda071b8268422381d0d87a74ea9ee343195d6dc"} Sep 10 12:11:50.927798 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.927772 2555 generic.go:356] "Generic (PLEG): container finished" podID="50ddb12b-1f50-4b1e-a5ae-7ad8875db358" containerID="eb7013cdf6cd65e119839836cd0bc64e0a9f15f9ad57711140a88dddda1c0c3e" exitCode=0 Sep 10 12:11:50.927931 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.927849 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"50ddb12b-1f50-4b1e-a5ae-7ad8875db358","Type":"ContainerDied","Data":"eb7013cdf6cd65e119839836cd0bc64e0a9f15f9ad57711140a88dddda1c0c3e"} Sep 10 12:11:50.927931 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.927904 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"50ddb12b-1f50-4b1e-a5ae-7ad8875db358","Type":"ContainerStarted","Data":"50b06f7f2775d0fae25a668d135d90185a10920446fc4ca0a3ec6a2fcbd51274"} Sep 10 12:11:50.943710 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:50.943670 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55968b787f-6snwb" podStartSLOduration=0.943652912 podStartE2EDuration="943.652912ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:11:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:11:50.943394043 +0000 UTC m=+144.383282299" watchObservedRunningTime="2026-09-10 12:11:50.943652912 +0000 UTC m=+144.383541145" Sep 10 12:11:51.113776 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:51.113753 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7b605dc-ff44-440b-a637-71516c5d996a" path="/var/lib/kubelet/pods/b7b605dc-ff44-440b-a637-71516c5d996a/volumes" Sep 10 12:11:51.937582 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:51.937544 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"50ddb12b-1f50-4b1e-a5ae-7ad8875db358","Type":"ContainerStarted","Data":"0dd5bac7f2ff647394ee3b83cb4e4e7b2f88b3435ab2a4f45d435f73458f698c"} Sep 10 12:11:51.938092 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:51.937658 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"50ddb12b-1f50-4b1e-a5ae-7ad8875db358","Type":"ContainerStarted","Data":"5fa35b5e2f626a1e9ec61676c9964728a801885441b3d1eb3f88be634ace966b"} Sep 10 12:11:51.938092 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:51.937715 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"50ddb12b-1f50-4b1e-a5ae-7ad8875db358","Type":"ContainerStarted","Data":"6fbb3013c313465ffbd65dd889f53f1a2f08c6fd9361c166630c7b24b250d273"} Sep 10 12:11:51.938092 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:51.937757 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"50ddb12b-1f50-4b1e-a5ae-7ad8875db358","Type":"ContainerStarted","Data":"5c9405ddde352efe15b59c3944b2f1465f5dbd3ae89f900661baeb1b10662e3b"} Sep 10 12:11:51.938092 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:51.937792 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"50ddb12b-1f50-4b1e-a5ae-7ad8875db358","Type":"ContainerStarted","Data":"6e166424e889b8535f67191337af10e508d020780076818d9e7f15e9523d5462"} Sep 10 12:11:51.938092 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:51.937838 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"50ddb12b-1f50-4b1e-a5ae-7ad8875db358","Type":"ContainerStarted","Data":"8299be20fc1fa8633c745edaf3dd7fc2c7624cf4338774f1de8eb3236bba7c0e"} Sep 10 12:11:51.967564 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:51.967490 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.956217375 podStartE2EDuration="2.967466469s" totalImagesPullingTime="0s" totalInitContainerRuntime="11.249094ms" isStatefulPod=false podCreationTimestamp="2026-09-10 12:11:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:11:51.964970811 +0000 UTC m=+145.404859046" watchObservedRunningTime="2026-09-10 12:11:51.967466469 +0000 UTC m=+145.407354702" Sep 10 12:11:52.319809 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.319718 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:11:52.320154 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.320118 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="prometheus" containerID="cri-o://489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba" gracePeriod=600 Sep 10 12:11:52.320397 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.320134 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="kube-rbac-proxy" containerID="cri-o://d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9" gracePeriod=600 Sep 10 12:11:52.320481 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.320152 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1" gracePeriod=600 Sep 10 12:11:52.320538 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.320170 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="config-reloader" containerID="cri-o://0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2" gracePeriod=600 Sep 10 12:11:52.320614 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.320171 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="thanos-sidecar" containerID="cri-o://bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71" gracePeriod=600 Sep 10 12:11:52.320712 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.320197 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="kube-rbac-proxy-web" containerID="cri-o://339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c" gracePeriod=600 Sep 10 12:11:52.580123 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.580045 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:52.643404 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643369 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.643584 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643413 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-0\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.643584 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643448 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-serving-certs-ca-bundle\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.643584 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643473 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-grpc-tls\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.643584 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643510 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-kubelet-serving-ca-bundle\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.643584 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643552 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-tls\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.643584 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643576 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-config\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.643905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643613 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-2\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.643905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643639 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-metrics-client-certs\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.643905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643673 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-metrics-client-ca\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.643905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643697 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-db\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.643905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643741 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-thanos-prometheus-http-client-file\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.643905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643765 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-web-config\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.643905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643800 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-tls-assets\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.643905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643825 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-kube-rbac-proxy\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.643905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643852 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.643905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643892 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-config-out\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.644415 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643915 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2gjm\" (UniqueName: \"kubernetes.io/projected/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-kube-api-access-j2gjm\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.644415 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.643967 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-1\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.644415 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.644008 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-trusted-ca-bundle\") pod \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\" (UID: \"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299\") " Sep 10 12:11:52.644415 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.644109 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:11:52.644598 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.644453 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.644598 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.644508 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:11:52.644699 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.644635 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:11:52.644768 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.644745 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:11:52.647489 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.645862 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:11:52.647489 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.646223 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:11:52.647489 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.646817 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:11:52.647489 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.646830 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:11:52.647489 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.647012 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:52.647823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.647587 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:52.648645 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.648596 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-kube-api-access-j2gjm" (OuterVolumeSpecName: "kube-api-access-j2gjm") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "kube-api-access-j2gjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:11:52.649254 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.649208 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:52.649553 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.649306 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:52.649553 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.649421 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:52.649553 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.649529 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:52.651222 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.651175 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:11:52.651222 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.651197 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-config" (OuterVolumeSpecName: "config") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:52.651588 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.651532 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:52.651685 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.651641 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-config-out" (OuterVolumeSpecName: "config-out") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:11:52.662060 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.662037 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-web-config" (OuterVolumeSpecName: "web-config") pod "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" (UID: "00e5e2a1-1bbe-43a6-81b2-e3fcb176e299"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:11:52.745661 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745631 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745661 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745659 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745669 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745680 2555 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-grpc-tls\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745689 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745706 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745715 2555 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-config\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745722 2555 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-metrics-client-certs\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745732 2555 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-configmap-metrics-client-ca\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745741 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-db\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745749 2555 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745759 2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-web-config\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745766 2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-tls-assets\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745774 2555 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-kube-rbac-proxy\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745781 2555 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745789 2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-config-out\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745798 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2gjm\" (UniqueName: \"kubernetes.io/projected/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-kube-api-access-j2gjm\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745805 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.745835 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.745813 2555 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:11:52.945730 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.945698 2555 generic.go:356] "Generic (PLEG): container finished" podID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerID="2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1" exitCode=0 Sep 10 12:11:52.945730 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.945726 2555 generic.go:356] "Generic (PLEG): container finished" podID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerID="d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9" exitCode=0 Sep 10 12:11:52.945730 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.945733 2555 generic.go:356] "Generic (PLEG): container finished" podID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerID="339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c" exitCode=0 Sep 10 12:11:52.946273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.945740 2555 generic.go:356] "Generic (PLEG): container finished" podID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerID="bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71" exitCode=0 Sep 10 12:11:52.946273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.945746 2555 generic.go:356] "Generic (PLEG): container finished" podID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerID="0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2" exitCode=0 Sep 10 12:11:52.946273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.945751 2555 generic.go:356] "Generic (PLEG): container finished" podID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerID="489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba" exitCode=0 Sep 10 12:11:52.946273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.945778 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299","Type":"ContainerDied","Data":"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1"} Sep 10 12:11:52.946273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.945846 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299","Type":"ContainerDied","Data":"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9"} Sep 10 12:11:52.946273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.945786 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:52.946273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.945885 2555 scope.go:117] "RemoveContainer" containerID="2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1" Sep 10 12:11:52.946273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.945875 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299","Type":"ContainerDied","Data":"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c"} Sep 10 12:11:52.946273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.946018 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299","Type":"ContainerDied","Data":"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71"} Sep 10 12:11:52.946273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.946090 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299","Type":"ContainerDied","Data":"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2"} Sep 10 12:11:52.946273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.946136 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299","Type":"ContainerDied","Data":"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba"} Sep 10 12:11:52.946273 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.946176 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"00e5e2a1-1bbe-43a6-81b2-e3fcb176e299","Type":"ContainerDied","Data":"e0777140e13339943cd374570f2e78a621a7a7756807fe01f70b29878a973d22"} Sep 10 12:11:52.953996 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.953795 2555 scope.go:117] "RemoveContainer" containerID="d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9" Sep 10 12:11:52.960752 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.960737 2555 scope.go:117] "RemoveContainer" containerID="339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c" Sep 10 12:11:52.967368 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.967258 2555 scope.go:117] "RemoveContainer" containerID="bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71" Sep 10 12:11:52.970010 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.969989 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:11:52.973824 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.973805 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:11:52.974893 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.974872 2555 scope.go:117] "RemoveContainer" containerID="0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2" Sep 10 12:11:52.981510 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.981493 2555 scope.go:117] "RemoveContainer" containerID="489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba" Sep 10 12:11:52.988423 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.988405 2555 scope.go:117] "RemoveContainer" containerID="efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6" Sep 10 12:11:52.994934 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.994916 2555 scope.go:117] "RemoveContainer" containerID="2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1" Sep 10 12:11:52.995232 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:11:52.995210 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1\": container with ID starting with 2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1 not found: ID does not exist" containerID="2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1" Sep 10 12:11:52.995318 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.995237 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1"} err="failed to get container status \"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1\": rpc error: code = NotFound desc = could not find container \"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1\": container with ID starting with 2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1 not found: ID does not exist" Sep 10 12:11:52.995318 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.995256 2555 scope.go:117] "RemoveContainer" containerID="d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9" Sep 10 12:11:52.995497 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:11:52.995482 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9\": container with ID starting with d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9 not found: ID does not exist" containerID="d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9" Sep 10 12:11:52.995530 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.995513 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9"} err="failed to get container status \"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9\": rpc error: code = NotFound desc = could not find container \"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9\": container with ID starting with d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9 not found: ID does not exist" Sep 10 12:11:52.995563 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.995530 2555 scope.go:117] "RemoveContainer" containerID="339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c" Sep 10 12:11:52.995886 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:11:52.995846 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c\": container with ID starting with 339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c not found: ID does not exist" containerID="339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c" Sep 10 12:11:52.996011 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.995878 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c"} err="failed to get container status \"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c\": rpc error: code = NotFound desc = could not find container \"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c\": container with ID starting with 339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c not found: ID does not exist" Sep 10 12:11:52.996011 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.995901 2555 scope.go:117] "RemoveContainer" containerID="bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71" Sep 10 12:11:52.996258 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:11:52.996211 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71\": container with ID starting with bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71 not found: ID does not exist" containerID="bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71" Sep 10 12:11:52.996935 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.996241 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71"} err="failed to get container status \"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71\": rpc error: code = NotFound desc = could not find container \"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71\": container with ID starting with bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71 not found: ID does not exist" Sep 10 12:11:52.996935 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.996822 2555 scope.go:117] "RemoveContainer" containerID="0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2" Sep 10 12:11:52.997879 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:11:52.997854 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2\": container with ID starting with 0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2 not found: ID does not exist" containerID="0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2" Sep 10 12:11:52.997971 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.997893 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2"} err="failed to get container status \"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2\": rpc error: code = NotFound desc = could not find container \"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2\": container with ID starting with 0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2 not found: ID does not exist" Sep 10 12:11:52.997971 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.997916 2555 scope.go:117] "RemoveContainer" containerID="489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba" Sep 10 12:11:52.998435 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:11:52.998407 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba\": container with ID starting with 489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba not found: ID does not exist" containerID="489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba" Sep 10 12:11:52.998532 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.998456 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba"} err="failed to get container status \"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba\": rpc error: code = NotFound desc = could not find container \"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba\": container with ID starting with 489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba not found: ID does not exist" Sep 10 12:11:52.998532 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:52.998479 2555 scope.go:117] "RemoveContainer" containerID="efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6" Sep 10 12:11:53.002380 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:11:53.002349 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6\": container with ID starting with efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6 not found: ID does not exist" containerID="efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6" Sep 10 12:11:53.002480 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.002388 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6"} err="failed to get container status \"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6\": rpc error: code = NotFound desc = could not find container \"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6\": container with ID starting with efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6 not found: ID does not exist" Sep 10 12:11:53.002480 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.002411 2555 scope.go:117] "RemoveContainer" containerID="2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1" Sep 10 12:11:53.002792 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.002746 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1"} err="failed to get container status \"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1\": rpc error: code = NotFound desc = could not find container \"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1\": container with ID starting with 2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1 not found: ID does not exist" Sep 10 12:11:53.004817 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.004790 2555 scope.go:117] "RemoveContainer" containerID="d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9" Sep 10 12:11:53.005175 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.005147 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9"} err="failed to get container status \"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9\": rpc error: code = NotFound desc = could not find container \"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9\": container with ID starting with d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9 not found: ID does not exist" Sep 10 12:11:53.005282 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.005177 2555 scope.go:117] "RemoveContainer" containerID="339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c" Sep 10 12:11:53.005464 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.005443 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c"} err="failed to get container status \"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c\": rpc error: code = NotFound desc = could not find container \"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c\": container with ID starting with 339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c not found: ID does not exist" Sep 10 12:11:53.005529 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.005465 2555 scope.go:117] "RemoveContainer" containerID="bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71" Sep 10 12:11:53.005710 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.005683 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71"} err="failed to get container status \"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71\": rpc error: code = NotFound desc = could not find container \"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71\": container with ID starting with bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71 not found: ID does not exist" Sep 10 12:11:53.005767 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.005710 2555 scope.go:117] "RemoveContainer" containerID="0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2" Sep 10 12:11:53.005959 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.005933 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2"} err="failed to get container status \"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2\": rpc error: code = NotFound desc = could not find container \"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2\": container with ID starting with 0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2 not found: ID does not exist" Sep 10 12:11:53.006016 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.005961 2555 scope.go:117] "RemoveContainer" containerID="489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba" Sep 10 12:11:53.006210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006191 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba"} err="failed to get container status \"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba\": rpc error: code = NotFound desc = could not find container \"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba\": container with ID starting with 489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba not found: ID does not exist" Sep 10 12:11:53.006263 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006210 2555 scope.go:117] "RemoveContainer" containerID="efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6" Sep 10 12:11:53.006433 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006418 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6"} err="failed to get container status \"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6\": rpc error: code = NotFound desc = could not find container \"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6\": container with ID starting with efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6 not found: ID does not exist" Sep 10 12:11:53.006474 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006434 2555 scope.go:117] "RemoveContainer" containerID="2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1" Sep 10 12:11:53.006582 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006564 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:11:53.006679 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006661 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1"} err="failed to get container status \"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1\": rpc error: code = NotFound desc = could not find container \"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1\": container with ID starting with 2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1 not found: ID does not exist" Sep 10 12:11:53.006713 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006681 2555 scope.go:117] "RemoveContainer" containerID="d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9" Sep 10 12:11:53.006915 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006898 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9"} err="failed to get container status \"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9\": rpc error: code = NotFound desc = could not find container \"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9\": container with ID starting with d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9 not found: ID does not exist" Sep 10 12:11:53.006952 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006915 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="thanos-sidecar" Sep 10 12:11:53.006952 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006933 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="thanos-sidecar" Sep 10 12:11:53.006952 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006948 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="kube-rbac-proxy-web" Sep 10 12:11:53.007038 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006954 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="kube-rbac-proxy-web" Sep 10 12:11:53.007038 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006962 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="init-config-reloader" Sep 10 12:11:53.007038 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006967 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="init-config-reloader" Sep 10 12:11:53.007038 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006976 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="config-reloader" Sep 10 12:11:53.007038 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006980 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="config-reloader" Sep 10 12:11:53.007038 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006987 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="kube-rbac-proxy" Sep 10 12:11:53.007038 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006992 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="kube-rbac-proxy" Sep 10 12:11:53.007038 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.007000 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="kube-rbac-proxy-thanos" Sep 10 12:11:53.007038 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.007005 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="kube-rbac-proxy-thanos" Sep 10 12:11:53.007038 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.007016 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="prometheus" Sep 10 12:11:53.007038 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.007021 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="prometheus" Sep 10 12:11:53.007507 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.006916 2555 scope.go:117] "RemoveContainer" containerID="339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c" Sep 10 12:11:53.007507 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.007078 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="thanos-sidecar" Sep 10 12:11:53.007507 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.007090 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="kube-rbac-proxy-thanos" Sep 10 12:11:53.007507 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.007097 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="kube-rbac-proxy" Sep 10 12:11:53.007507 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.007103 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="prometheus" Sep 10 12:11:53.007507 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.007111 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="config-reloader" Sep 10 12:11:53.007507 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.007117 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" containerName="kube-rbac-proxy-web" Sep 10 12:11:53.007507 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.007274 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c"} err="failed to get container status \"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c\": rpc error: code = NotFound desc = could not find container \"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c\": container with ID starting with 339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c not found: ID does not exist" Sep 10 12:11:53.007507 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.007290 2555 scope.go:117] "RemoveContainer" containerID="bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71" Sep 10 12:11:53.007809 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.007545 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71"} err="failed to get container status \"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71\": rpc error: code = NotFound desc = could not find container \"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71\": container with ID starting with bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71 not found: ID does not exist" Sep 10 12:11:53.007809 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.007564 2555 scope.go:117] "RemoveContainer" containerID="0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2" Sep 10 12:11:53.007873 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.007830 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2"} err="failed to get container status \"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2\": rpc error: code = NotFound desc = could not find container \"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2\": container with ID starting with 0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2 not found: ID does not exist" Sep 10 12:11:53.007873 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.007857 2555 scope.go:117] "RemoveContainer" containerID="489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba" Sep 10 12:11:53.008164 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.008145 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba"} err="failed to get container status \"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba\": rpc error: code = NotFound desc = could not find container \"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba\": container with ID starting with 489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba not found: ID does not exist" Sep 10 12:11:53.008245 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.008166 2555 scope.go:117] "RemoveContainer" containerID="efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6" Sep 10 12:11:53.008394 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.008377 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6"} err="failed to get container status \"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6\": rpc error: code = NotFound desc = could not find container \"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6\": container with ID starting with efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6 not found: ID does not exist" Sep 10 12:11:53.008437 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.008394 2555 scope.go:117] "RemoveContainer" containerID="2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1" Sep 10 12:11:53.008662 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.008639 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1"} err="failed to get container status \"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1\": rpc error: code = NotFound desc = could not find container \"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1\": container with ID starting with 2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1 not found: ID does not exist" Sep 10 12:11:53.008763 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.008664 2555 scope.go:117] "RemoveContainer" containerID="d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9" Sep 10 12:11:53.008995 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.008953 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9"} err="failed to get container status \"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9\": rpc error: code = NotFound desc = could not find container \"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9\": container with ID starting with d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9 not found: ID does not exist" Sep 10 12:11:53.009060 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.008998 2555 scope.go:117] "RemoveContainer" containerID="339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c" Sep 10 12:11:53.009314 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.009297 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c"} err="failed to get container status \"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c\": rpc error: code = NotFound desc = could not find container \"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c\": container with ID starting with 339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c not found: ID does not exist" Sep 10 12:11:53.009387 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.009316 2555 scope.go:117] "RemoveContainer" containerID="bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71" Sep 10 12:11:53.009592 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.009575 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71"} err="failed to get container status \"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71\": rpc error: code = NotFound desc = could not find container \"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71\": container with ID starting with bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71 not found: ID does not exist" Sep 10 12:11:53.009659 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.009593 2555 scope.go:117] "RemoveContainer" containerID="0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2" Sep 10 12:11:53.009823 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.009806 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2"} err="failed to get container status \"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2\": rpc error: code = NotFound desc = could not find container \"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2\": container with ID starting with 0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2 not found: ID does not exist" Sep 10 12:11:53.009897 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.009824 2555 scope.go:117] "RemoveContainer" containerID="489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba" Sep 10 12:11:53.010063 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.010047 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba"} err="failed to get container status \"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba\": rpc error: code = NotFound desc = could not find container \"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba\": container with ID starting with 489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba not found: ID does not exist" Sep 10 12:11:53.010142 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.010080 2555 scope.go:117] "RemoveContainer" containerID="efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6" Sep 10 12:11:53.010272 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.010256 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6"} err="failed to get container status \"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6\": rpc error: code = NotFound desc = could not find container \"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6\": container with ID starting with efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6 not found: ID does not exist" Sep 10 12:11:53.010344 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.010273 2555 scope.go:117] "RemoveContainer" containerID="2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1" Sep 10 12:11:53.010461 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.010444 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1"} err="failed to get container status \"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1\": rpc error: code = NotFound desc = could not find container \"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1\": container with ID starting with 2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1 not found: ID does not exist" Sep 10 12:11:53.010531 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.010462 2555 scope.go:117] "RemoveContainer" containerID="d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9" Sep 10 12:11:53.010707 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.010690 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9"} err="failed to get container status \"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9\": rpc error: code = NotFound desc = could not find container \"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9\": container with ID starting with d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9 not found: ID does not exist" Sep 10 12:11:53.010761 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.010708 2555 scope.go:117] "RemoveContainer" containerID="339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c" Sep 10 12:11:53.010962 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.010938 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c"} err="failed to get container status \"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c\": rpc error: code = NotFound desc = could not find container \"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c\": container with ID starting with 339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c not found: ID does not exist" Sep 10 12:11:53.011009 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.010965 2555 scope.go:117] "RemoveContainer" containerID="bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71" Sep 10 12:11:53.011104 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.011090 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.011251 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.011227 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71"} err="failed to get container status \"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71\": rpc error: code = NotFound desc = could not find container \"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71\": container with ID starting with bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71 not found: ID does not exist" Sep 10 12:11:53.011318 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.011252 2555 scope.go:117] "RemoveContainer" containerID="0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2" Sep 10 12:11:53.011545 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.011484 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2"} err="failed to get container status \"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2\": rpc error: code = NotFound desc = could not find container \"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2\": container with ID starting with 0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2 not found: ID does not exist" Sep 10 12:11:53.011545 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.011508 2555 scope.go:117] "RemoveContainer" containerID="489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba" Sep 10 12:11:53.011837 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.011810 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba"} err="failed to get container status \"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba\": rpc error: code = NotFound desc = could not find container \"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba\": container with ID starting with 489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba not found: ID does not exist" Sep 10 12:11:53.011883 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.011840 2555 scope.go:117] "RemoveContainer" containerID="efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6" Sep 10 12:11:53.012100 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.012081 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6"} err="failed to get container status \"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6\": rpc error: code = NotFound desc = could not find container \"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6\": container with ID starting with efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6 not found: ID does not exist" Sep 10 12:11:53.012100 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.012100 2555 scope.go:117] "RemoveContainer" containerID="2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1" Sep 10 12:11:53.012338 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.012312 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1"} err="failed to get container status \"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1\": rpc error: code = NotFound desc = could not find container \"2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1\": container with ID starting with 2c22f6cda897f5282e7ed80fed9dd7da7555e35ed5b6c095b5f1ba87ee7567d1 not found: ID does not exist" Sep 10 12:11:53.012338 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.012335 2555 scope.go:117] "RemoveContainer" containerID="d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9" Sep 10 12:11:53.012584 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.012567 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9"} err="failed to get container status \"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9\": rpc error: code = NotFound desc = could not find container \"d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9\": container with ID starting with d1e86469b34d05d79eda59d3792c58c509e4a656f06cbdfa6a087066faf1bfe9 not found: ID does not exist" Sep 10 12:11:53.012657 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.012586 2555 scope.go:117] "RemoveContainer" containerID="339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c" Sep 10 12:11:53.012860 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.012839 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c"} err="failed to get container status \"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c\": rpc error: code = NotFound desc = could not find container \"339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c\": container with ID starting with 339d84ee67f4ccad43380fa2ab0576cb2ab7b0e6ffc52de83ccd834c6c2b768c not found: ID does not exist" Sep 10 12:11:53.012901 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.012862 2555 scope.go:117] "RemoveContainer" containerID="bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71" Sep 10 12:11:53.013159 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.013141 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71"} err="failed to get container status \"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71\": rpc error: code = NotFound desc = could not find container \"bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71\": container with ID starting with bbeaecfdbf22c8dc92f657ba15d696a24e7ee16bd9afc195d99d5666a23ecb71 not found: ID does not exist" Sep 10 12:11:53.013236 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.013160 2555 scope.go:117] "RemoveContainer" containerID="0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2" Sep 10 12:11:53.013415 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.013387 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2"} err="failed to get container status \"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2\": rpc error: code = NotFound desc = could not find container \"0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2\": container with ID starting with 0b96949809678ebabc55b94d9a170b684382d44dc8868de3d41959c4784a41f2 not found: ID does not exist" Sep 10 12:11:53.013415 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.013415 2555 scope.go:117] "RemoveContainer" containerID="489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba" Sep 10 12:11:53.013551 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.013517 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 12:11:53.013551 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.013524 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 12:11:53.013718 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.013686 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba"} err="failed to get container status \"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba\": rpc error: code = NotFound desc = could not find container \"489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba\": container with ID starting with 489e30b42bd7fc8c9a99934ce96489de493025fddb2d993ce42d8bacf3dd05ba not found: ID does not exist" Sep 10 12:11:53.013718 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.013718 2555 scope.go:117] "RemoveContainer" containerID="efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6" Sep 10 12:11:53.013870 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.013783 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 12:11:53.013870 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.013791 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ci8o7g7j0cbs6\"" Sep 10 12:11:53.013870 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.013797 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 12:11:53.014016 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.013992 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6"} err="failed to get container status \"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6\": rpc error: code = NotFound desc = could not find container \"efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6\": container with ID starting with efed0612448e74260baa8cf277d0be3b008d0e7847b06ccde850e0fd56c131f6 not found: ID does not exist" Sep 10 12:11:53.014365 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.014350 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 12:11:53.014444 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.014400 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 12:11:53.014621 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.014607 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 12:11:53.014826 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.014811 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 12:11:53.015098 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.014919 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6f2p4\"" Sep 10 12:11:53.015098 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.014968 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 12:11:53.015098 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.014979 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 12:11:53.015098 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.014985 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 12:11:53.015098 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.015059 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 12:11:53.016427 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.016404 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 12:11:53.020164 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.020140 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:11:53.020611 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.020595 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 12:11:53.048528 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.048503 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqtrq\" (UniqueName: \"kubernetes.io/projected/7ef9bb62-c342-4a47-b70c-3979dcfe97da-kube-api-access-fqtrq\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.048650 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.048533 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.048650 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.048626 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.048765 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.048657 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.048765 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.048683 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.048877 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.048771 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ef9bb62-c342-4a47-b70c-3979dcfe97da-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.048877 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.048844 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.048877 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.048867 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.049028 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.048904 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.049028 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.048936 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ef9bb62-c342-4a47-b70c-3979dcfe97da-config-out\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.049028 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.048957 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.049028 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.049001 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.049237 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.049127 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.049237 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.049148 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.049237 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.049208 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.049237 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.049232 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-config\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.049377 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.049331 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.049377 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.049366 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.049468 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.049436 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7ef9bb62-c342-4a47-b70c-3979dcfe97da-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.049522 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.049475 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-web-config\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.112769 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.112743 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00e5e2a1-1bbe-43a6-81b2-e3fcb176e299" path="/var/lib/kubelet/pods/00e5e2a1-1bbe-43a6-81b2-e3fcb176e299/volumes" Sep 10 12:11:53.150191 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150164 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqtrq\" (UniqueName: \"kubernetes.io/projected/7ef9bb62-c342-4a47-b70c-3979dcfe97da-kube-api-access-fqtrq\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.150318 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150202 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.150318 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150245 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.150318 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150269 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.150318 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150293 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.150505 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150438 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ef9bb62-c342-4a47-b70c-3979dcfe97da-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.150505 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150485 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.150606 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150505 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.150606 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150530 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.150606 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150564 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ef9bb62-c342-4a47-b70c-3979dcfe97da-config-out\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.150606 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150590 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.150798 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150626 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.150798 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150660 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.150798 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150688 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.150798 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150723 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.150798 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150755 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-config\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.150798 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150781 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.151099 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150807 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.151099 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150839 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7ef9bb62-c342-4a47-b70c-3979dcfe97da-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.151099 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150872 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-web-config\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.151099 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.150923 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.151844 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.151459 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.154164 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.152424 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7ef9bb62-c342-4a47-b70c-3979dcfe97da-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.154164 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.152436 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.154164 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.152739 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.154164 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.153046 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.154164 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.153385 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.154164 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.153462 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.154164 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.153716 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ef9bb62-c342-4a47-b70c-3979dcfe97da-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.154164 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.153984 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.154164 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.154118 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.155223 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.155165 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.155315 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.155227 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7ef9bb62-c342-4a47-b70c-3979dcfe97da-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.155315 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.155273 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-web-config\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.155391 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.155358 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.155665 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.155644 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.155697 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.155662 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.156374 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.156358 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ef9bb62-c342-4a47-b70c-3979dcfe97da-config-out\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.156610 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.156596 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7ef9bb62-c342-4a47-b70c-3979dcfe97da-config\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.158011 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.157995 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqtrq\" (UniqueName: \"kubernetes.io/projected/7ef9bb62-c342-4a47-b70c-3979dcfe97da-kube-api-access-fqtrq\") pod \"prometheus-k8s-0\" (UID: \"7ef9bb62-c342-4a47-b70c-3979dcfe97da\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.322716 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.322633 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:11:53.600838 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.600812 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:11:53.602713 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:11:53.602686 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef9bb62_c342_4a47_b70c_3979dcfe97da.slice/crio-907231cca923988499b663b14756f05e39a0113991794aefb323e1c505537dec WatchSource:0}: Error finding container 907231cca923988499b663b14756f05e39a0113991794aefb323e1c505537dec: Status 404 returned error can't find the container with id 907231cca923988499b663b14756f05e39a0113991794aefb323e1c505537dec Sep 10 12:11:53.953556 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.953520 2555 generic.go:356] "Generic (PLEG): container finished" podID="7ef9bb62-c342-4a47-b70c-3979dcfe97da" containerID="e6e24ab8a87953851faa8ec938b68d1073af41d47e69cea5ae08ffe32e542654" exitCode=0 Sep 10 12:11:53.953896 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.953588 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ef9bb62-c342-4a47-b70c-3979dcfe97da","Type":"ContainerDied","Data":"e6e24ab8a87953851faa8ec938b68d1073af41d47e69cea5ae08ffe32e542654"} Sep 10 12:11:53.953896 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:53.953642 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ef9bb62-c342-4a47-b70c-3979dcfe97da","Type":"ContainerStarted","Data":"907231cca923988499b663b14756f05e39a0113991794aefb323e1c505537dec"} Sep 10 12:11:54.961116 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:54.961060 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ef9bb62-c342-4a47-b70c-3979dcfe97da","Type":"ContainerStarted","Data":"6bf65492fb5e142924edd6db57baf79775a368e3ebb8ba6f7362a45b53eca2aa"} Sep 10 12:11:54.961456 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:54.961177 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ef9bb62-c342-4a47-b70c-3979dcfe97da","Type":"ContainerStarted","Data":"a038b2bb65c81b1f6742d44f4158f74f55f09a8f6ef7ab78750338ff077e5fd3"} Sep 10 12:11:54.961456 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:54.961210 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ef9bb62-c342-4a47-b70c-3979dcfe97da","Type":"ContainerStarted","Data":"b3da0b1d29cde760a309c31c41629c84c0ac73be797bea32cc8deaa86315d8b8"} Sep 10 12:11:54.961456 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:54.961236 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ef9bb62-c342-4a47-b70c-3979dcfe97da","Type":"ContainerStarted","Data":"88b222eeff7e110a58d324be072ce954812c6e6f935bae14ccad6aeea956937b"} Sep 10 12:11:54.961456 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:54.961265 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ef9bb62-c342-4a47-b70c-3979dcfe97da","Type":"ContainerStarted","Data":"c9955f183b72372f1912cc9b8a135bbd01d59639631993442ae60cc4d822e3e0"} Sep 10 12:11:54.961456 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:54.961291 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ef9bb62-c342-4a47-b70c-3979dcfe97da","Type":"ContainerStarted","Data":"ddcf5641e1152354d365e56dc643a9f583beea00a6bd32865960ed28901ca092"} Sep 10 12:11:54.989478 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:54.989423 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.971691776 podStartE2EDuration="2.989408955s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.717179ms" isStatefulPod=false podCreationTimestamp="2026-09-10 12:11:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:11:54.988026307 +0000 UTC m=+148.427914573" watchObservedRunningTime="2026-09-10 12:11:54.989408955 +0000 UTC m=+148.429297187" Sep 10 12:11:58.323163 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:11:58.323121 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:12:00.436268 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:00.436229 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:12:00.436700 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:00.436286 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:12:00.440731 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:00.440711 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:12:00.992814 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:00.992788 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:12:01.038908 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:01.038881 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7df8dd95c9-xzzzj"] Sep 10 12:12:26.058678 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.058593 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7df8dd95c9-xzzzj" podUID="271b3f95-0c1b-465c-bc09-05b7ca436c67" containerName="console" containerID="cri-o://ab536f850bedc2d3af746d993f9acbda55d5111455f15d385a70b2686863538a" gracePeriod=15 Sep 10 12:12:26.289318 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.289295 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:12:26.425664 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.425601 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5vj2\" (UniqueName: \"kubernetes.io/projected/271b3f95-0c1b-465c-bc09-05b7ca436c67-kube-api-access-p5vj2\") pod \"271b3f95-0c1b-465c-bc09-05b7ca436c67\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " Sep 10 12:12:26.425807 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.425671 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-config\") pod \"271b3f95-0c1b-465c-bc09-05b7ca436c67\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " Sep 10 12:12:26.425807 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.425696 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-service-ca\") pod \"271b3f95-0c1b-465c-bc09-05b7ca436c67\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " Sep 10 12:12:26.425807 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.425737 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-trusted-ca-bundle\") pod \"271b3f95-0c1b-465c-bc09-05b7ca436c67\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " Sep 10 12:12:26.425807 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.425770 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-serving-cert\") pod \"271b3f95-0c1b-465c-bc09-05b7ca436c67\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " Sep 10 12:12:26.426012 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.425818 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-oauth-config\") pod \"271b3f95-0c1b-465c-bc09-05b7ca436c67\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " Sep 10 12:12:26.426012 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.425842 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-oauth-serving-cert\") pod \"271b3f95-0c1b-465c-bc09-05b7ca436c67\" (UID: \"271b3f95-0c1b-465c-bc09-05b7ca436c67\") " Sep 10 12:12:26.426196 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.426158 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-config" (OuterVolumeSpecName: "console-config") pod "271b3f95-0c1b-465c-bc09-05b7ca436c67" (UID: "271b3f95-0c1b-465c-bc09-05b7ca436c67"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:12:26.426330 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.426191 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "271b3f95-0c1b-465c-bc09-05b7ca436c67" (UID: "271b3f95-0c1b-465c-bc09-05b7ca436c67"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:12:26.426444 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.426379 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "271b3f95-0c1b-465c-bc09-05b7ca436c67" (UID: "271b3f95-0c1b-465c-bc09-05b7ca436c67"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:12:26.426507 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.426448 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-service-ca" (OuterVolumeSpecName: "service-ca") pod "271b3f95-0c1b-465c-bc09-05b7ca436c67" (UID: "271b3f95-0c1b-465c-bc09-05b7ca436c67"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:12:26.427821 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.427789 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/271b3f95-0c1b-465c-bc09-05b7ca436c67-kube-api-access-p5vj2" (OuterVolumeSpecName: "kube-api-access-p5vj2") pod "271b3f95-0c1b-465c-bc09-05b7ca436c67" (UID: "271b3f95-0c1b-465c-bc09-05b7ca436c67"). InnerVolumeSpecName "kube-api-access-p5vj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:12:26.428291 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.428270 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "271b3f95-0c1b-465c-bc09-05b7ca436c67" (UID: "271b3f95-0c1b-465c-bc09-05b7ca436c67"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:12:26.428359 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.428287 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "271b3f95-0c1b-465c-bc09-05b7ca436c67" (UID: "271b3f95-0c1b-465c-bc09-05b7ca436c67"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:12:26.526828 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.526802 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5vj2\" (UniqueName: \"kubernetes.io/projected/271b3f95-0c1b-465c-bc09-05b7ca436c67-kube-api-access-p5vj2\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:12:26.526828 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.526827 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-config\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:12:26.526965 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.526842 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-service-ca\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:12:26.526965 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.526854 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-trusted-ca-bundle\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:12:26.526965 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.526867 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-serving-cert\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:12:26.526965 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.526879 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/271b3f95-0c1b-465c-bc09-05b7ca436c67-console-oauth-config\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:12:26.526965 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:26.526891 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/271b3f95-0c1b-465c-bc09-05b7ca436c67-oauth-serving-cert\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:12:27.096793 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:27.096763 2555 generic.go:356] "Generic (PLEG): container finished" podID="271b3f95-0c1b-465c-bc09-05b7ca436c67" containerID="ab536f850bedc2d3af746d993f9acbda55d5111455f15d385a70b2686863538a" exitCode=0 Sep 10 12:12:27.097098 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:27.096813 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7df8dd95c9-xzzzj" Sep 10 12:12:27.097098 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:27.096848 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7df8dd95c9-xzzzj" event={"ID":"271b3f95-0c1b-465c-bc09-05b7ca436c67","Type":"ContainerDied","Data":"ab536f850bedc2d3af746d993f9acbda55d5111455f15d385a70b2686863538a"} Sep 10 12:12:27.097098 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:27.096916 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7df8dd95c9-xzzzj" event={"ID":"271b3f95-0c1b-465c-bc09-05b7ca436c67","Type":"ContainerDied","Data":"ba71cdf5ae1015d96cf33945baff45c43d82c01f72003c49512433b780b13b1c"} Sep 10 12:12:27.097098 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:27.096937 2555 scope.go:117] "RemoveContainer" containerID="ab536f850bedc2d3af746d993f9acbda55d5111455f15d385a70b2686863538a" Sep 10 12:12:27.105444 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:27.105425 2555 scope.go:117] "RemoveContainer" containerID="ab536f850bedc2d3af746d993f9acbda55d5111455f15d385a70b2686863538a" Sep 10 12:12:27.105717 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:12:27.105692 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab536f850bedc2d3af746d993f9acbda55d5111455f15d385a70b2686863538a\": container with ID starting with ab536f850bedc2d3af746d993f9acbda55d5111455f15d385a70b2686863538a not found: ID does not exist" containerID="ab536f850bedc2d3af746d993f9acbda55d5111455f15d385a70b2686863538a" Sep 10 12:12:27.105779 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:27.105721 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab536f850bedc2d3af746d993f9acbda55d5111455f15d385a70b2686863538a"} err="failed to get container status \"ab536f850bedc2d3af746d993f9acbda55d5111455f15d385a70b2686863538a\": rpc error: code = NotFound desc = could not find container \"ab536f850bedc2d3af746d993f9acbda55d5111455f15d385a70b2686863538a\": container with ID starting with ab536f850bedc2d3af746d993f9acbda55d5111455f15d385a70b2686863538a not found: ID does not exist" Sep 10 12:12:27.116586 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:27.116567 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7df8dd95c9-xzzzj"] Sep 10 12:12:27.120294 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:27.120275 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7df8dd95c9-xzzzj"] Sep 10 12:12:29.113168 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:29.113137 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="271b3f95-0c1b-465c-bc09-05b7ca436c67" path="/var/lib/kubelet/pods/271b3f95-0c1b-465c-bc09-05b7ca436c67/volumes" Sep 10 12:12:53.323741 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:53.323708 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:12:53.338974 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:53.338951 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:12:54.229491 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:12:54.229465 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:13:28.977444 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:28.977411 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mp4f9"] Sep 10 12:13:28.977845 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:28.977765 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="271b3f95-0c1b-465c-bc09-05b7ca436c67" containerName="console" Sep 10 12:13:28.977845 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:28.977777 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="271b3f95-0c1b-465c-bc09-05b7ca436c67" containerName="console" Sep 10 12:13:28.977845 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:28.977839 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="271b3f95-0c1b-465c-bc09-05b7ca436c67" containerName="console" Sep 10 12:13:28.981145 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:28.981130 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mp4f9" Sep 10 12:13:28.983366 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:28.983341 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 10 12:13:28.983883 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:28.983864 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vcvn5\"" Sep 10 12:13:28.983982 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:28.983865 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 10 12:13:28.989530 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:28.989511 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mp4f9"] Sep 10 12:13:29.129157 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:29.129130 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34693ebc-833c-42b1-a523-8e0ad70abcd8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mp4f9\" (UID: \"34693ebc-833c-42b1-a523-8e0ad70abcd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mp4f9" Sep 10 12:13:29.129296 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:29.129188 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btmjc\" (UniqueName: \"kubernetes.io/projected/34693ebc-833c-42b1-a523-8e0ad70abcd8-kube-api-access-btmjc\") pod \"cert-manager-cainjector-559cdd8c87-mp4f9\" (UID: \"34693ebc-833c-42b1-a523-8e0ad70abcd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mp4f9" Sep 10 12:13:29.230505 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:29.230445 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34693ebc-833c-42b1-a523-8e0ad70abcd8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mp4f9\" (UID: \"34693ebc-833c-42b1-a523-8e0ad70abcd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mp4f9" Sep 10 12:13:29.230505 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:29.230494 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btmjc\" (UniqueName: \"kubernetes.io/projected/34693ebc-833c-42b1-a523-8e0ad70abcd8-kube-api-access-btmjc\") pod \"cert-manager-cainjector-559cdd8c87-mp4f9\" (UID: \"34693ebc-833c-42b1-a523-8e0ad70abcd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mp4f9" Sep 10 12:13:29.241963 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:29.241938 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34693ebc-833c-42b1-a523-8e0ad70abcd8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mp4f9\" (UID: \"34693ebc-833c-42b1-a523-8e0ad70abcd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mp4f9" Sep 10 12:13:29.242177 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:29.242156 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btmjc\" (UniqueName: \"kubernetes.io/projected/34693ebc-833c-42b1-a523-8e0ad70abcd8-kube-api-access-btmjc\") pod \"cert-manager-cainjector-559cdd8c87-mp4f9\" (UID: \"34693ebc-833c-42b1-a523-8e0ad70abcd8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mp4f9" Sep 10 12:13:29.304895 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:29.304872 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mp4f9" Sep 10 12:13:29.572597 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:29.572530 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mp4f9"] Sep 10 12:13:29.575479 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:13:29.575451 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34693ebc_833c_42b1_a523_8e0ad70abcd8.slice/crio-9ec8799470164d1a01c3e328eeb8ddb5381e5e899c7c6cb19598784c529ed92f WatchSource:0}: Error finding container 9ec8799470164d1a01c3e328eeb8ddb5381e5e899c7c6cb19598784c529ed92f: Status 404 returned error can't find the container with id 9ec8799470164d1a01c3e328eeb8ddb5381e5e899c7c6cb19598784c529ed92f Sep 10 12:13:30.354306 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:30.354269 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mp4f9" event={"ID":"34693ebc-833c-42b1-a523-8e0ad70abcd8","Type":"ContainerStarted","Data":"9ec8799470164d1a01c3e328eeb8ddb5381e5e899c7c6cb19598784c529ed92f"} Sep 10 12:13:33.370966 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:33.370868 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mp4f9" event={"ID":"34693ebc-833c-42b1-a523-8e0ad70abcd8","Type":"ContainerStarted","Data":"05b4ab68348c1c7a91ded973c049bfb2599c7eaa89462b52d6e0ae9a70a840e1"} Sep 10 12:13:33.386492 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:33.386445 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mp4f9" podStartSLOduration=1.897412483 podStartE2EDuration="5.386432384s" totalImagesPullingTime="3.489019901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:13:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:13:33.384909767 +0000 UTC m=+246.824798005" watchObservedRunningTime="2026-09-10 12:13:33.386432384 +0000 UTC m=+246.826320616" Sep 10 12:13:50.852574 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:50.852495 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5qd"] Sep 10 12:13:50.855571 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:50.855553 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5qd" Sep 10 12:13:50.857579 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:50.857561 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 12:13:50.857689 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:50.857582 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:13:50.857689 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:50.857564 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-752sx\"" Sep 10 12:13:50.863316 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:50.863295 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5qd"] Sep 10 12:13:50.916990 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:50.916963 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4jt7\" (UniqueName: \"kubernetes.io/projected/b2823f9f-400d-4ee0-99a4-efdf71db282e-kube-api-access-s4jt7\") pod \"openshift-lws-operator-fd8ccff4c-tj5qd\" (UID: \"b2823f9f-400d-4ee0-99a4-efdf71db282e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5qd" Sep 10 12:13:50.917134 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:50.917030 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2823f9f-400d-4ee0-99a4-efdf71db282e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tj5qd\" (UID: \"b2823f9f-400d-4ee0-99a4-efdf71db282e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5qd" Sep 10 12:13:51.017821 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:51.017780 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2823f9f-400d-4ee0-99a4-efdf71db282e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tj5qd\" (UID: \"b2823f9f-400d-4ee0-99a4-efdf71db282e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5qd" Sep 10 12:13:51.017979 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:51.017840 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4jt7\" (UniqueName: \"kubernetes.io/projected/b2823f9f-400d-4ee0-99a4-efdf71db282e-kube-api-access-s4jt7\") pod \"openshift-lws-operator-fd8ccff4c-tj5qd\" (UID: \"b2823f9f-400d-4ee0-99a4-efdf71db282e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5qd" Sep 10 12:13:51.018230 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:51.018210 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2823f9f-400d-4ee0-99a4-efdf71db282e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tj5qd\" (UID: \"b2823f9f-400d-4ee0-99a4-efdf71db282e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5qd" Sep 10 12:13:51.025530 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:51.025499 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4jt7\" (UniqueName: \"kubernetes.io/projected/b2823f9f-400d-4ee0-99a4-efdf71db282e-kube-api-access-s4jt7\") pod \"openshift-lws-operator-fd8ccff4c-tj5qd\" (UID: \"b2823f9f-400d-4ee0-99a4-efdf71db282e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5qd" Sep 10 12:13:51.165234 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:51.165157 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5qd" Sep 10 12:13:51.434416 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:51.434387 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5qd"] Sep 10 12:13:51.436967 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:13:51.436935 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2823f9f_400d_4ee0_99a4_efdf71db282e.slice/crio-499443f217d25a69f6d4574ab8bf7cdc8b2323e92b19e8911e75cfb59a233aff WatchSource:0}: Error finding container 499443f217d25a69f6d4574ab8bf7cdc8b2323e92b19e8911e75cfb59a233aff: Status 404 returned error can't find the container with id 499443f217d25a69f6d4574ab8bf7cdc8b2323e92b19e8911e75cfb59a233aff Sep 10 12:13:51.447221 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:51.447192 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5qd" event={"ID":"b2823f9f-400d-4ee0-99a4-efdf71db282e","Type":"ContainerStarted","Data":"499443f217d25a69f6d4574ab8bf7cdc8b2323e92b19e8911e75cfb59a233aff"} Sep 10 12:13:54.465954 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:54.465910 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5qd" event={"ID":"b2823f9f-400d-4ee0-99a4-efdf71db282e","Type":"ContainerStarted","Data":"d46c893ad16d74e47bc023c10a933dc7d7957d02548a24a686971b7634c347ae"} Sep 10 12:13:54.488114 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:13:54.488040 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tj5qd" podStartSLOduration=2.223163125 podStartE2EDuration="4.488022153s" totalImagesPullingTime="2.264859028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:13:54.48655781 +0000 UTC m=+267.926446068" watchObservedRunningTime="2026-09-10 12:13:54.488022153 +0000 UTC m=+267.927910384" Sep 10 12:14:01.715770 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.715729 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d"] Sep 10 12:14:01.719320 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.719299 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" Sep 10 12:14:01.722296 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.722275 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 12:14:01.722413 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.722275 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 12:14:01.722413 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.722348 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 12:14:01.722413 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.722349 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-csnmf\"" Sep 10 12:14:01.730465 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.730446 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d"] Sep 10 12:14:01.814870 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.814835 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1375e625-ec7b-4f36-92ef-91e33e64a40e-metrics-cert\") pod \"lws-controller-manager-86cfb8b7dd-2nt8d\" (UID: \"1375e625-ec7b-4f36-92ef-91e33e64a40e\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" Sep 10 12:14:01.815047 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.814876 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkt2k\" (UniqueName: \"kubernetes.io/projected/1375e625-ec7b-4f36-92ef-91e33e64a40e-kube-api-access-fkt2k\") pod \"lws-controller-manager-86cfb8b7dd-2nt8d\" (UID: \"1375e625-ec7b-4f36-92ef-91e33e64a40e\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" Sep 10 12:14:01.815047 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.814985 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1375e625-ec7b-4f36-92ef-91e33e64a40e-cert\") pod \"lws-controller-manager-86cfb8b7dd-2nt8d\" (UID: \"1375e625-ec7b-4f36-92ef-91e33e64a40e\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" Sep 10 12:14:01.815047 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.815023 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1375e625-ec7b-4f36-92ef-91e33e64a40e-manager-config\") pod \"lws-controller-manager-86cfb8b7dd-2nt8d\" (UID: \"1375e625-ec7b-4f36-92ef-91e33e64a40e\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" Sep 10 12:14:01.915969 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.915933 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1375e625-ec7b-4f36-92ef-91e33e64a40e-metrics-cert\") pod \"lws-controller-manager-86cfb8b7dd-2nt8d\" (UID: \"1375e625-ec7b-4f36-92ef-91e33e64a40e\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" Sep 10 12:14:01.915969 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.915974 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkt2k\" (UniqueName: \"kubernetes.io/projected/1375e625-ec7b-4f36-92ef-91e33e64a40e-kube-api-access-fkt2k\") pod \"lws-controller-manager-86cfb8b7dd-2nt8d\" (UID: \"1375e625-ec7b-4f36-92ef-91e33e64a40e\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" Sep 10 12:14:01.916212 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.916016 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1375e625-ec7b-4f36-92ef-91e33e64a40e-cert\") pod \"lws-controller-manager-86cfb8b7dd-2nt8d\" (UID: \"1375e625-ec7b-4f36-92ef-91e33e64a40e\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" Sep 10 12:14:01.916212 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.916038 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1375e625-ec7b-4f36-92ef-91e33e64a40e-manager-config\") pod \"lws-controller-manager-86cfb8b7dd-2nt8d\" (UID: \"1375e625-ec7b-4f36-92ef-91e33e64a40e\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" Sep 10 12:14:01.916764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.916734 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1375e625-ec7b-4f36-92ef-91e33e64a40e-manager-config\") pod \"lws-controller-manager-86cfb8b7dd-2nt8d\" (UID: \"1375e625-ec7b-4f36-92ef-91e33e64a40e\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" Sep 10 12:14:01.918497 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.918475 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1375e625-ec7b-4f36-92ef-91e33e64a40e-cert\") pod \"lws-controller-manager-86cfb8b7dd-2nt8d\" (UID: \"1375e625-ec7b-4f36-92ef-91e33e64a40e\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" Sep 10 12:14:01.918591 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.918481 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1375e625-ec7b-4f36-92ef-91e33e64a40e-metrics-cert\") pod \"lws-controller-manager-86cfb8b7dd-2nt8d\" (UID: \"1375e625-ec7b-4f36-92ef-91e33e64a40e\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" Sep 10 12:14:01.923790 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:01.923768 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkt2k\" (UniqueName: \"kubernetes.io/projected/1375e625-ec7b-4f36-92ef-91e33e64a40e-kube-api-access-fkt2k\") pod \"lws-controller-manager-86cfb8b7dd-2nt8d\" (UID: \"1375e625-ec7b-4f36-92ef-91e33e64a40e\") " pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" Sep 10 12:14:02.027859 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:02.027770 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" Sep 10 12:14:02.297692 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:02.297661 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d"] Sep 10 12:14:02.300201 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:14:02.300175 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1375e625_ec7b_4f36_92ef_91e33e64a40e.slice/crio-7fca009075abd07291410d8c9a3104a53b32c631308ae9f88bc460fc15398ddc WatchSource:0}: Error finding container 7fca009075abd07291410d8c9a3104a53b32c631308ae9f88bc460fc15398ddc: Status 404 returned error can't find the container with id 7fca009075abd07291410d8c9a3104a53b32c631308ae9f88bc460fc15398ddc Sep 10 12:14:02.502118 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:02.502063 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" event={"ID":"1375e625-ec7b-4f36-92ef-91e33e64a40e","Type":"ContainerStarted","Data":"7fca009075abd07291410d8c9a3104a53b32c631308ae9f88bc460fc15398ddc"} Sep 10 12:14:05.517677 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:05.517644 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" event={"ID":"1375e625-ec7b-4f36-92ef-91e33e64a40e","Type":"ContainerStarted","Data":"aaed5dc792e4b4acfae0f5f8f645ad12b8789d7a1a21db7fac636c3f5c399e79"} Sep 10 12:14:05.518148 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:05.517703 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" Sep 10 12:14:05.533363 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:05.533305 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" podStartSLOduration=2.325591258 podStartE2EDuration="4.533282855s" totalImagesPullingTime="2.207691597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:05.532673104 +0000 UTC m=+278.972561335" watchObservedRunningTime="2026-09-10 12:14:05.533282855 +0000 UTC m=+278.973171089" Sep 10 12:14:13.540609 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.540571 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr"] Sep 10 12:14:13.543233 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.543217 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:13.545602 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.545583 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 12:14:13.546429 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.546415 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 12:14:13.547492 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.547475 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 12:14:13.547554 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.547504 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 12:14:13.548161 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.548140 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gwfj7\"" Sep 10 12:14:13.579790 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.579769 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr"] Sep 10 12:14:13.615920 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.615895 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvfs7\" (UniqueName: \"kubernetes.io/projected/ee553c52-efbc-4222-9e39-7b6c753c9ee7-kube-api-access-lvfs7\") pod \"opendatahub-operator-controller-manager-5c75f74b49-nshrr\" (UID: \"ee553c52-efbc-4222-9e39-7b6c753c9ee7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:13.616014 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.615924 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee553c52-efbc-4222-9e39-7b6c753c9ee7-tmp\") pod \"opendatahub-operator-controller-manager-5c75f74b49-nshrr\" (UID: \"ee553c52-efbc-4222-9e39-7b6c753c9ee7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:13.616014 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.615951 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee553c52-efbc-4222-9e39-7b6c753c9ee7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c75f74b49-nshrr\" (UID: \"ee553c52-efbc-4222-9e39-7b6c753c9ee7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:13.616139 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.616014 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee553c52-efbc-4222-9e39-7b6c753c9ee7-manifests\") pod \"opendatahub-operator-controller-manager-5c75f74b49-nshrr\" (UID: \"ee553c52-efbc-4222-9e39-7b6c753c9ee7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:13.616139 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.616043 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee553c52-efbc-4222-9e39-7b6c753c9ee7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c75f74b49-nshrr\" (UID: \"ee553c52-efbc-4222-9e39-7b6c753c9ee7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:13.716613 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.716592 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee553c52-efbc-4222-9e39-7b6c753c9ee7-manifests\") pod \"opendatahub-operator-controller-manager-5c75f74b49-nshrr\" (UID: \"ee553c52-efbc-4222-9e39-7b6c753c9ee7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:13.716702 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.716619 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee553c52-efbc-4222-9e39-7b6c753c9ee7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c75f74b49-nshrr\" (UID: \"ee553c52-efbc-4222-9e39-7b6c753c9ee7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:13.716702 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.716677 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvfs7\" (UniqueName: \"kubernetes.io/projected/ee553c52-efbc-4222-9e39-7b6c753c9ee7-kube-api-access-lvfs7\") pod \"opendatahub-operator-controller-manager-5c75f74b49-nshrr\" (UID: \"ee553c52-efbc-4222-9e39-7b6c753c9ee7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:13.716702 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.716695 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee553c52-efbc-4222-9e39-7b6c753c9ee7-tmp\") pod \"opendatahub-operator-controller-manager-5c75f74b49-nshrr\" (UID: \"ee553c52-efbc-4222-9e39-7b6c753c9ee7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:13.716858 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.716718 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee553c52-efbc-4222-9e39-7b6c753c9ee7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c75f74b49-nshrr\" (UID: \"ee553c52-efbc-4222-9e39-7b6c753c9ee7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:13.717013 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.716984 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee553c52-efbc-4222-9e39-7b6c753c9ee7-manifests\") pod \"opendatahub-operator-controller-manager-5c75f74b49-nshrr\" (UID: \"ee553c52-efbc-4222-9e39-7b6c753c9ee7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:13.718984 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.718958 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee553c52-efbc-4222-9e39-7b6c753c9ee7-tmp\") pod \"opendatahub-operator-controller-manager-5c75f74b49-nshrr\" (UID: \"ee553c52-efbc-4222-9e39-7b6c753c9ee7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:13.719171 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.719150 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee553c52-efbc-4222-9e39-7b6c753c9ee7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c75f74b49-nshrr\" (UID: \"ee553c52-efbc-4222-9e39-7b6c753c9ee7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:13.719235 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.719216 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee553c52-efbc-4222-9e39-7b6c753c9ee7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c75f74b49-nshrr\" (UID: \"ee553c52-efbc-4222-9e39-7b6c753c9ee7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:13.728282 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.728264 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvfs7\" (UniqueName: \"kubernetes.io/projected/ee553c52-efbc-4222-9e39-7b6c753c9ee7-kube-api-access-lvfs7\") pod \"opendatahub-operator-controller-manager-5c75f74b49-nshrr\" (UID: \"ee553c52-efbc-4222-9e39-7b6c753c9ee7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:13.852739 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:13.852689 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:14.133234 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:14.133181 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr"] Sep 10 12:14:14.136480 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:14:14.136453 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee553c52_efbc_4222_9e39_7b6c753c9ee7.slice/crio-af1ddbaa3371925946f10b6d60a6b8c959925c1b16c8a46ff31f27f756e8b107 WatchSource:0}: Error finding container af1ddbaa3371925946f10b6d60a6b8c959925c1b16c8a46ff31f27f756e8b107: Status 404 returned error can't find the container with id af1ddbaa3371925946f10b6d60a6b8c959925c1b16c8a46ff31f27f756e8b107 Sep 10 12:14:14.557700 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:14.557660 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" event={"ID":"ee553c52-efbc-4222-9e39-7b6c753c9ee7","Type":"ContainerStarted","Data":"af1ddbaa3371925946f10b6d60a6b8c959925c1b16c8a46ff31f27f756e8b107"} Sep 10 12:14:16.523998 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:16.523960 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-86cfb8b7dd-2nt8d" Sep 10 12:14:17.581607 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:17.581571 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" event={"ID":"ee553c52-efbc-4222-9e39-7b6c753c9ee7","Type":"ContainerStarted","Data":"28a09c97acdc3adbfc52273b660eb388e9e25856f29a4f03a0724b883a593d27"} Sep 10 12:14:18.589789 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:18.589750 2555 generic.go:356] "Generic (PLEG): container finished" podID="ee553c52-efbc-4222-9e39-7b6c753c9ee7" containerID="28a09c97acdc3adbfc52273b660eb388e9e25856f29a4f03a0724b883a593d27" exitCode=0 Sep 10 12:14:18.590189 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:18.589786 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" event={"ID":"ee553c52-efbc-4222-9e39-7b6c753c9ee7","Type":"ContainerDied","Data":"28a09c97acdc3adbfc52273b660eb388e9e25856f29a4f03a0724b883a593d27"} Sep 10 12:14:19.596385 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:19.596347 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" event={"ID":"ee553c52-efbc-4222-9e39-7b6c753c9ee7","Type":"ContainerStarted","Data":"556e2c5dcc495062496269945a1db6c32b6d2703111e700e4090b86ef0ab955c"} Sep 10 12:14:19.596843 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:19.596484 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:19.616921 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:19.616873 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" podStartSLOduration=2.310520789 podStartE2EDuration="6.616858068s" totalImagesPullingTime="3.306031769s" totalInitContainerRuntime="1.00030551s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:19.61443554 +0000 UTC m=+293.054323779" watchObservedRunningTime="2026-09-10 12:14:19.616858068 +0000 UTC m=+293.056746299" Sep 10 12:14:26.999938 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:26.999906 2555 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 12:14:30.603116 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:30.603085 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c75f74b49-nshrr" Sep 10 12:14:44.174051 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.174014 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz"] Sep 10 12:14:44.176906 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.176884 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz" Sep 10 12:14:44.179170 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.179148 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 12:14:44.179300 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.179151 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 12:14:44.179370 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.179160 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 10 12:14:44.179370 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.179162 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 10 12:14:44.179959 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.179940 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5582h\"" Sep 10 12:14:44.195451 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.195409 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz"] Sep 10 12:14:44.268769 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.268738 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f5584b9-dd6b-4051-8777-6fd29375eb7e-tls-certs\") pod \"kube-auth-proxy-5cf4544794-xzdfz\" (UID: \"1f5584b9-dd6b-4051-8777-6fd29375eb7e\") " pod="openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz" Sep 10 12:14:44.268898 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.268777 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v57d8\" (UniqueName: \"kubernetes.io/projected/1f5584b9-dd6b-4051-8777-6fd29375eb7e-kube-api-access-v57d8\") pod \"kube-auth-proxy-5cf4544794-xzdfz\" (UID: \"1f5584b9-dd6b-4051-8777-6fd29375eb7e\") " pod="openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz" Sep 10 12:14:44.268898 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.268855 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f5584b9-dd6b-4051-8777-6fd29375eb7e-tmp\") pod \"kube-auth-proxy-5cf4544794-xzdfz\" (UID: \"1f5584b9-dd6b-4051-8777-6fd29375eb7e\") " pod="openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz" Sep 10 12:14:44.369423 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.369398 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f5584b9-dd6b-4051-8777-6fd29375eb7e-tls-certs\") pod \"kube-auth-proxy-5cf4544794-xzdfz\" (UID: \"1f5584b9-dd6b-4051-8777-6fd29375eb7e\") " pod="openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz" Sep 10 12:14:44.369622 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.369435 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v57d8\" (UniqueName: \"kubernetes.io/projected/1f5584b9-dd6b-4051-8777-6fd29375eb7e-kube-api-access-v57d8\") pod \"kube-auth-proxy-5cf4544794-xzdfz\" (UID: \"1f5584b9-dd6b-4051-8777-6fd29375eb7e\") " pod="openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz" Sep 10 12:14:44.369622 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.369471 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f5584b9-dd6b-4051-8777-6fd29375eb7e-tmp\") pod \"kube-auth-proxy-5cf4544794-xzdfz\" (UID: \"1f5584b9-dd6b-4051-8777-6fd29375eb7e\") " pod="openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz" Sep 10 12:14:44.371682 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.371657 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f5584b9-dd6b-4051-8777-6fd29375eb7e-tmp\") pod \"kube-auth-proxy-5cf4544794-xzdfz\" (UID: \"1f5584b9-dd6b-4051-8777-6fd29375eb7e\") " pod="openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz" Sep 10 12:14:44.371794 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.371759 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f5584b9-dd6b-4051-8777-6fd29375eb7e-tls-certs\") pod \"kube-auth-proxy-5cf4544794-xzdfz\" (UID: \"1f5584b9-dd6b-4051-8777-6fd29375eb7e\") " pod="openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz" Sep 10 12:14:44.385843 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.385814 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v57d8\" (UniqueName: \"kubernetes.io/projected/1f5584b9-dd6b-4051-8777-6fd29375eb7e-kube-api-access-v57d8\") pod \"kube-auth-proxy-5cf4544794-xzdfz\" (UID: \"1f5584b9-dd6b-4051-8777-6fd29375eb7e\") " pod="openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz" Sep 10 12:14:44.486870 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.486844 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz" Sep 10 12:14:44.772601 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.772569 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz"] Sep 10 12:14:44.775386 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:14:44.775360 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f5584b9_dd6b_4051_8777_6fd29375eb7e.slice/crio-f7a2389025d67f1cbe417122a57bb6e2048d99ea5abdf3657cae153941a25d81 WatchSource:0}: Error finding container f7a2389025d67f1cbe417122a57bb6e2048d99ea5abdf3657cae153941a25d81: Status 404 returned error can't find the container with id f7a2389025d67f1cbe417122a57bb6e2048d99ea5abdf3657cae153941a25d81 Sep 10 12:14:44.777655 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:44.777634 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:14:45.717238 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:45.717187 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz" event={"ID":"1f5584b9-dd6b-4051-8777-6fd29375eb7e","Type":"ContainerStarted","Data":"f7a2389025d67f1cbe417122a57bb6e2048d99ea5abdf3657cae153941a25d81"} Sep 10 12:14:48.735142 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:48.735100 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz" event={"ID":"1f5584b9-dd6b-4051-8777-6fd29375eb7e","Type":"ContainerStarted","Data":"24beb76c37e19a60043075337e1705f09f994b16c8c44cabe122d07ecc888dac"} Sep 10 12:14:48.754510 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:14:48.754455 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5cf4544794-xzdfz" podStartSLOduration=1.41427954 podStartE2EDuration="4.75444033s" totalImagesPullingTime="3.34016079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:14:48.752607556 +0000 UTC m=+322.192495811" watchObservedRunningTime="2026-09-10 12:14:48.75444033 +0000 UTC m=+322.194328562" Sep 10 12:15:26.314308 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.314235 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-db8564fff-ggrtp"] Sep 10 12:15:26.316665 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.316645 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.340149 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.340127 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db8564fff-ggrtp"] Sep 10 12:15:26.408099 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.408055 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c74e177-b7b5-41b8-b69d-b707a46060a3-service-ca\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.408197 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.408105 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c74e177-b7b5-41b8-b69d-b707a46060a3-console-serving-cert\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.408197 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.408122 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zn8m\" (UniqueName: \"kubernetes.io/projected/4c74e177-b7b5-41b8-b69d-b707a46060a3-kube-api-access-6zn8m\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.408197 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.408169 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c74e177-b7b5-41b8-b69d-b707a46060a3-oauth-serving-cert\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.408311 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.408206 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c74e177-b7b5-41b8-b69d-b707a46060a3-console-config\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.408311 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.408233 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c74e177-b7b5-41b8-b69d-b707a46060a3-console-oauth-config\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.408311 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.408275 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c74e177-b7b5-41b8-b69d-b707a46060a3-trusted-ca-bundle\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.508970 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.508939 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c74e177-b7b5-41b8-b69d-b707a46060a3-trusted-ca-bundle\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.509113 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.508992 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c74e177-b7b5-41b8-b69d-b707a46060a3-service-ca\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.509113 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.509020 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c74e177-b7b5-41b8-b69d-b707a46060a3-console-serving-cert\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.509113 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.509041 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zn8m\" (UniqueName: \"kubernetes.io/projected/4c74e177-b7b5-41b8-b69d-b707a46060a3-kube-api-access-6zn8m\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.509113 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.509096 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c74e177-b7b5-41b8-b69d-b707a46060a3-oauth-serving-cert\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.509329 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.509140 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c74e177-b7b5-41b8-b69d-b707a46060a3-console-config\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.509329 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.509183 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c74e177-b7b5-41b8-b69d-b707a46060a3-console-oauth-config\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.509886 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.509860 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c74e177-b7b5-41b8-b69d-b707a46060a3-console-config\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.509986 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.509882 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c74e177-b7b5-41b8-b69d-b707a46060a3-service-ca\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.509986 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.509896 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c74e177-b7b5-41b8-b69d-b707a46060a3-oauth-serving-cert\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.509986 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.509916 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c74e177-b7b5-41b8-b69d-b707a46060a3-trusted-ca-bundle\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.511660 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.511633 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c74e177-b7b5-41b8-b69d-b707a46060a3-console-serving-cert\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.511750 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.511685 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c74e177-b7b5-41b8-b69d-b707a46060a3-console-oauth-config\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.519484 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.519462 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zn8m\" (UniqueName: \"kubernetes.io/projected/4c74e177-b7b5-41b8-b69d-b707a46060a3-kube-api-access-6zn8m\") pod \"console-db8564fff-ggrtp\" (UID: \"4c74e177-b7b5-41b8-b69d-b707a46060a3\") " pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.625266 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.625212 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:26.899888 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:26.899863 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db8564fff-ggrtp"] Sep 10 12:15:26.902596 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:15:26.902564 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c74e177_b7b5_41b8_b69d_b707a46060a3.slice/crio-269ee05e08ac07143dd6306e21dc427d9bb6553697c6e20cbee2ff2940a424aa WatchSource:0}: Error finding container 269ee05e08ac07143dd6306e21dc427d9bb6553697c6e20cbee2ff2940a424aa: Status 404 returned error can't find the container with id 269ee05e08ac07143dd6306e21dc427d9bb6553697c6e20cbee2ff2940a424aa Sep 10 12:15:27.910326 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:27.910289 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db8564fff-ggrtp" event={"ID":"4c74e177-b7b5-41b8-b69d-b707a46060a3","Type":"ContainerStarted","Data":"988c350d127d0ecf754dffc449bcba67dd00d236d83769b0b6f3f6f7389cdb02"} Sep 10 12:15:27.910773 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:27.910337 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db8564fff-ggrtp" event={"ID":"4c74e177-b7b5-41b8-b69d-b707a46060a3","Type":"ContainerStarted","Data":"269ee05e08ac07143dd6306e21dc427d9bb6553697c6e20cbee2ff2940a424aa"} Sep 10 12:15:27.931159 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:27.931112 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-db8564fff-ggrtp" podStartSLOduration=1.931097082 podStartE2EDuration="1.931097082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:15:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:15:27.930376979 +0000 UTC m=+361.370265247" watchObservedRunningTime="2026-09-10 12:15:27.931097082 +0000 UTC m=+361.370985313" Sep 10 12:15:36.626204 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:36.626173 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:36.626625 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:36.626232 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:36.630026 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:36.630004 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:36.961160 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:36.961132 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-db8564fff-ggrtp" Sep 10 12:15:37.013913 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:15:37.013883 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55968b787f-6snwb"] Sep 10 12:16:02.032950 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.032891 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55968b787f-6snwb" podUID="3492c8e4-4179-4fcd-b733-2042442c16c1" containerName="console" containerID="cri-o://1ce484dc04f2fcab803615da404f869d0a2f6467faab63ec8abf4aa9748c7b80" gracePeriod=15 Sep 10 12:16:02.268311 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.268286 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:16:02.374807 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.374733 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-console-config\") pod \"3492c8e4-4179-4fcd-b733-2042442c16c1\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " Sep 10 12:16:02.374807 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.374770 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-service-ca\") pod \"3492c8e4-4179-4fcd-b733-2042442c16c1\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " Sep 10 12:16:02.374807 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.374801 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3492c8e4-4179-4fcd-b733-2042442c16c1-console-oauth-config\") pod \"3492c8e4-4179-4fcd-b733-2042442c16c1\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " Sep 10 12:16:02.375047 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.374837 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4f6c\" (UniqueName: \"kubernetes.io/projected/3492c8e4-4179-4fcd-b733-2042442c16c1-kube-api-access-x4f6c\") pod \"3492c8e4-4179-4fcd-b733-2042442c16c1\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " Sep 10 12:16:02.375047 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.374869 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3492c8e4-4179-4fcd-b733-2042442c16c1-console-serving-cert\") pod \"3492c8e4-4179-4fcd-b733-2042442c16c1\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " Sep 10 12:16:02.375047 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.374925 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-trusted-ca-bundle\") pod \"3492c8e4-4179-4fcd-b733-2042442c16c1\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " Sep 10 12:16:02.375047 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.374963 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-oauth-serving-cert\") pod \"3492c8e4-4179-4fcd-b733-2042442c16c1\" (UID: \"3492c8e4-4179-4fcd-b733-2042442c16c1\") " Sep 10 12:16:02.375269 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.375216 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-service-ca" (OuterVolumeSpecName: "service-ca") pod "3492c8e4-4179-4fcd-b733-2042442c16c1" (UID: "3492c8e4-4179-4fcd-b733-2042442c16c1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:16:02.375327 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.375194 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-console-config" (OuterVolumeSpecName: "console-config") pod "3492c8e4-4179-4fcd-b733-2042442c16c1" (UID: "3492c8e4-4179-4fcd-b733-2042442c16c1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:16:02.375454 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.375430 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3492c8e4-4179-4fcd-b733-2042442c16c1" (UID: "3492c8e4-4179-4fcd-b733-2042442c16c1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:16:02.375509 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.375481 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3492c8e4-4179-4fcd-b733-2042442c16c1" (UID: "3492c8e4-4179-4fcd-b733-2042442c16c1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:16:02.376997 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.376975 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3492c8e4-4179-4fcd-b733-2042442c16c1-kube-api-access-x4f6c" (OuterVolumeSpecName: "kube-api-access-x4f6c") pod "3492c8e4-4179-4fcd-b733-2042442c16c1" (UID: "3492c8e4-4179-4fcd-b733-2042442c16c1"). InnerVolumeSpecName "kube-api-access-x4f6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:16:02.377420 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.377405 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3492c8e4-4179-4fcd-b733-2042442c16c1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3492c8e4-4179-4fcd-b733-2042442c16c1" (UID: "3492c8e4-4179-4fcd-b733-2042442c16c1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:16:02.377510 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.377492 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3492c8e4-4179-4fcd-b733-2042442c16c1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3492c8e4-4179-4fcd-b733-2042442c16c1" (UID: "3492c8e4-4179-4fcd-b733-2042442c16c1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:16:02.475911 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.475884 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-trusted-ca-bundle\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:16:02.475911 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.475908 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-oauth-serving-cert\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:16:02.476052 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.475918 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-console-config\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:16:02.476052 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.475926 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3492c8e4-4179-4fcd-b733-2042442c16c1-service-ca\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:16:02.476052 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.475934 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3492c8e4-4179-4fcd-b733-2042442c16c1-console-oauth-config\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:16:02.476052 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.475942 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4f6c\" (UniqueName: \"kubernetes.io/projected/3492c8e4-4179-4fcd-b733-2042442c16c1-kube-api-access-x4f6c\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:16:02.476052 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:02.475951 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3492c8e4-4179-4fcd-b733-2042442c16c1-console-serving-cert\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:16:03.077701 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:03.077666 2555 generic.go:356] "Generic (PLEG): container finished" podID="3492c8e4-4179-4fcd-b733-2042442c16c1" containerID="1ce484dc04f2fcab803615da404f869d0a2f6467faab63ec8abf4aa9748c7b80" exitCode=0 Sep 10 12:16:03.078098 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:03.077716 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55968b787f-6snwb" Sep 10 12:16:03.078098 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:03.077752 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55968b787f-6snwb" event={"ID":"3492c8e4-4179-4fcd-b733-2042442c16c1","Type":"ContainerDied","Data":"1ce484dc04f2fcab803615da404f869d0a2f6467faab63ec8abf4aa9748c7b80"} Sep 10 12:16:03.078098 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:03.077827 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55968b787f-6snwb" event={"ID":"3492c8e4-4179-4fcd-b733-2042442c16c1","Type":"ContainerDied","Data":"7d7d80e5bf52e8b3de662fb7eda071b8268422381d0d87a74ea9ee343195d6dc"} Sep 10 12:16:03.078098 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:03.077849 2555 scope.go:117] "RemoveContainer" containerID="1ce484dc04f2fcab803615da404f869d0a2f6467faab63ec8abf4aa9748c7b80" Sep 10 12:16:03.086604 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:03.086586 2555 scope.go:117] "RemoveContainer" containerID="1ce484dc04f2fcab803615da404f869d0a2f6467faab63ec8abf4aa9748c7b80" Sep 10 12:16:03.086870 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:16:03.086849 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ce484dc04f2fcab803615da404f869d0a2f6467faab63ec8abf4aa9748c7b80\": container with ID starting with 1ce484dc04f2fcab803615da404f869d0a2f6467faab63ec8abf4aa9748c7b80 not found: ID does not exist" containerID="1ce484dc04f2fcab803615da404f869d0a2f6467faab63ec8abf4aa9748c7b80" Sep 10 12:16:03.086937 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:03.086877 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ce484dc04f2fcab803615da404f869d0a2f6467faab63ec8abf4aa9748c7b80"} err="failed to get container status \"1ce484dc04f2fcab803615da404f869d0a2f6467faab63ec8abf4aa9748c7b80\": rpc error: code = NotFound desc = could not find container \"1ce484dc04f2fcab803615da404f869d0a2f6467faab63ec8abf4aa9748c7b80\": container with ID starting with 1ce484dc04f2fcab803615da404f869d0a2f6467faab63ec8abf4aa9748c7b80 not found: ID does not exist" Sep 10 12:16:03.099736 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:03.099717 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55968b787f-6snwb"] Sep 10 12:16:03.104668 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:03.104639 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55968b787f-6snwb"] Sep 10 12:16:03.113416 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:03.113395 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3492c8e4-4179-4fcd-b733-2042442c16c1" path="/var/lib/kubelet/pods/3492c8e4-4179-4fcd-b733-2042442c16c1/volumes" Sep 10 12:16:27.267891 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.267791 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b"] Sep 10 12:16:27.268331 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.268276 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3492c8e4-4179-4fcd-b733-2042442c16c1" containerName="console" Sep 10 12:16:27.268331 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.268289 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3492c8e4-4179-4fcd-b733-2042442c16c1" containerName="console" Sep 10 12:16:27.268440 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.268343 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3492c8e4-4179-4fcd-b733-2042442c16c1" containerName="console" Sep 10 12:16:27.272356 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.272335 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b" Sep 10 12:16:27.274447 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.274426 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 10 12:16:27.274447 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.274440 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 10 12:16:27.274610 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.274464 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 12:16:27.275058 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.275043 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 12:16:27.275155 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.275050 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-k6wvd\"" Sep 10 12:16:27.284554 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.283042 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b"] Sep 10 12:16:27.373300 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.373274 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9132ec50-fdb0-4145-a88f-c1382086976b-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-zq74b\" (UID: \"9132ec50-fdb0-4145-a88f-c1382086976b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b" Sep 10 12:16:27.373467 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.373332 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9132ec50-fdb0-4145-a88f-c1382086976b-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-zq74b\" (UID: \"9132ec50-fdb0-4145-a88f-c1382086976b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b" Sep 10 12:16:27.373467 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.373350 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfn7h\" (UniqueName: \"kubernetes.io/projected/9132ec50-fdb0-4145-a88f-c1382086976b-kube-api-access-mfn7h\") pod \"kuadrant-console-plugin-fbdd4f445-zq74b\" (UID: \"9132ec50-fdb0-4145-a88f-c1382086976b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b" Sep 10 12:16:27.474402 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.474371 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9132ec50-fdb0-4145-a88f-c1382086976b-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-zq74b\" (UID: \"9132ec50-fdb0-4145-a88f-c1382086976b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b" Sep 10 12:16:27.474402 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.474403 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfn7h\" (UniqueName: \"kubernetes.io/projected/9132ec50-fdb0-4145-a88f-c1382086976b-kube-api-access-mfn7h\") pod \"kuadrant-console-plugin-fbdd4f445-zq74b\" (UID: \"9132ec50-fdb0-4145-a88f-c1382086976b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b" Sep 10 12:16:27.474583 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.474447 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9132ec50-fdb0-4145-a88f-c1382086976b-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-zq74b\" (UID: \"9132ec50-fdb0-4145-a88f-c1382086976b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b" Sep 10 12:16:27.475011 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.474993 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9132ec50-fdb0-4145-a88f-c1382086976b-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-zq74b\" (UID: \"9132ec50-fdb0-4145-a88f-c1382086976b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b" Sep 10 12:16:27.476829 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.476807 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9132ec50-fdb0-4145-a88f-c1382086976b-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-zq74b\" (UID: \"9132ec50-fdb0-4145-a88f-c1382086976b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b" Sep 10 12:16:27.483453 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.483430 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfn7h\" (UniqueName: \"kubernetes.io/projected/9132ec50-fdb0-4145-a88f-c1382086976b-kube-api-access-mfn7h\") pod \"kuadrant-console-plugin-fbdd4f445-zq74b\" (UID: \"9132ec50-fdb0-4145-a88f-c1382086976b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b" Sep 10 12:16:27.586045 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.585986 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b" Sep 10 12:16:27.855848 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:27.855780 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b"] Sep 10 12:16:27.859686 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:16:27.859661 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9132ec50_fdb0_4145_a88f_c1382086976b.slice/crio-8704948cf900a5922ede6e43ada6f06f0ad6ed4b25f0f043af81343b1e0e5dce WatchSource:0}: Error finding container 8704948cf900a5922ede6e43ada6f06f0ad6ed4b25f0f043af81343b1e0e5dce: Status 404 returned error can't find the container with id 8704948cf900a5922ede6e43ada6f06f0ad6ed4b25f0f043af81343b1e0e5dce Sep 10 12:16:28.192131 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:28.192099 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b" event={"ID":"9132ec50-fdb0-4145-a88f-c1382086976b","Type":"ContainerStarted","Data":"8704948cf900a5922ede6e43ada6f06f0ad6ed4b25f0f043af81343b1e0e5dce"} Sep 10 12:16:33.221755 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:33.221720 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b" event={"ID":"9132ec50-fdb0-4145-a88f-c1382086976b","Type":"ContainerStarted","Data":"3b3505e48dfbd10d67348b38c637a3976eaf1357bb4cb94011464ad8cfd46f26"} Sep 10 12:16:33.238952 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:33.238906 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zq74b" podStartSLOduration=1.3361988550000001 podStartE2EDuration="6.238891462s" totalImagesPullingTime="4.902692607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:16:33.237241346 +0000 UTC m=+426.677129579" watchObservedRunningTime="2026-09-10 12:16:33.238891462 +0000 UTC m=+426.678779693" Sep 10 12:16:36.538918 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:36.538886 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs"] Sep 10 12:16:36.542818 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:36.542798 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs" Sep 10 12:16:36.545695 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:36.545673 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6ngnf\"" Sep 10 12:16:36.560955 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:36.560934 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs"] Sep 10 12:16:36.651406 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:36.651382 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmjl2\" (UniqueName: \"kubernetes.io/projected/196dc46b-e199-408e-b834-92a99ca05ca9-kube-api-access-tmjl2\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bljcs\" (UID: \"196dc46b-e199-408e-b834-92a99ca05ca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs" Sep 10 12:16:36.651529 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:36.651410 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/196dc46b-e199-408e-b834-92a99ca05ca9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bljcs\" (UID: \"196dc46b-e199-408e-b834-92a99ca05ca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs" Sep 10 12:16:36.752781 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:36.752754 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmjl2\" (UniqueName: \"kubernetes.io/projected/196dc46b-e199-408e-b834-92a99ca05ca9-kube-api-access-tmjl2\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bljcs\" (UID: \"196dc46b-e199-408e-b834-92a99ca05ca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs" Sep 10 12:16:36.752881 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:36.752784 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/196dc46b-e199-408e-b834-92a99ca05ca9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bljcs\" (UID: \"196dc46b-e199-408e-b834-92a99ca05ca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs" Sep 10 12:16:36.753128 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:36.753112 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/196dc46b-e199-408e-b834-92a99ca05ca9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bljcs\" (UID: \"196dc46b-e199-408e-b834-92a99ca05ca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs" Sep 10 12:16:36.761620 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:36.761600 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmjl2\" (UniqueName: \"kubernetes.io/projected/196dc46b-e199-408e-b834-92a99ca05ca9-kube-api-access-tmjl2\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bljcs\" (UID: \"196dc46b-e199-408e-b834-92a99ca05ca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs" Sep 10 12:16:36.853720 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:36.853665 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs" Sep 10 12:16:37.131150 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:37.131119 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs"] Sep 10 12:16:37.134222 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:16:37.134198 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod196dc46b_e199_408e_b834_92a99ca05ca9.slice/crio-bce0561343e17cbf512d5c2f91b8933e7ce6283c40355a701a30a62e1aca8620 WatchSource:0}: Error finding container bce0561343e17cbf512d5c2f91b8933e7ce6283c40355a701a30a62e1aca8620: Status 404 returned error can't find the container with id bce0561343e17cbf512d5c2f91b8933e7ce6283c40355a701a30a62e1aca8620 Sep 10 12:16:37.246968 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:37.246934 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs" event={"ID":"196dc46b-e199-408e-b834-92a99ca05ca9","Type":"ContainerStarted","Data":"bce0561343e17cbf512d5c2f91b8933e7ce6283c40355a701a30a62e1aca8620"} Sep 10 12:16:37.546702 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:37.546669 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs"] Sep 10 12:16:37.550742 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:37.550719 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs"] Sep 10 12:16:41.269217 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:41.269183 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs" podUID="196dc46b-e199-408e-b834-92a99ca05ca9" containerName="manager" containerID="cri-o://71f58d8a981a23d94d70ebd21332f14281fe7e04a1589a0795cd8fc63f1f3585" gracePeriod=2 Sep 10 12:16:41.504171 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:41.504148 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs" Sep 10 12:16:41.505830 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:16:41.505807 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-bljcs\" is forbidden: User \"system:node:ip-10-0-142-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-28.ec2.internal' and this object" podUID="196dc46b-e199-408e-b834-92a99ca05ca9" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs" Sep 10 12:16:41.601048 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:41.600982 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmjl2\" (UniqueName: \"kubernetes.io/projected/196dc46b-e199-408e-b834-92a99ca05ca9-kube-api-access-tmjl2\") pod \"196dc46b-e199-408e-b834-92a99ca05ca9\" (UID: \"196dc46b-e199-408e-b834-92a99ca05ca9\") " Sep 10 12:16:41.601213 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:41.601079 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/196dc46b-e199-408e-b834-92a99ca05ca9-extensions-socket-volume\") pod \"196dc46b-e199-408e-b834-92a99ca05ca9\" (UID: \"196dc46b-e199-408e-b834-92a99ca05ca9\") " Sep 10 12:16:41.601271 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:41.601248 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/196dc46b-e199-408e-b834-92a99ca05ca9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "196dc46b-e199-408e-b834-92a99ca05ca9" (UID: "196dc46b-e199-408e-b834-92a99ca05ca9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:16:41.603135 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:41.603114 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/196dc46b-e199-408e-b834-92a99ca05ca9-kube-api-access-tmjl2" (OuterVolumeSpecName: "kube-api-access-tmjl2") pod "196dc46b-e199-408e-b834-92a99ca05ca9" (UID: "196dc46b-e199-408e-b834-92a99ca05ca9"). InnerVolumeSpecName "kube-api-access-tmjl2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:16:41.701734 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:41.701703 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/196dc46b-e199-408e-b834-92a99ca05ca9-extensions-socket-volume\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:16:41.701734 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:41.701733 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmjl2\" (UniqueName: \"kubernetes.io/projected/196dc46b-e199-408e-b834-92a99ca05ca9-kube-api-access-tmjl2\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:16:42.274899 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:42.274864 2555 generic.go:356] "Generic (PLEG): container finished" podID="196dc46b-e199-408e-b834-92a99ca05ca9" containerID="71f58d8a981a23d94d70ebd21332f14281fe7e04a1589a0795cd8fc63f1f3585" exitCode=2 Sep 10 12:16:42.275291 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:42.274901 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs" Sep 10 12:16:42.275291 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:42.274962 2555 scope.go:117] "RemoveContainer" containerID="71f58d8a981a23d94d70ebd21332f14281fe7e04a1589a0795cd8fc63f1f3585" Sep 10 12:16:42.276795 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:16:42.276767 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-bljcs\" is forbidden: User \"system:node:ip-10-0-142-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-28.ec2.internal' and this object" podUID="196dc46b-e199-408e-b834-92a99ca05ca9" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs" Sep 10 12:16:42.283337 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:42.283322 2555 scope.go:117] "RemoveContainer" containerID="71f58d8a981a23d94d70ebd21332f14281fe7e04a1589a0795cd8fc63f1f3585" Sep 10 12:16:42.283588 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:16:42.283573 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71f58d8a981a23d94d70ebd21332f14281fe7e04a1589a0795cd8fc63f1f3585\": container with ID starting with 71f58d8a981a23d94d70ebd21332f14281fe7e04a1589a0795cd8fc63f1f3585 not found: ID does not exist" containerID="71f58d8a981a23d94d70ebd21332f14281fe7e04a1589a0795cd8fc63f1f3585" Sep 10 12:16:42.283644 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:42.283596 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71f58d8a981a23d94d70ebd21332f14281fe7e04a1589a0795cd8fc63f1f3585"} err="failed to get container status \"71f58d8a981a23d94d70ebd21332f14281fe7e04a1589a0795cd8fc63f1f3585\": rpc error: code = NotFound desc = could not find container \"71f58d8a981a23d94d70ebd21332f14281fe7e04a1589a0795cd8fc63f1f3585\": container with ID starting with 71f58d8a981a23d94d70ebd21332f14281fe7e04a1589a0795cd8fc63f1f3585 not found: ID does not exist" Sep 10 12:16:42.284585 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:16:42.284565 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-bljcs\" is forbidden: User \"system:node:ip-10-0-142-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-28.ec2.internal' and this object" podUID="196dc46b-e199-408e-b834-92a99ca05ca9" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bljcs" Sep 10 12:16:43.114398 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:16:43.114366 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="196dc46b-e199-408e-b834-92a99ca05ca9" path="/var/lib/kubelet/pods/196dc46b-e199-408e-b834-92a99ca05ca9/volumes" Sep 10 12:17:25.008667 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.008633 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8qvb7"] Sep 10 12:17:25.009064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.008987 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="196dc46b-e199-408e-b834-92a99ca05ca9" containerName="manager" Sep 10 12:17:25.009064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.008997 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="196dc46b-e199-408e-b834-92a99ca05ca9" containerName="manager" Sep 10 12:17:25.009064 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.009054 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="196dc46b-e199-408e-b834-92a99ca05ca9" containerName="manager" Sep 10 12:17:25.011049 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.011030 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-8qvb7" Sep 10 12:17:25.013514 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.013493 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 10 12:17:25.021285 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.021264 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8qvb7"] Sep 10 12:17:25.052412 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.052377 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8qvb7"] Sep 10 12:17:25.191893 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.191839 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a113cd98-8ef1-48b2-874f-cd1b039a444f-config-file\") pod \"limitador-limitador-84994f7ffc-8qvb7\" (UID: \"a113cd98-8ef1-48b2-874f-cd1b039a444f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8qvb7" Sep 10 12:17:25.192130 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.191919 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv74j\" (UniqueName: \"kubernetes.io/projected/a113cd98-8ef1-48b2-874f-cd1b039a444f-kube-api-access-mv74j\") pod \"limitador-limitador-84994f7ffc-8qvb7\" (UID: \"a113cd98-8ef1-48b2-874f-cd1b039a444f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8qvb7" Sep 10 12:17:25.293190 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.293113 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv74j\" (UniqueName: \"kubernetes.io/projected/a113cd98-8ef1-48b2-874f-cd1b039a444f-kube-api-access-mv74j\") pod \"limitador-limitador-84994f7ffc-8qvb7\" (UID: \"a113cd98-8ef1-48b2-874f-cd1b039a444f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8qvb7" Sep 10 12:17:25.293316 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.293208 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a113cd98-8ef1-48b2-874f-cd1b039a444f-config-file\") pod \"limitador-limitador-84994f7ffc-8qvb7\" (UID: \"a113cd98-8ef1-48b2-874f-cd1b039a444f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8qvb7" Sep 10 12:17:25.293783 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.293764 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a113cd98-8ef1-48b2-874f-cd1b039a444f-config-file\") pod \"limitador-limitador-84994f7ffc-8qvb7\" (UID: \"a113cd98-8ef1-48b2-874f-cd1b039a444f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8qvb7" Sep 10 12:17:25.301132 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.301109 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv74j\" (UniqueName: \"kubernetes.io/projected/a113cd98-8ef1-48b2-874f-cd1b039a444f-kube-api-access-mv74j\") pod \"limitador-limitador-84994f7ffc-8qvb7\" (UID: \"a113cd98-8ef1-48b2-874f-cd1b039a444f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-8qvb7" Sep 10 12:17:25.321721 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.321689 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-8qvb7" Sep 10 12:17:25.597095 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.597050 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8qvb7"] Sep 10 12:17:25.599369 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:17:25.599346 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda113cd98_8ef1_48b2_874f_cd1b039a444f.slice/crio-847ff30320079d9755671d0a2cc565932a5e508c839b66e663a1eb40d9706081 WatchSource:0}: Error finding container 847ff30320079d9755671d0a2cc565932a5e508c839b66e663a1eb40d9706081: Status 404 returned error can't find the container with id 847ff30320079d9755671d0a2cc565932a5e508c839b66e663a1eb40d9706081 Sep 10 12:17:25.708850 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.708817 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-mf4h2"] Sep 10 12:17:25.711657 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.711638 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-mf4h2" Sep 10 12:17:25.713826 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.713803 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gntn6\"" Sep 10 12:17:25.720303 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.720283 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-mf4h2"] Sep 10 12:17:25.798140 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.798105 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvl8p\" (UniqueName: \"kubernetes.io/projected/48cef981-e9e5-4506-a948-35123feeff00-kube-api-access-xvl8p\") pod \"authorino-59c974bd48-mf4h2\" (UID: \"48cef981-e9e5-4506-a948-35123feeff00\") " pod="kuadrant-system/authorino-59c974bd48-mf4h2" Sep 10 12:17:25.899578 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.899493 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvl8p\" (UniqueName: \"kubernetes.io/projected/48cef981-e9e5-4506-a948-35123feeff00-kube-api-access-xvl8p\") pod \"authorino-59c974bd48-mf4h2\" (UID: \"48cef981-e9e5-4506-a948-35123feeff00\") " pod="kuadrant-system/authorino-59c974bd48-mf4h2" Sep 10 12:17:25.908102 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:25.908052 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvl8p\" (UniqueName: \"kubernetes.io/projected/48cef981-e9e5-4506-a948-35123feeff00-kube-api-access-xvl8p\") pod \"authorino-59c974bd48-mf4h2\" (UID: \"48cef981-e9e5-4506-a948-35123feeff00\") " pod="kuadrant-system/authorino-59c974bd48-mf4h2" Sep 10 12:17:26.021789 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:26.021753 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-mf4h2" Sep 10 12:17:26.289421 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:26.289390 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-mf4h2"] Sep 10 12:17:26.292498 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:17:26.292472 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48cef981_e9e5_4506_a948_35123feeff00.slice/crio-c0db167ec13242ad4d017d2666baa1b48f576b117a803800e80f11d07f8cc46e WatchSource:0}: Error finding container c0db167ec13242ad4d017d2666baa1b48f576b117a803800e80f11d07f8cc46e: Status 404 returned error can't find the container with id c0db167ec13242ad4d017d2666baa1b48f576b117a803800e80f11d07f8cc46e Sep 10 12:17:26.487857 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:26.487825 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-8qvb7" event={"ID":"a113cd98-8ef1-48b2-874f-cd1b039a444f","Type":"ContainerStarted","Data":"847ff30320079d9755671d0a2cc565932a5e508c839b66e663a1eb40d9706081"} Sep 10 12:17:26.489055 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:26.489031 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-mf4h2" event={"ID":"48cef981-e9e5-4506-a948-35123feeff00","Type":"ContainerStarted","Data":"c0db167ec13242ad4d017d2666baa1b48f576b117a803800e80f11d07f8cc46e"} Sep 10 12:17:27.497770 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:27.497707 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-8qvb7" event={"ID":"a113cd98-8ef1-48b2-874f-cd1b039a444f","Type":"ContainerStarted","Data":"18b7e62260d3b25800ed4fc57299678411c652ad17adc04bbad7d34f3b4f8b70"} Sep 10 12:17:27.498259 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:27.497904 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-8qvb7" Sep 10 12:17:27.529300 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:27.529240 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-8qvb7" podStartSLOduration=2.449079618 podStartE2EDuration="3.529218091s" totalImagesPullingTime="1.080138473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:17:27.526457143 +0000 UTC m=+480.966345406" watchObservedRunningTime="2026-09-10 12:17:27.529218091 +0000 UTC m=+480.969106326" Sep 10 12:17:28.503819 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:28.503784 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-mf4h2" event={"ID":"48cef981-e9e5-4506-a948-35123feeff00","Type":"ContainerStarted","Data":"f1bfb5b1ba7d19795e33a71ff3e7d0d2b2961e9c47bb5fee5df752fae3d5c112"} Sep 10 12:17:28.518292 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:28.518240 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-mf4h2" podStartSLOduration=1.751488219 podStartE2EDuration="3.518223086s" totalImagesPullingTime="1.766734867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:17:28.517358436 +0000 UTC m=+481.957246670" watchObservedRunningTime="2026-09-10 12:17:28.518223086 +0000 UTC m=+481.958111322" Sep 10 12:17:38.504953 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:17:38.504920 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-8qvb7" Sep 10 12:18:00.060498 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:00.060463 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-mf4h2"] Sep 10 12:18:00.061057 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:00.060658 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-mf4h2" podUID="48cef981-e9e5-4506-a948-35123feeff00" containerName="authorino" containerID="cri-o://f1bfb5b1ba7d19795e33a71ff3e7d0d2b2961e9c47bb5fee5df752fae3d5c112" gracePeriod=30 Sep 10 12:18:00.305042 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:00.305018 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-mf4h2" Sep 10 12:18:00.408871 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:00.408804 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvl8p\" (UniqueName: \"kubernetes.io/projected/48cef981-e9e5-4506-a948-35123feeff00-kube-api-access-xvl8p\") pod \"48cef981-e9e5-4506-a948-35123feeff00\" (UID: \"48cef981-e9e5-4506-a948-35123feeff00\") " Sep 10 12:18:00.410739 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:00.410707 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48cef981-e9e5-4506-a948-35123feeff00-kube-api-access-xvl8p" (OuterVolumeSpecName: "kube-api-access-xvl8p") pod "48cef981-e9e5-4506-a948-35123feeff00" (UID: "48cef981-e9e5-4506-a948-35123feeff00"). InnerVolumeSpecName "kube-api-access-xvl8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:18:00.509769 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:00.509737 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvl8p\" (UniqueName: \"kubernetes.io/projected/48cef981-e9e5-4506-a948-35123feeff00-kube-api-access-xvl8p\") on node \"ip-10-0-142-28.ec2.internal\" DevicePath \"\"" Sep 10 12:18:00.658323 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:00.658284 2555 generic.go:356] "Generic (PLEG): container finished" podID="48cef981-e9e5-4506-a948-35123feeff00" containerID="f1bfb5b1ba7d19795e33a71ff3e7d0d2b2961e9c47bb5fee5df752fae3d5c112" exitCode=0 Sep 10 12:18:00.658473 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:00.658328 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-mf4h2" Sep 10 12:18:00.658473 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:00.658370 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-mf4h2" event={"ID":"48cef981-e9e5-4506-a948-35123feeff00","Type":"ContainerDied","Data":"f1bfb5b1ba7d19795e33a71ff3e7d0d2b2961e9c47bb5fee5df752fae3d5c112"} Sep 10 12:18:00.658473 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:00.658414 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-mf4h2" event={"ID":"48cef981-e9e5-4506-a948-35123feeff00","Type":"ContainerDied","Data":"c0db167ec13242ad4d017d2666baa1b48f576b117a803800e80f11d07f8cc46e"} Sep 10 12:18:00.658473 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:00.658434 2555 scope.go:117] "RemoveContainer" containerID="f1bfb5b1ba7d19795e33a71ff3e7d0d2b2961e9c47bb5fee5df752fae3d5c112" Sep 10 12:18:00.667863 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:00.667844 2555 scope.go:117] "RemoveContainer" containerID="f1bfb5b1ba7d19795e33a71ff3e7d0d2b2961e9c47bb5fee5df752fae3d5c112" Sep 10 12:18:00.668161 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:18:00.668140 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1bfb5b1ba7d19795e33a71ff3e7d0d2b2961e9c47bb5fee5df752fae3d5c112\": container with ID starting with f1bfb5b1ba7d19795e33a71ff3e7d0d2b2961e9c47bb5fee5df752fae3d5c112 not found: ID does not exist" containerID="f1bfb5b1ba7d19795e33a71ff3e7d0d2b2961e9c47bb5fee5df752fae3d5c112" Sep 10 12:18:00.668207 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:00.668175 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1bfb5b1ba7d19795e33a71ff3e7d0d2b2961e9c47bb5fee5df752fae3d5c112"} err="failed to get container status \"f1bfb5b1ba7d19795e33a71ff3e7d0d2b2961e9c47bb5fee5df752fae3d5c112\": rpc error: code = NotFound desc = could not find container \"f1bfb5b1ba7d19795e33a71ff3e7d0d2b2961e9c47bb5fee5df752fae3d5c112\": container with ID starting with f1bfb5b1ba7d19795e33a71ff3e7d0d2b2961e9c47bb5fee5df752fae3d5c112 not found: ID does not exist" Sep 10 12:18:00.682516 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:00.682487 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-mf4h2"] Sep 10 12:18:00.686407 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:00.686389 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-mf4h2"] Sep 10 12:18:01.115725 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:01.115684 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48cef981-e9e5-4506-a948-35123feeff00" path="/var/lib/kubelet/pods/48cef981-e9e5-4506-a948-35123feeff00/volumes" Sep 10 12:18:43.887686 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:18:43.887642 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8qvb7"] Sep 10 12:19:05.692189 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:05.692154 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8qvb7"] Sep 10 12:19:15.282733 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.282700 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-w88sf"] Sep 10 12:19:15.283224 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.283092 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48cef981-e9e5-4506-a948-35123feeff00" containerName="authorino" Sep 10 12:19:15.283224 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.283103 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="48cef981-e9e5-4506-a948-35123feeff00" containerName="authorino" Sep 10 12:19:15.283224 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.283168 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="48cef981-e9e5-4506-a948-35123feeff00" containerName="authorino" Sep 10 12:19:15.286279 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.286259 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.289536 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.289514 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 12:19:15.289666 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.289584 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 12:19:15.289666 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.289642 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j9nk5\"" Sep 10 12:19:15.289791 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.289521 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 10 12:19:15.296185 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.296152 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-w88sf"] Sep 10 12:19:15.347704 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.347668 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2444682-577f-4348-810d-a774328a9a97-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.347704 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.347704 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2444682-577f-4348-810d-a774328a9a97-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.347918 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.347740 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb4pg\" (UniqueName: \"kubernetes.io/projected/d2444682-577f-4348-810d-a774328a9a97-kube-api-access-xb4pg\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.347918 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.347818 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2444682-577f-4348-810d-a774328a9a97-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.347918 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.347905 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2444682-577f-4348-810d-a774328a9a97-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.348027 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.347934 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2444682-577f-4348-810d-a774328a9a97-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.448996 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.448959 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2444682-577f-4348-810d-a774328a9a97-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.448996 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.448996 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2444682-577f-4348-810d-a774328a9a97-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.449247 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.449025 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb4pg\" (UniqueName: \"kubernetes.io/projected/d2444682-577f-4348-810d-a774328a9a97-kube-api-access-xb4pg\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.449247 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.449061 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2444682-577f-4348-810d-a774328a9a97-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.449247 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.449149 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2444682-577f-4348-810d-a774328a9a97-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.449247 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.449184 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2444682-577f-4348-810d-a774328a9a97-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.449411 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.449355 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2444682-577f-4348-810d-a774328a9a97-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.449449 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.449406 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2444682-577f-4348-810d-a774328a9a97-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.449519 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.449495 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2444682-577f-4348-810d-a774328a9a97-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.451337 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.451311 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2444682-577f-4348-810d-a774328a9a97-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.451618 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.451602 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2444682-577f-4348-810d-a774328a9a97-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.456882 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.456858 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb4pg\" (UniqueName: \"kubernetes.io/projected/d2444682-577f-4348-810d-a774328a9a97-kube-api-access-xb4pg\") pod \"e2e-distinct-simulated-kserve-6685d86975-w88sf\" (UID: \"d2444682-577f-4348-810d-a774328a9a97\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.598375 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.598285 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:15.869022 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:15.868999 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-w88sf"] Sep 10 12:19:15.871255 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:19:15.871223 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2444682_577f_4348_810d_a774328a9a97.slice/crio-bc04db419c424e2ead296c276c9a21b730cc87c8312961d9999c9f2582ab9e8f WatchSource:0}: Error finding container bc04db419c424e2ead296c276c9a21b730cc87c8312961d9999c9f2582ab9e8f: Status 404 returned error can't find the container with id bc04db419c424e2ead296c276c9a21b730cc87c8312961d9999c9f2582ab9e8f Sep 10 12:19:16.013700 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:16.013659 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" event={"ID":"d2444682-577f-4348-810d-a774328a9a97","Type":"ContainerStarted","Data":"bc04db419c424e2ead296c276c9a21b730cc87c8312961d9999c9f2582ab9e8f"} Sep 10 12:19:16.091726 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:16.091686 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8qvb7"] Sep 10 12:19:17.019815 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:17.019781 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" event={"ID":"d2444682-577f-4348-810d-a774328a9a97","Type":"ContainerStarted","Data":"e6099c99c91e5199d70a498f7d296d5234476adf5a8c88473f482571685fa905"} Sep 10 12:19:17.040461 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:17.040407 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podStartSLOduration=0.984147017 podStartE2EDuration="2.04038663s" totalImagesPullingTime="1.056239613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:19:17.040277357 +0000 UTC m=+590.480165617" watchObservedRunningTime="2026-09-10 12:19:17.04038663 +0000 UTC m=+590.480274864" Sep 10 12:19:18.025618 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:18.025579 2555 generic.go:356] "Generic (PLEG): container finished" podID="d2444682-577f-4348-810d-a774328a9a97" containerID="e6099c99c91e5199d70a498f7d296d5234476adf5a8c88473f482571685fa905" exitCode=0 Sep 10 12:19:18.025999 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:18.025671 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" event={"ID":"d2444682-577f-4348-810d-a774328a9a97","Type":"ContainerDied","Data":"e6099c99c91e5199d70a498f7d296d5234476adf5a8c88473f482571685fa905"} Sep 10 12:19:18.025999 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:18.025951 2555 scope.go:117] "RemoveContainer" containerID="e6099c99c91e5199d70a498f7d296d5234476adf5a8c88473f482571685fa905" Sep 10 12:19:19.035752 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:19.035713 2555 generic.go:356] "Generic (PLEG): container finished" podID="d2444682-577f-4348-810d-a774328a9a97" containerID="0c168a680d799ba108ecc0857b7bfcc05cf21c88331ff063772940905796eaba" exitCode=0 Sep 10 12:19:19.036195 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:19.035759 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" event={"ID":"d2444682-577f-4348-810d-a774328a9a97","Type":"ContainerDied","Data":"0c168a680d799ba108ecc0857b7bfcc05cf21c88331ff063772940905796eaba"} Sep 10 12:19:19.036195 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:19.035844 2555 scope.go:117] "RemoveContainer" containerID="e6099c99c91e5199d70a498f7d296d5234476adf5a8c88473f482571685fa905" Sep 10 12:19:19.036195 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:19.036107 2555 scope.go:117] "RemoveContainer" containerID="0c168a680d799ba108ecc0857b7bfcc05cf21c88331ff063772940905796eaba" Sep 10 12:19:19.036343 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:19:19.036318 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:19:20.042984 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:20.042962 2555 scope.go:117] "RemoveContainer" containerID="0c168a680d799ba108ecc0857b7bfcc05cf21c88331ff063772940905796eaba" Sep 10 12:19:20.043373 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:19:20.043159 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:19:21.291994 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:21.291960 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8qvb7"] Sep 10 12:19:25.598761 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:25.598714 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:25.599182 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:25.598787 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:25.599182 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:25.598806 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:25.599182 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:25.598820 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:25.599295 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:25.599193 2555 scope.go:117] "RemoveContainer" containerID="0c168a680d799ba108ecc0857b7bfcc05cf21c88331ff063772940905796eaba" Sep 10 12:19:25.599401 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:19:25.599380 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:19:29.493171 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:29.493135 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8qvb7"] Sep 10 12:19:39.108134 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:39.108094 2555 scope.go:117] "RemoveContainer" containerID="0c168a680d799ba108ecc0857b7bfcc05cf21c88331ff063772940905796eaba" Sep 10 12:19:40.136382 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:40.136346 2555 generic.go:356] "Generic (PLEG): container finished" podID="d2444682-577f-4348-810d-a774328a9a97" containerID="a0c967b81ceaddcb4c37c6f1680194b6543a3a10aa098866773534b8ba6d291f" exitCode=0 Sep 10 12:19:40.136778 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:40.136389 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" event={"ID":"d2444682-577f-4348-810d-a774328a9a97","Type":"ContainerDied","Data":"a0c967b81ceaddcb4c37c6f1680194b6543a3a10aa098866773534b8ba6d291f"} Sep 10 12:19:40.136778 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:40.136444 2555 scope.go:117] "RemoveContainer" containerID="0c168a680d799ba108ecc0857b7bfcc05cf21c88331ff063772940905796eaba" Sep 10 12:19:40.136900 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:40.136791 2555 scope.go:117] "RemoveContainer" containerID="a0c967b81ceaddcb4c37c6f1680194b6543a3a10aa098866773534b8ba6d291f" Sep 10 12:19:40.137035 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:19:40.137010 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:19:41.475618 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.475579 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w"] Sep 10 12:19:41.480723 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.480701 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.482867 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.482847 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 10 12:19:41.488019 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.487994 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w"] Sep 10 12:19:41.601905 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.601868 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bd536d0-cc02-4fb9-acf0-f025633c11d6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.602151 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.601916 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bd536d0-cc02-4fb9-acf0-f025633c11d6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.602151 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.601998 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd536d0-cc02-4fb9-acf0-f025633c11d6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.602151 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.602094 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl5qn\" (UniqueName: \"kubernetes.io/projected/5bd536d0-cc02-4fb9-acf0-f025633c11d6-kube-api-access-sl5qn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.602151 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.602127 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bd536d0-cc02-4fb9-acf0-f025633c11d6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.602354 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.602153 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bd536d0-cc02-4fb9-acf0-f025633c11d6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.702865 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.702831 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bd536d0-cc02-4fb9-acf0-f025633c11d6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.702865 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.702866 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bd536d0-cc02-4fb9-acf0-f025633c11d6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.703112 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.702909 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd536d0-cc02-4fb9-acf0-f025633c11d6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.703112 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.702951 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl5qn\" (UniqueName: \"kubernetes.io/projected/5bd536d0-cc02-4fb9-acf0-f025633c11d6-kube-api-access-sl5qn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.703112 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.702968 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bd536d0-cc02-4fb9-acf0-f025633c11d6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.703112 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.702994 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bd536d0-cc02-4fb9-acf0-f025633c11d6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.703329 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.703281 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bd536d0-cc02-4fb9-acf0-f025633c11d6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.703390 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.703370 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bd536d0-cc02-4fb9-acf0-f025633c11d6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.703429 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.703385 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bd536d0-cc02-4fb9-acf0-f025633c11d6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.705220 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.705188 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bd536d0-cc02-4fb9-acf0-f025633c11d6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.705403 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.705385 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd536d0-cc02-4fb9-acf0-f025633c11d6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.712560 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.712537 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl5qn\" (UniqueName: \"kubernetes.io/projected/5bd536d0-cc02-4fb9-acf0-f025633c11d6-kube-api-access-sl5qn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w\" (UID: \"5bd536d0-cc02-4fb9-acf0-f025633c11d6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:41.792040 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:41.791969 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:42.068851 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:42.068825 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w"] Sep 10 12:19:42.071319 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:19:42.071293 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd536d0_cc02_4fb9_acf0_f025633c11d6.slice/crio-20e9acb339e5e7d4c40978c909b2401916cc9f774501cb1408801d60bf93d6e2 WatchSource:0}: Error finding container 20e9acb339e5e7d4c40978c909b2401916cc9f774501cb1408801d60bf93d6e2: Status 404 returned error can't find the container with id 20e9acb339e5e7d4c40978c909b2401916cc9f774501cb1408801d60bf93d6e2 Sep 10 12:19:42.148480 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:42.148445 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" event={"ID":"5bd536d0-cc02-4fb9-acf0-f025633c11d6","Type":"ContainerStarted","Data":"20e9acb339e5e7d4c40978c909b2401916cc9f774501cb1408801d60bf93d6e2"} Sep 10 12:19:42.982185 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:42.982149 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8qvb7"] Sep 10 12:19:43.154890 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:43.154850 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" event={"ID":"5bd536d0-cc02-4fb9-acf0-f025633c11d6","Type":"ContainerStarted","Data":"83c1f7554dcb870cf1dfd4f93925b261fa6fdba0a94ff3d9862b3093ee0ef43d"} Sep 10 12:19:43.174001 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:43.173957 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" podStartSLOduration=1.979473917 podStartE2EDuration="2.173940032s" totalImagesPullingTime="194.466115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:19:43.171829751 +0000 UTC m=+616.611718003" watchObservedRunningTime="2026-09-10 12:19:43.173940032 +0000 UTC m=+616.613828265" Sep 10 12:19:45.598839 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:45.598798 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:45.599259 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:45.598861 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:45.599259 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:45.598878 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:45.599259 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:45.598893 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:19:45.599382 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:45.599261 2555 scope.go:117] "RemoveContainer" containerID="a0c967b81ceaddcb4c37c6f1680194b6543a3a10aa098866773534b8ba6d291f" Sep 10 12:19:45.599447 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:19:45.599427 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:19:49.679649 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:49.679567 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8qvb7"] Sep 10 12:19:51.792909 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:51.792867 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:51.793325 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:51.792942 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:51.805263 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:51.805236 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:19:52.207334 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:19:52.207307 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w" Sep 10 12:20:00.108878 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:00.108843 2555 scope.go:117] "RemoveContainer" containerID="a0c967b81ceaddcb4c37c6f1680194b6543a3a10aa098866773534b8ba6d291f" Sep 10 12:20:00.109303 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:00.109169 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:20:01.241940 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:01.241904 2555 generic.go:356] "Generic (PLEG): container finished" podID="d2444682-577f-4348-810d-a774328a9a97" containerID="f03cd48af9a16095e4343c06f183e4fb14559e624581d13c0efaafed8a9b2328" exitCode=0 Sep 10 12:20:01.242422 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:01.241970 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" event={"ID":"d2444682-577f-4348-810d-a774328a9a97","Type":"ContainerDied","Data":"f03cd48af9a16095e4343c06f183e4fb14559e624581d13c0efaafed8a9b2328"} Sep 10 12:20:01.242422 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:01.242041 2555 scope.go:117] "RemoveContainer" containerID="a0c967b81ceaddcb4c37c6f1680194b6543a3a10aa098866773534b8ba6d291f" Sep 10 12:20:01.242537 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:01.242458 2555 scope.go:117] "RemoveContainer" containerID="f03cd48af9a16095e4343c06f183e4fb14559e624581d13c0efaafed8a9b2328" Sep 10 12:20:01.242736 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:20:01.242715 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:20:04.578496 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.578465 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq"] Sep 10 12:20:04.581907 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.581888 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.584091 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.584044 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 10 12:20:04.595221 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.595195 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq"] Sep 10 12:20:04.617388 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.617356 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61933dcb-0327-4a2e-bd61-fb0eba253f25-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.617535 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.617403 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61933dcb-0327-4a2e-bd61-fb0eba253f25-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.617535 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.617486 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61933dcb-0327-4a2e-bd61-fb0eba253f25-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.617535 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.617520 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61933dcb-0327-4a2e-bd61-fb0eba253f25-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.617644 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.617595 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct5rc\" (UniqueName: \"kubernetes.io/projected/61933dcb-0327-4a2e-bd61-fb0eba253f25-kube-api-access-ct5rc\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.617644 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.617617 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61933dcb-0327-4a2e-bd61-fb0eba253f25-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.718410 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.718368 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61933dcb-0327-4a2e-bd61-fb0eba253f25-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.718562 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.718436 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61933dcb-0327-4a2e-bd61-fb0eba253f25-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.718562 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.718463 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61933dcb-0327-4a2e-bd61-fb0eba253f25-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.718562 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.718491 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61933dcb-0327-4a2e-bd61-fb0eba253f25-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.718562 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.718514 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61933dcb-0327-4a2e-bd61-fb0eba253f25-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.718562 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.718548 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct5rc\" (UniqueName: \"kubernetes.io/projected/61933dcb-0327-4a2e-bd61-fb0eba253f25-kube-api-access-ct5rc\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.718940 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.718793 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61933dcb-0327-4a2e-bd61-fb0eba253f25-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.718940 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.718850 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61933dcb-0327-4a2e-bd61-fb0eba253f25-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.718940 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.718923 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61933dcb-0327-4a2e-bd61-fb0eba253f25-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.720764 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.720746 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61933dcb-0327-4a2e-bd61-fb0eba253f25-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.721029 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.721004 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61933dcb-0327-4a2e-bd61-fb0eba253f25-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.725837 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.725810 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct5rc\" (UniqueName: \"kubernetes.io/projected/61933dcb-0327-4a2e-bd61-fb0eba253f25-kube-api-access-ct5rc\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq\" (UID: \"61933dcb-0327-4a2e-bd61-fb0eba253f25\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:04.890994 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:04.890907 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:05.163641 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:05.163615 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq"] Sep 10 12:20:05.165484 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:20:05.165455 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61933dcb_0327_4a2e_bd61_fb0eba253f25.slice/crio-991d0c8c17697d8e98ca3af47c0170240c9c908fbdd9dff90cc3857b8027f8a5 WatchSource:0}: Error finding container 991d0c8c17697d8e98ca3af47c0170240c9c908fbdd9dff90cc3857b8027f8a5: Status 404 returned error can't find the container with id 991d0c8c17697d8e98ca3af47c0170240c9c908fbdd9dff90cc3857b8027f8a5 Sep 10 12:20:05.264754 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:05.264719 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" event={"ID":"61933dcb-0327-4a2e-bd61-fb0eba253f25","Type":"ContainerStarted","Data":"991d0c8c17697d8e98ca3af47c0170240c9c908fbdd9dff90cc3857b8027f8a5"} Sep 10 12:20:05.598590 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:05.598549 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:20:05.598977 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:05.598612 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:20:05.598977 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:05.598628 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:20:05.598977 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:05.598644 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:20:05.599115 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:05.598988 2555 scope.go:117] "RemoveContainer" containerID="f03cd48af9a16095e4343c06f183e4fb14559e624581d13c0efaafed8a9b2328" Sep 10 12:20:05.599222 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:20:05.599204 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:20:06.271267 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:06.271228 2555 generic.go:356] "Generic (PLEG): container finished" podID="61933dcb-0327-4a2e-bd61-fb0eba253f25" containerID="9c98dd5681214ec0358eef3b37e528d781838b0eaa99e70696802a86f0c87e88" exitCode=0 Sep 10 12:20:06.271480 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:06.271268 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" event={"ID":"61933dcb-0327-4a2e-bd61-fb0eba253f25","Type":"ContainerDied","Data":"9c98dd5681214ec0358eef3b37e528d781838b0eaa99e70696802a86f0c87e88"} Sep 10 12:20:06.271614 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:06.271597 2555 scope.go:117] "RemoveContainer" containerID="9c98dd5681214ec0358eef3b37e528d781838b0eaa99e70696802a86f0c87e88" Sep 10 12:20:06.988033 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:06.987993 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-8qvb7"] Sep 10 12:20:07.278249 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:07.278162 2555 generic.go:356] "Generic (PLEG): container finished" podID="61933dcb-0327-4a2e-bd61-fb0eba253f25" containerID="71a0ef433dbf753b9d680c7afa35ac02e2fe875a86926b7eb98300a9282d0cb7" exitCode=0 Sep 10 12:20:07.278249 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:07.278203 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" event={"ID":"61933dcb-0327-4a2e-bd61-fb0eba253f25","Type":"ContainerDied","Data":"71a0ef433dbf753b9d680c7afa35ac02e2fe875a86926b7eb98300a9282d0cb7"} Sep 10 12:20:07.278249 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:07.278239 2555 scope.go:117] "RemoveContainer" containerID="9c98dd5681214ec0358eef3b37e528d781838b0eaa99e70696802a86f0c87e88" Sep 10 12:20:07.278516 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:07.278499 2555 scope.go:117] "RemoveContainer" containerID="71a0ef433dbf753b9d680c7afa35ac02e2fe875a86926b7eb98300a9282d0cb7" Sep 10 12:20:07.278701 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:20:07.278683 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:20:08.285611 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:08.285567 2555 scope.go:117] "RemoveContainer" containerID="71a0ef433dbf753b9d680c7afa35ac02e2fe875a86926b7eb98300a9282d0cb7" Sep 10 12:20:08.285999 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:20:08.285783 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:20:14.892054 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:14.892016 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:14.892054 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:14.892063 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:14.892488 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:14.892095 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:14.892488 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:14.892105 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:14.892488 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:14.892470 2555 scope.go:117] "RemoveContainer" containerID="71a0ef433dbf753b9d680c7afa35ac02e2fe875a86926b7eb98300a9282d0cb7" Sep 10 12:20:14.892660 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:20:14.892642 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:20:19.113938 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:19.113909 2555 scope.go:117] "RemoveContainer" containerID="f03cd48af9a16095e4343c06f183e4fb14559e624581d13c0efaafed8a9b2328" Sep 10 12:20:19.114329 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:20:19.114145 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:20:28.108851 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:28.108816 2555 scope.go:117] "RemoveContainer" containerID="71a0ef433dbf753b9d680c7afa35ac02e2fe875a86926b7eb98300a9282d0cb7" Sep 10 12:20:28.390793 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:28.390739 2555 generic.go:356] "Generic (PLEG): container finished" podID="61933dcb-0327-4a2e-bd61-fb0eba253f25" containerID="f3d89e0f094785833c65343b58dd2a5bc8c87df5aca070482d3882806532ec0e" exitCode=0 Sep 10 12:20:28.390956 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:28.390847 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" event={"ID":"61933dcb-0327-4a2e-bd61-fb0eba253f25","Type":"ContainerDied","Data":"f3d89e0f094785833c65343b58dd2a5bc8c87df5aca070482d3882806532ec0e"} Sep 10 12:20:28.390956 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:28.390891 2555 scope.go:117] "RemoveContainer" containerID="71a0ef433dbf753b9d680c7afa35ac02e2fe875a86926b7eb98300a9282d0cb7" Sep 10 12:20:28.391632 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:28.391606 2555 scope.go:117] "RemoveContainer" containerID="f3d89e0f094785833c65343b58dd2a5bc8c87df5aca070482d3882806532ec0e" Sep 10 12:20:28.392255 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:20:28.392227 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:20:32.109037 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:32.109008 2555 scope.go:117] "RemoveContainer" containerID="f03cd48af9a16095e4343c06f183e4fb14559e624581d13c0efaafed8a9b2328" Sep 10 12:20:32.109443 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:20:32.109228 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:20:34.891874 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:34.891835 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:34.892375 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:34.891952 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:34.892375 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:34.892112 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:34.892375 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:34.892143 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:20:34.892375 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:34.892304 2555 scope.go:117] "RemoveContainer" containerID="f3d89e0f094785833c65343b58dd2a5bc8c87df5aca070482d3882806532ec0e" Sep 10 12:20:34.892511 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:20:34.892480 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:20:35.426365 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:35.426338 2555 scope.go:117] "RemoveContainer" containerID="f3d89e0f094785833c65343b58dd2a5bc8c87df5aca070482d3882806532ec0e" Sep 10 12:20:35.426550 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:20:35.426525 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:20:47.111225 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:47.111190 2555 scope.go:117] "RemoveContainer" containerID="f03cd48af9a16095e4343c06f183e4fb14559e624581d13c0efaafed8a9b2328" Sep 10 12:20:47.111813 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:47.111454 2555 scope.go:117] "RemoveContainer" containerID="f3d89e0f094785833c65343b58dd2a5bc8c87df5aca070482d3882806532ec0e" Sep 10 12:20:47.111813 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:20:47.111629 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:20:47.490870 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:47.490840 2555 generic.go:356] "Generic (PLEG): container finished" podID="d2444682-577f-4348-810d-a774328a9a97" containerID="ca371e5d75ea6a9eac91760469110c0c12fe102ddaccf05d5ac0a83e09dd1922" exitCode=0 Sep 10 12:20:47.491093 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:47.490918 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" event={"ID":"d2444682-577f-4348-810d-a774328a9a97","Type":"ContainerDied","Data":"ca371e5d75ea6a9eac91760469110c0c12fe102ddaccf05d5ac0a83e09dd1922"} Sep 10 12:20:47.491093 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:47.490989 2555 scope.go:117] "RemoveContainer" containerID="f03cd48af9a16095e4343c06f183e4fb14559e624581d13c0efaafed8a9b2328" Sep 10 12:20:47.491408 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:47.491391 2555 scope.go:117] "RemoveContainer" containerID="ca371e5d75ea6a9eac91760469110c0c12fe102ddaccf05d5ac0a83e09dd1922" Sep 10 12:20:47.491621 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:20:47.491600 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:20:55.598697 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:55.598659 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:20:55.599230 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:55.598720 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:20:55.599230 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:55.598736 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:20:55.599230 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:55.598750 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:20:55.599230 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:55.599141 2555 scope.go:117] "RemoveContainer" containerID="ca371e5d75ea6a9eac91760469110c0c12fe102ddaccf05d5ac0a83e09dd1922" Sep 10 12:20:55.599370 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:20:55.599320 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:20:58.108682 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:58.108651 2555 scope.go:117] "RemoveContainer" containerID="f3d89e0f094785833c65343b58dd2a5bc8c87df5aca070482d3882806532ec0e" Sep 10 12:20:58.547642 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:58.547597 2555 generic.go:356] "Generic (PLEG): container finished" podID="61933dcb-0327-4a2e-bd61-fb0eba253f25" containerID="560a8b260e08750a181bd3c7227344598c17a191f4a3bac3171f34bb0a5d33ba" exitCode=0 Sep 10 12:20:58.547829 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:58.547656 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" event={"ID":"61933dcb-0327-4a2e-bd61-fb0eba253f25","Type":"ContainerDied","Data":"560a8b260e08750a181bd3c7227344598c17a191f4a3bac3171f34bb0a5d33ba"} Sep 10 12:20:58.547829 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:58.547716 2555 scope.go:117] "RemoveContainer" containerID="f3d89e0f094785833c65343b58dd2a5bc8c87df5aca070482d3882806532ec0e" Sep 10 12:20:58.548155 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:20:58.548137 2555 scope.go:117] "RemoveContainer" containerID="560a8b260e08750a181bd3c7227344598c17a191f4a3bac3171f34bb0a5d33ba" Sep 10 12:20:58.548366 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:20:58.548343 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:21:04.891878 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:04.891839 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:21:04.892519 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:04.891893 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:21:04.892519 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:04.891908 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:21:04.892519 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:04.891920 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:21:04.892519 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:04.892429 2555 scope.go:117] "RemoveContainer" containerID="560a8b260e08750a181bd3c7227344598c17a191f4a3bac3171f34bb0a5d33ba" Sep 10 12:21:04.892730 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:21:04.892657 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:21:07.111203 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:07.111170 2555 scope.go:117] "RemoveContainer" containerID="ca371e5d75ea6a9eac91760469110c0c12fe102ddaccf05d5ac0a83e09dd1922" Sep 10 12:21:07.111675 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:21:07.111421 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:21:19.109103 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:19.109020 2555 scope.go:117] "RemoveContainer" containerID="560a8b260e08750a181bd3c7227344598c17a191f4a3bac3171f34bb0a5d33ba" Sep 10 12:21:19.109543 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:21:19.109268 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:21:22.108057 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:22.108026 2555 scope.go:117] "RemoveContainer" containerID="ca371e5d75ea6a9eac91760469110c0c12fe102ddaccf05d5ac0a83e09dd1922" Sep 10 12:21:22.108460 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:21:22.108237 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:21:32.109218 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:32.109185 2555 scope.go:117] "RemoveContainer" containerID="560a8b260e08750a181bd3c7227344598c17a191f4a3bac3171f34bb0a5d33ba" Sep 10 12:21:32.109697 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:21:32.109348 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:21:36.108559 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:36.108521 2555 scope.go:117] "RemoveContainer" containerID="ca371e5d75ea6a9eac91760469110c0c12fe102ddaccf05d5ac0a83e09dd1922" Sep 10 12:21:36.109014 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:21:36.108760 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:21:45.108329 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:45.108295 2555 scope.go:117] "RemoveContainer" containerID="560a8b260e08750a181bd3c7227344598c17a191f4a3bac3171f34bb0a5d33ba" Sep 10 12:21:45.783236 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:45.783202 2555 generic.go:356] "Generic (PLEG): container finished" podID="61933dcb-0327-4a2e-bd61-fb0eba253f25" containerID="f9a33e5b2637abfb00ca348a3a0e066823bc1d5f89b23da902c6a84e6c69a043" exitCode=0 Sep 10 12:21:45.783443 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:45.783280 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" event={"ID":"61933dcb-0327-4a2e-bd61-fb0eba253f25","Type":"ContainerDied","Data":"f9a33e5b2637abfb00ca348a3a0e066823bc1d5f89b23da902c6a84e6c69a043"} Sep 10 12:21:45.783443 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:45.783340 2555 scope.go:117] "RemoveContainer" containerID="560a8b260e08750a181bd3c7227344598c17a191f4a3bac3171f34bb0a5d33ba" Sep 10 12:21:45.783746 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:45.783729 2555 scope.go:117] "RemoveContainer" containerID="f9a33e5b2637abfb00ca348a3a0e066823bc1d5f89b23da902c6a84e6c69a043" Sep 10 12:21:45.783921 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:21:45.783904 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:21:48.108479 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:48.108451 2555 scope.go:117] "RemoveContainer" containerID="ca371e5d75ea6a9eac91760469110c0c12fe102ddaccf05d5ac0a83e09dd1922" Sep 10 12:21:48.108852 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:21:48.108636 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:21:54.891497 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:54.891453 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:21:54.891497 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:54.891502 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:21:54.892004 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:54.891512 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:21:54.892004 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:54.891523 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:21:54.892004 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:21:54.891862 2555 scope.go:117] "RemoveContainer" containerID="f9a33e5b2637abfb00ca348a3a0e066823bc1d5f89b23da902c6a84e6c69a043" Sep 10 12:21:54.892126 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:21:54.892015 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:22:01.108381 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:01.108344 2555 scope.go:117] "RemoveContainer" containerID="ca371e5d75ea6a9eac91760469110c0c12fe102ddaccf05d5ac0a83e09dd1922" Sep 10 12:22:01.109199 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:22:01.108531 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:22:09.108248 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:09.108219 2555 scope.go:117] "RemoveContainer" containerID="f9a33e5b2637abfb00ca348a3a0e066823bc1d5f89b23da902c6a84e6c69a043" Sep 10 12:22:09.108695 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:22:09.108382 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:22:13.108587 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:13.108560 2555 scope.go:117] "RemoveContainer" containerID="ca371e5d75ea6a9eac91760469110c0c12fe102ddaccf05d5ac0a83e09dd1922" Sep 10 12:22:13.919940 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:13.919907 2555 generic.go:356] "Generic (PLEG): container finished" podID="d2444682-577f-4348-810d-a774328a9a97" containerID="88f4d239951ac0522c219b12773f8c36f13f523463af3686dcb620d0444f3b51" exitCode=0 Sep 10 12:22:13.919940 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:13.919943 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" event={"ID":"d2444682-577f-4348-810d-a774328a9a97","Type":"ContainerDied","Data":"88f4d239951ac0522c219b12773f8c36f13f523463af3686dcb620d0444f3b51"} Sep 10 12:22:13.920225 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:13.919988 2555 scope.go:117] "RemoveContainer" containerID="ca371e5d75ea6a9eac91760469110c0c12fe102ddaccf05d5ac0a83e09dd1922" Sep 10 12:22:13.920389 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:13.920370 2555 scope.go:117] "RemoveContainer" containerID="88f4d239951ac0522c219b12773f8c36f13f523463af3686dcb620d0444f3b51" Sep 10 12:22:13.920580 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:22:13.920558 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:22:15.599285 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:15.599251 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:22:15.599748 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:15.599311 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:22:15.599748 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:15.599327 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:22:15.599748 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:15.599340 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" Sep 10 12:22:15.599748 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:15.599666 2555 scope.go:117] "RemoveContainer" containerID="88f4d239951ac0522c219b12773f8c36f13f523463af3686dcb620d0444f3b51" Sep 10 12:22:15.599873 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:22:15.599822 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:22:20.108193 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:20.108164 2555 scope.go:117] "RemoveContainer" containerID="f9a33e5b2637abfb00ca348a3a0e066823bc1d5f89b23da902c6a84e6c69a043" Sep 10 12:22:20.108549 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:22:20.108337 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:22:29.108611 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:29.108577 2555 scope.go:117] "RemoveContainer" containerID="88f4d239951ac0522c219b12773f8c36f13f523463af3686dcb620d0444f3b51" Sep 10 12:22:29.109049 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:22:29.108808 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:22:35.109039 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:35.109004 2555 scope.go:117] "RemoveContainer" containerID="f9a33e5b2637abfb00ca348a3a0e066823bc1d5f89b23da902c6a84e6c69a043" Sep 10 12:22:35.109503 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:22:35.109187 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:22:40.108585 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:40.108557 2555 scope.go:117] "RemoveContainer" containerID="88f4d239951ac0522c219b12773f8c36f13f523463af3686dcb620d0444f3b51" Sep 10 12:22:40.108972 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:22:40.108754 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:22:46.108327 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:46.108299 2555 scope.go:117] "RemoveContainer" containerID="f9a33e5b2637abfb00ca348a3a0e066823bc1d5f89b23da902c6a84e6c69a043" Sep 10 12:22:46.108688 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:22:46.108474 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:22:51.108877 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:22:51.108806 2555 scope.go:117] "RemoveContainer" containerID="88f4d239951ac0522c219b12773f8c36f13f523463af3686dcb620d0444f3b51" Sep 10 12:22:51.109303 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:22:51.108966 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:23:00.108162 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:00.108128 2555 scope.go:117] "RemoveContainer" containerID="f9a33e5b2637abfb00ca348a3a0e066823bc1d5f89b23da902c6a84e6c69a043" Sep 10 12:23:00.108622 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:23:00.108301 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:23:06.108178 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:06.108147 2555 scope.go:117] "RemoveContainer" containerID="88f4d239951ac0522c219b12773f8c36f13f523463af3686dcb620d0444f3b51" Sep 10 12:23:06.108609 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:23:06.108309 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:23:14.108978 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:14.108947 2555 scope.go:117] "RemoveContainer" containerID="f9a33e5b2637abfb00ca348a3a0e066823bc1d5f89b23da902c6a84e6c69a043" Sep 10 12:23:15.206466 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:15.206430 2555 generic.go:356] "Generic (PLEG): container finished" podID="61933dcb-0327-4a2e-bd61-fb0eba253f25" containerID="8dea4750d39d5fff775b9859834726af906592e1ec822c9ab4e39387f9010568" exitCode=0 Sep 10 12:23:15.206930 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:15.206491 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" event={"ID":"61933dcb-0327-4a2e-bd61-fb0eba253f25","Type":"ContainerDied","Data":"8dea4750d39d5fff775b9859834726af906592e1ec822c9ab4e39387f9010568"} Sep 10 12:23:15.206930 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:15.206524 2555 scope.go:117] "RemoveContainer" containerID="f9a33e5b2637abfb00ca348a3a0e066823bc1d5f89b23da902c6a84e6c69a043" Sep 10 12:23:15.206930 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:15.206870 2555 scope.go:117] "RemoveContainer" containerID="8dea4750d39d5fff775b9859834726af906592e1ec822c9ab4e39387f9010568" Sep 10 12:23:15.207113 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:23:15.207094 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:23:17.115984 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:17.115955 2555 scope.go:117] "RemoveContainer" containerID="88f4d239951ac0522c219b12773f8c36f13f523463af3686dcb620d0444f3b51" Sep 10 12:23:17.116389 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:23:17.116159 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:23:24.891435 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:24.891402 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:23:24.891871 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:24.891447 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:23:24.891871 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:24.891458 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:23:24.891871 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:24.891467 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" Sep 10 12:23:24.891871 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:24.891759 2555 scope.go:117] "RemoveContainer" containerID="8dea4750d39d5fff775b9859834726af906592e1ec822c9ab4e39387f9010568" Sep 10 12:23:24.892005 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:23:24.891923 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:23:32.109005 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:32.108960 2555 scope.go:117] "RemoveContainer" containerID="88f4d239951ac0522c219b12773f8c36f13f523463af3686dcb620d0444f3b51" Sep 10 12:23:32.109475 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:23:32.109185 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:23:37.111048 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:37.111017 2555 scope.go:117] "RemoveContainer" containerID="8dea4750d39d5fff775b9859834726af906592e1ec822c9ab4e39387f9010568" Sep 10 12:23:37.111547 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:23:37.111278 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:23:44.108760 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:44.108725 2555 scope.go:117] "RemoveContainer" containerID="88f4d239951ac0522c219b12773f8c36f13f523463af3686dcb620d0444f3b51" Sep 10 12:23:44.109354 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:23:44.108908 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:23:50.108646 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:50.108616 2555 scope.go:117] "RemoveContainer" containerID="8dea4750d39d5fff775b9859834726af906592e1ec822c9ab4e39387f9010568" Sep 10 12:23:50.109097 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:23:50.108772 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:23:56.108524 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:23:56.108495 2555 scope.go:117] "RemoveContainer" containerID="88f4d239951ac0522c219b12773f8c36f13f523463af3686dcb620d0444f3b51" Sep 10 12:23:56.108896 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:23:56.108683 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:24:05.108503 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:05.108470 2555 scope.go:117] "RemoveContainer" containerID="8dea4750d39d5fff775b9859834726af906592e1ec822c9ab4e39387f9010568" Sep 10 12:24:05.108883 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:24:05.108641 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:24:05.832207 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:05.832178 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c75f74b49-nshrr_ee553c52-efbc-4222-9e39-7b6c753c9ee7/copy-manifests/0.log" Sep 10 12:24:05.845111 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:05.845083 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c75f74b49-nshrr_ee553c52-efbc-4222-9e39-7b6c753c9ee7/manager/0.log" Sep 10 12:24:07.330628 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:07.330595 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-zq74b_9132ec50-fdb0-4145-a88f-c1382086976b/kuadrant-console-plugin/0.log" Sep 10 12:24:07.544550 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:07.544523 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-8qvb7_a113cd98-8ef1-48b2-874f-cd1b039a444f/limitador/0.log" Sep 10 12:24:08.303889 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:08.303828 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cf4544794-xzdfz_1f5584b9-dd6b-4051-8777-6fd29375eb7e/kube-auth-proxy/0.log" Sep 10 12:24:09.208514 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:09.208488 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-6685d86975-w88sf_d2444682-577f-4348-810d-a774328a9a97/main/5.log" Sep 10 12:24:09.524827 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:09.524750 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgms4w_5bd536d0-cc02-4fb9-acf0-f025633c11d6/main/0.log" Sep 10 12:24:09.729112 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:09.729083 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_61933dcb-0327-4a2e-bd61-fb0eba253f25/main/5.log" Sep 10 12:24:10.108879 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:10.108852 2555 scope.go:117] "RemoveContainer" containerID="88f4d239951ac0522c219b12773f8c36f13f523463af3686dcb620d0444f3b51" Sep 10 12:24:10.109044 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:24:10.109015 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:24:18.563561 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:18.563526 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xwkm4_9a81a977-6e78-4a35-bd30-af9397a90af6/global-pull-secret-syncer/0.log" Sep 10 12:24:18.675947 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:18.675919 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wv4xx_20293890-fc1c-4d9e-b3dd-d2e759f9006c/konnectivity-agent/0.log" Sep 10 12:24:18.767308 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:18.767279 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-28.ec2.internal_270566bf61107e37921a529016c765e7/haproxy/0.log" Sep 10 12:24:19.108517 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:19.108442 2555 scope.go:117] "RemoveContainer" containerID="8dea4750d39d5fff775b9859834726af906592e1ec822c9ab4e39387f9010568" Sep 10 12:24:19.108683 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:24:19.108660 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:24:22.558514 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:22.558488 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-zq74b_9132ec50-fdb0-4145-a88f-c1382086976b/kuadrant-console-plugin/0.log" Sep 10 12:24:22.643798 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:22.643775 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-8qvb7_a113cd98-8ef1-48b2-874f-cd1b039a444f/limitador/0.log" Sep 10 12:24:24.384211 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:24.384186 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_50ddb12b-1f50-4b1e-a5ae-7ad8875db358/alertmanager/0.log" Sep 10 12:24:24.409756 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:24.409731 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_50ddb12b-1f50-4b1e-a5ae-7ad8875db358/config-reloader/0.log" Sep 10 12:24:24.433087 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:24.433051 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_50ddb12b-1f50-4b1e-a5ae-7ad8875db358/kube-rbac-proxy-web/0.log" Sep 10 12:24:24.456446 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:24.456430 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_50ddb12b-1f50-4b1e-a5ae-7ad8875db358/kube-rbac-proxy/0.log" Sep 10 12:24:24.484546 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:24.484528 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_50ddb12b-1f50-4b1e-a5ae-7ad8875db358/kube-rbac-proxy-metric/0.log" Sep 10 12:24:24.508482 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:24.508460 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_50ddb12b-1f50-4b1e-a5ae-7ad8875db358/prom-label-proxy/0.log" Sep 10 12:24:24.543632 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:24.543583 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_50ddb12b-1f50-4b1e-a5ae-7ad8875db358/init-config-reloader/0.log" Sep 10 12:24:24.640396 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:24.640376 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-xpb48_1277d546-5b24-422f-8cdf-8e948452297b/kube-state-metrics/0.log" Sep 10 12:24:24.669487 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:24.669466 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-xpb48_1277d546-5b24-422f-8cdf-8e948452297b/kube-rbac-proxy-main/0.log" Sep 10 12:24:24.701096 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:24.701064 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-xpb48_1277d546-5b24-422f-8cdf-8e948452297b/kube-rbac-proxy-self/0.log" Sep 10 12:24:24.736795 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:24.736777 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6d5599ff9f-7hmds_565c4aa9-3ff1-48af-8bcf-cc6f2cb41c9f/metrics-server/0.log" Sep 10 12:24:24.772803 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:24.772782 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-72qxb_d259a3b3-fa17-4b02-8e97-b6be268e8f64/monitoring-plugin/0.log" Sep 10 12:24:24.897515 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:24.897490 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pm9cx_eb122167-7438-4a13-8180-775494053f0d/node-exporter/0.log" Sep 10 12:24:24.927917 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:24.927894 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pm9cx_eb122167-7438-4a13-8180-775494053f0d/kube-rbac-proxy/0.log" Sep 10 12:24:24.950682 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:24.950664 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pm9cx_eb122167-7438-4a13-8180-775494053f0d/init-textfile/0.log" Sep 10 12:24:25.073026 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.073004 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-df48q_644b2ea1-47fe-438c-b99a-ca044e3ad3aa/kube-rbac-proxy-main/0.log" Sep 10 12:24:25.105260 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.105239 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-df48q_644b2ea1-47fe-438c-b99a-ca044e3ad3aa/kube-rbac-proxy-self/0.log" Sep 10 12:24:25.108400 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.108384 2555 scope.go:117] "RemoveContainer" containerID="88f4d239951ac0522c219b12773f8c36f13f523463af3686dcb620d0444f3b51" Sep 10 12:24:25.108568 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:24:25.108550 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:24:25.138686 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.138628 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-df48q_644b2ea1-47fe-438c-b99a-ca044e3ad3aa/openshift-state-metrics/0.log" Sep 10 12:24:25.184149 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.184132 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ef9bb62-c342-4a47-b70c-3979dcfe97da/prometheus/0.log" Sep 10 12:24:25.257386 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.257364 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ef9bb62-c342-4a47-b70c-3979dcfe97da/config-reloader/0.log" Sep 10 12:24:25.306555 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.306536 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ef9bb62-c342-4a47-b70c-3979dcfe97da/thanos-sidecar/0.log" Sep 10 12:24:25.343491 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.343472 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ef9bb62-c342-4a47-b70c-3979dcfe97da/kube-rbac-proxy-web/0.log" Sep 10 12:24:25.372780 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.372766 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ef9bb62-c342-4a47-b70c-3979dcfe97da/kube-rbac-proxy/0.log" Sep 10 12:24:25.398925 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.398876 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ef9bb62-c342-4a47-b70c-3979dcfe97da/kube-rbac-proxy-thanos/0.log" Sep 10 12:24:25.429139 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.429120 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ef9bb62-c342-4a47-b70c-3979dcfe97da/init-config-reloader/0.log" Sep 10 12:24:25.461663 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.461641 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-hz6z4_b92ee30d-637d-456c-ab0b-761b78e9f101/prometheus-operator/0.log" Sep 10 12:24:25.487793 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.487777 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-hz6z4_b92ee30d-637d-456c-ab0b-761b78e9f101/kube-rbac-proxy/0.log" Sep 10 12:24:25.517933 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.517915 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-9fq5x_e289a864-7824-4ffe-b5a3-0587b4da5e0d/prometheus-operator-admission-webhook/0.log" Sep 10 12:24:25.556078 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.556054 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c7466b7cf-psxjp_61360982-b7dd-442d-93c0-9cda13501a1f/telemeter-client/0.log" Sep 10 12:24:25.580992 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.580974 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c7466b7cf-psxjp_61360982-b7dd-442d-93c0-9cda13501a1f/reload/0.log" Sep 10 12:24:25.603670 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.603653 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c7466b7cf-psxjp_61360982-b7dd-442d-93c0-9cda13501a1f/kube-rbac-proxy/0.log" Sep 10 12:24:25.647672 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.643747 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84fb7b76cd-pfcbc_edf46728-d985-4362-816a-a591652a6122/thanos-query/0.log" Sep 10 12:24:25.669915 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.669867 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84fb7b76cd-pfcbc_edf46728-d985-4362-816a-a591652a6122/kube-rbac-proxy-web/0.log" Sep 10 12:24:25.693781 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.693765 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84fb7b76cd-pfcbc_edf46728-d985-4362-816a-a591652a6122/kube-rbac-proxy/0.log" Sep 10 12:24:25.725210 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.725188 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84fb7b76cd-pfcbc_edf46728-d985-4362-816a-a591652a6122/prom-label-proxy/0.log" Sep 10 12:24:25.751921 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.751900 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84fb7b76cd-pfcbc_edf46728-d985-4362-816a-a591652a6122/kube-rbac-proxy-rules/0.log" Sep 10 12:24:25.782188 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:25.782167 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84fb7b76cd-pfcbc_edf46728-d985-4362-816a-a591652a6122/kube-rbac-proxy-metrics/0.log" Sep 10 12:24:28.673524 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:28.673486 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-db8564fff-ggrtp_4c74e177-b7b5-41b8-b69d-b707a46060a3/console/0.log" Sep 10 12:24:29.298425 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.298396 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl"] Sep 10 12:24:29.301904 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.301887 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.304387 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.304364 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lhj2m\"/\"default-dockercfg-tzk24\"" Sep 10 12:24:29.304537 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.304518 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lhj2m\"/\"openshift-service-ca.crt\"" Sep 10 12:24:29.305013 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.304998 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lhj2m\"/\"kube-root-ca.crt\"" Sep 10 12:24:29.308958 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.308605 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl"] Sep 10 12:24:29.470024 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.469994 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9-sys\") pod \"perf-node-gather-daemonset-2bdzl\" (UID: \"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.470187 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.470045 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq866\" (UniqueName: \"kubernetes.io/projected/da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9-kube-api-access-sq866\") pod \"perf-node-gather-daemonset-2bdzl\" (UID: \"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.470187 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.470086 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9-podres\") pod \"perf-node-gather-daemonset-2bdzl\" (UID: \"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.470187 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.470119 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9-lib-modules\") pod \"perf-node-gather-daemonset-2bdzl\" (UID: \"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.470187 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.470181 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9-proc\") pod \"perf-node-gather-daemonset-2bdzl\" (UID: \"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.571326 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.571261 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq866\" (UniqueName: \"kubernetes.io/projected/da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9-kube-api-access-sq866\") pod \"perf-node-gather-daemonset-2bdzl\" (UID: \"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.571326 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.571291 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9-podres\") pod \"perf-node-gather-daemonset-2bdzl\" (UID: \"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.571326 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.571313 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9-lib-modules\") pod \"perf-node-gather-daemonset-2bdzl\" (UID: \"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.571554 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.571392 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9-proc\") pod \"perf-node-gather-daemonset-2bdzl\" (UID: \"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.571554 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.571417 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9-sys\") pod \"perf-node-gather-daemonset-2bdzl\" (UID: \"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.571554 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.571448 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9-podres\") pod \"perf-node-gather-daemonset-2bdzl\" (UID: \"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.571554 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.571515 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9-lib-modules\") pod \"perf-node-gather-daemonset-2bdzl\" (UID: \"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.571554 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.571538 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9-proc\") pod \"perf-node-gather-daemonset-2bdzl\" (UID: \"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.571717 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.571563 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9-sys\") pod \"perf-node-gather-daemonset-2bdzl\" (UID: \"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.580060 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.580037 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq866\" (UniqueName: \"kubernetes.io/projected/da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9-kube-api-access-sq866\") pod \"perf-node-gather-daemonset-2bdzl\" (UID: \"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9\") " pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.613018 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.612998 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:29.889162 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:29.889137 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl"] Sep 10 12:24:29.891412 ip-10-0-142-28 kubenswrapper[2555]: W0910 12:24:29.891384 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podda6edcc0_99cf_4a9f_bb1c_7769fcd55ae9.slice/crio-2af09c76d12d9cbc39d0a20d4f5faaf2e76e8c9a9de895c251abf6fd041e1683 WatchSource:0}: Error finding container 2af09c76d12d9cbc39d0a20d4f5faaf2e76e8c9a9de895c251abf6fd041e1683: Status 404 returned error can't find the container with id 2af09c76d12d9cbc39d0a20d4f5faaf2e76e8c9a9de895c251abf6fd041e1683 Sep 10 12:24:30.568456 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:30.568423 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" event={"ID":"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9","Type":"ContainerStarted","Data":"d5737683f2d7b9be450eb341ad0e3f7f80155221adf4bdc02340be037aeba54b"} Sep 10 12:24:30.568633 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:30.568475 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" event={"ID":"da6edcc0-99cf-4a9f-bb1c-7769fcd55ae9","Type":"ContainerStarted","Data":"2af09c76d12d9cbc39d0a20d4f5faaf2e76e8c9a9de895c251abf6fd041e1683"} Sep 10 12:24:30.568633 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:30.568499 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:30.583558 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:30.583510 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" podStartSLOduration=1.583495617 podStartE2EDuration="1.583495617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:24:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:24:30.582580785 +0000 UTC m=+904.022469031" watchObservedRunningTime="2026-09-10 12:24:30.583495617 +0000 UTC m=+904.023383842" Sep 10 12:24:30.607727 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:30.607706 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vv8np_d63e3a79-328d-4ba5-85d9-061bf56bb22c/dns/0.log" Sep 10 12:24:30.627796 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:30.627778 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vv8np_d63e3a79-328d-4ba5-85d9-061bf56bb22c/kube-rbac-proxy/0.log" Sep 10 12:24:30.700158 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:30.700133 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-znmg7_1ecb68cc-bba4-4a6c-863f-5b946518e907/dns-node-resolver/0.log" Sep 10 12:24:31.264303 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:31.264273 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k5r2r_0f00f889-5c53-45e7-9b18-0d0f6cd156c2/node-ca/0.log" Sep 10 12:24:32.343191 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:32.343164 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cf4544794-xzdfz_1f5584b9-dd6b-4051-8777-6fd29375eb7e/kube-auth-proxy/0.log" Sep 10 12:24:33.117436 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:33.117412 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pshwm_1b91d97b-3893-4ef0-a425-4cec10dbb7c6/serve-healthcheck-canary/0.log" Sep 10 12:24:33.695215 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:33.695189 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fm4t6_9369ef1c-feea-4223-9bcf-a1a4e094fd3d/kube-rbac-proxy/0.log" Sep 10 12:24:33.715814 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:33.715788 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fm4t6_9369ef1c-feea-4223-9bcf-a1a4e094fd3d/exporter/0.log" Sep 10 12:24:33.743513 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:33.743493 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fm4t6_9369ef1c-feea-4223-9bcf-a1a4e094fd3d/extractor/0.log" Sep 10 12:24:34.108662 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:34.108601 2555 scope.go:117] "RemoveContainer" containerID="8dea4750d39d5fff775b9859834726af906592e1ec822c9ab4e39387f9010568" Sep 10 12:24:34.108783 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:24:34.108747 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:24:36.258853 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:36.258824 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c75f74b49-nshrr_ee553c52-efbc-4222-9e39-7b6c753c9ee7/manager/0.log" Sep 10 12:24:36.279600 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:36.279575 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c75f74b49-nshrr_ee553c52-efbc-4222-9e39-7b6c753c9ee7/copy-manifests/0.log" Sep 10 12:24:36.582696 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:36.582626 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lhj2m/perf-node-gather-daemonset-2bdzl" Sep 10 12:24:37.458795 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:37.458764 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-86cfb8b7dd-2nt8d_1375e625-ec7b-4f36-92ef-91e33e64a40e/manager/0.log" Sep 10 12:24:37.543992 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:37.543966 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-tj5qd_b2823f9f-400d-4ee0-99a4-efdf71db282e/openshift-lws-operator/0.log" Sep 10 12:24:39.108607 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:39.108486 2555 scope.go:117] "RemoveContainer" containerID="88f4d239951ac0522c219b12773f8c36f13f523463af3686dcb620d0444f3b51" Sep 10 12:24:39.126952 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:24:39.108701 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-w88sf_llm(d2444682-577f-4348-810d-a774328a9a97)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-w88sf" podUID="d2444682-577f-4348-810d-a774328a9a97" Sep 10 12:24:39.441033 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:39.441004 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cf4544794-xzdfz_1f5584b9-dd6b-4051-8777-6fd29375eb7e/kube-auth-proxy/0.log" Sep 10 12:24:40.801619 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:40.801589 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cf4544794-xzdfz_1f5584b9-dd6b-4051-8777-6fd29375eb7e/kube-auth-proxy/0.log" Sep 10 12:24:45.068156 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:45.068084 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fh5k8_61bafc2e-da2c-4b35-8555-b19f06728459/kube-multus-additional-cni-plugins/0.log" Sep 10 12:24:45.091681 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:45.091659 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fh5k8_61bafc2e-da2c-4b35-8555-b19f06728459/egress-router-binary-copy/0.log" Sep 10 12:24:45.116198 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:45.116175 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fh5k8_61bafc2e-da2c-4b35-8555-b19f06728459/cni-plugins/0.log" Sep 10 12:24:45.139856 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:45.139837 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fh5k8_61bafc2e-da2c-4b35-8555-b19f06728459/bond-cni-plugin/0.log" Sep 10 12:24:45.165954 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:45.165938 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fh5k8_61bafc2e-da2c-4b35-8555-b19f06728459/routeoverride-cni/0.log" Sep 10 12:24:45.183939 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:45.183919 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fh5k8_61bafc2e-da2c-4b35-8555-b19f06728459/whereabouts-cni-bincopy/0.log" Sep 10 12:24:45.212988 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:45.212969 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fh5k8_61bafc2e-da2c-4b35-8555-b19f06728459/whereabouts-cni/0.log" Sep 10 12:24:45.428050 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:45.427981 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nxgbv_73c9c1ff-fd19-429d-bfcb-858770cc3aa8/kube-multus/0.log" Sep 10 12:24:45.519918 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:45.519890 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-58d7t_6909e322-42f0-4d07-af43-4b79e0e8fc17/network-metrics-daemon/0.log" Sep 10 12:24:45.541564 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:45.541541 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-58d7t_6909e322-42f0-4d07-af43-4b79e0e8fc17/kube-rbac-proxy/0.log" Sep 10 12:24:46.108554 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:46.108526 2555 scope.go:117] "RemoveContainer" containerID="8dea4750d39d5fff775b9859834726af906592e1ec822c9ab4e39387f9010568" Sep 10 12:24:46.108994 ip-10-0-142-28 kubenswrapper[2555]: E0910 12:24:46.108750 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq_llm(61933dcb-0327-4a2e-bd61-fb0eba253f25)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-5rkcq" podUID="61933dcb-0327-4a2e-bd61-fb0eba253f25" Sep 10 12:24:46.724537 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:46.724511 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-49qv8_0dd9a703-4cbe-48b5-9c53-5c5a69c97706/ovn-controller/0.log" Sep 10 12:24:46.744526 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:46.744503 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-49qv8_0dd9a703-4cbe-48b5-9c53-5c5a69c97706/ovn-acl-logging/0.log" Sep 10 12:24:46.767824 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:46.767804 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-49qv8_0dd9a703-4cbe-48b5-9c53-5c5a69c97706/kube-rbac-proxy-node/0.log" Sep 10 12:24:46.790200 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:46.790169 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-49qv8_0dd9a703-4cbe-48b5-9c53-5c5a69c97706/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 12:24:46.815236 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:46.815217 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-49qv8_0dd9a703-4cbe-48b5-9c53-5c5a69c97706/northd/0.log" Sep 10 12:24:46.845207 ip-10-0-142-28 kubenswrapper[2555]: I0910 12:24:46.845190 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-49qv8_0dd9a703-4cbe-48b5-9c53-5c5a69c97706/nbdb/0.log"