Sep 10 12:19:13.043751 ip-10-0-130-132 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 10 12:19:13.043760 ip-10-0-130-132 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 10 12:19:13.043767 ip-10-0-130-132 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 10 12:19:13.044010 ip-10-0-130-132 systemd[1]: Failed to start Kubernetes Kubelet. Sep 10 12:19:23.074562 ip-10-0-130-132 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 10 12:19:23.074582 ip-10-0-130-132 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 074b9ff3924e43e2a8d69d61476d47f4 -- Sep 10 12:21:13.544957 ip-10-0-130-132 systemd[1]: Starting Kubernetes Kubelet... Sep 10 12:21:13.987326 ip-10-0-130-132 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:21:13.987326 ip-10-0-130-132 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 12:21:13.987326 ip-10-0-130-132 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:21:13.987326 ip-10-0-130-132 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 12:21:13.987326 ip-10-0-130-132 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 12:21:13.990183 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:13.990113 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 12:21:13.997548 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997526 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:21:13.997548 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997543 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:21:13.997548 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997547 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:21:13.997548 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997551 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:21:13.997548 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997554 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:21:13.997548 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997557 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997560 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997563 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997566 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997568 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997571 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997577 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997581 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997583 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997589 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997592 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997595 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997599 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997604 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997607 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997610 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997613 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997615 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997621 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:21:13.997791 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997623 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997626 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997629 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997632 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997635 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997637 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997640 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997642 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997645 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997647 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997650 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997652 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997657 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997660 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997663 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997667 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997669 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997672 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997676 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:21:13.998274 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997680 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997683 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997686 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997688 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997691 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997709 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997712 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997715 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997718 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997721 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997723 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997726 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997730 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997732 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997735 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997738 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997740 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997745 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997748 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997751 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:21:13.998800 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997754 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997756 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997759 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997762 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997764 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997767 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997770 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997772 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997776 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997779 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997784 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997787 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997789 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997792 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997795 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997798 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997801 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997804 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997807 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:21:13.999357 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997811 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997815 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997821 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997824 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997827 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997829 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997832 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997835 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997837 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997840 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997843 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997845 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997848 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997850 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997853 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997858 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.997861 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998934 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998942 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:21:13.999866 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998945 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998949 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998955 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998959 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998962 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998964 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998967 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998970 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998973 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998975 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998978 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998982 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998986 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998989 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998994 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.998997 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999000 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999002 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999005 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999007 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:21:14.000349 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999010 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999012 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999015 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999018 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999020 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999023 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999025 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999030 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999033 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999036 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999038 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999041 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999044 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999047 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999050 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999053 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999055 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999058 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999061 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999066 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:21:14.001011 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999069 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999073 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999075 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999078 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999081 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999084 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999086 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999089 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999092 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999094 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999097 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999102 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999105 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999107 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999110 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999115 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999118 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999122 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999125 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:21:14.001535 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999127 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999130 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999133 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999136 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999139 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999144 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999146 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999149 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999152 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999155 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999157 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999160 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999163 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999167 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999170 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999172 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999177 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999180 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999183 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:21:14.002066 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999186 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999189 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999192 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999194 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999197 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999200 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999202 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999204 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999207 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999210 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999215 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999218 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999220 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999223 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999225 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999228 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999230 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999233 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999236 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999836 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:21:14.002570 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999842 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999845 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999848 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999853 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999856 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999858 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999861 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999864 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999867 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999870 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999873 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999876 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999879 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999882 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999884 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999889 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999892 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999895 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999899 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999902 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:21:14.003140 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999906 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999909 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999911 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999916 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999919 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999923 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999926 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999932 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999935 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999938 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999941 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999944 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999947 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999949 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999952 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999954 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999957 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999960 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999963 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:21:14.003655 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999965 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999971 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999973 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999976 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999978 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999981 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999984 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999986 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999989 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999991 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999994 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:13.999996 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000000 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000005 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000008 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000010 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000013 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000016 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000018 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000021 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:21:14.004163 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000023 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000026 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000028 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000031 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000034 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000039 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000042 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000044 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000047 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000049 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000052 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000055 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000057 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000060 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000062 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000065 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000068 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000070 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000075 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000078 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:21:14.004712 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000081 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000084 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000087 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000089 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000092 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000094 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000099 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000101 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000104 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000107 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000112 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000115 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000117 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000120 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000122 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000125 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000127 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000132 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.000135 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000343 2574 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 12:21:14.005237 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000471 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000481 2574 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000485 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000490 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000493 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000505 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000510 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000513 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000516 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000519 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000522 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000525 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000528 2574 flags.go:64] FLAG: --cgroup-root="" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000532 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000535 2574 flags.go:64] FLAG: --client-ca-file="" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000538 2574 flags.go:64] FLAG: --cloud-provider="external" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000541 2574 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000545 2574 flags.go:64] FLAG: --cluster-domain="" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000548 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000551 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000554 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000557 2574 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000561 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 12:21:14.005793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000564 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000567 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000570 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000573 2574 flags.go:64] FLAG: --contention-profiling="false" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000576 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000579 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000582 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000585 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000589 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000594 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000598 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000600 2574 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000603 2574 flags.go:64] FLAG: --enable-server="true" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000608 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000614 2574 flags.go:64] FLAG: --event-burst="100" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000619 2574 flags.go:64] FLAG: --event-qps="50" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000621 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000626 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000630 2574 flags.go:64] FLAG: --eviction-hard="" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000636 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000638 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000644 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000647 2574 flags.go:64] FLAG: --eviction-soft="" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000650 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000654 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 12:21:14.006388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000657 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000661 2574 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000664 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000668 2574 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000671 2574 flags.go:64] FLAG: --feature-gates="" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000676 2574 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000680 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000683 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000688 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000691 2574 flags.go:64] FLAG: --healthz-port="10248" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000694 2574 flags.go:64] FLAG: --help="false" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000708 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000711 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000714 2574 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000717 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000720 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000726 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000729 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000732 2574 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000735 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000738 2574 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000741 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000744 2574 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000747 2574 flags.go:64] FLAG: --kube-reserved="" Sep 10 12:21:14.007119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000750 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000753 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000755 2574 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000758 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000761 2574 flags.go:64] FLAG: --lock-file="" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000763 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000766 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000769 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000774 2574 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000779 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000781 2574 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000784 2574 flags.go:64] FLAG: --logging-format="text" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000787 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000790 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000793 2574 flags.go:64] FLAG: --manifest-url="" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000796 2574 flags.go:64] FLAG: --manifest-url-header="" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000800 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000803 2574 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000807 2574 flags.go:64] FLAG: --max-pods="110" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000810 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000813 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000816 2574 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000819 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000822 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000825 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 12:21:14.007765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000829 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000837 2574 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000840 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000843 2574 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000846 2574 flags.go:64] FLAG: --pod-cidr="" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000849 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000854 2574 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000857 2574 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000860 2574 flags.go:64] FLAG: --pods-per-core="0" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000863 2574 flags.go:64] FLAG: --port="10250" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000866 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000869 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05f8295047a65db92" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000872 2574 flags.go:64] FLAG: --qos-reserved="" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000875 2574 flags.go:64] FLAG: --read-only-port="10255" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000878 2574 flags.go:64] FLAG: --register-node="true" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000881 2574 flags.go:64] FLAG: --register-with-taints="" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000884 2574 flags.go:64] FLAG: --registry-burst="10" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000888 2574 flags.go:64] FLAG: --registry-qps="5" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000890 2574 flags.go:64] FLAG: --reserved-cpus="" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000893 2574 flags.go:64] FLAG: --reserved-memory="" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000896 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000899 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000902 2574 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000905 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000908 2574 flags.go:64] FLAG: --runonce="false" Sep 10 12:21:14.008455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000910 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000913 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000916 2574 flags.go:64] FLAG: --seccomp-default="false" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000919 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000922 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000925 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000928 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000931 2574 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000934 2574 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000937 2574 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000940 2574 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000943 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000946 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000949 2574 flags.go:64] FLAG: --system-cgroups="" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000951 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000958 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000961 2574 flags.go:64] FLAG: --tls-cert-file="" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000963 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000968 2574 flags.go:64] FLAG: --tls-min-version="" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000970 2574 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000973 2574 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000976 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000978 2574 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000981 2574 flags.go:64] FLAG: --v="2" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000985 2574 flags.go:64] FLAG: --version="false" Sep 10 12:21:14.009111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000989 2574 flags.go:64] FLAG: --vmodule="" Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000993 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.000996 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001111 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001116 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001119 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001122 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001124 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001127 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001129 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001132 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001135 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001138 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001142 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001147 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001149 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001152 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001154 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001157 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001159 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:21:14.009787 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001162 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001165 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001167 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001170 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001172 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001175 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001177 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001181 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001185 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001187 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001190 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001193 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001195 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001198 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001201 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001203 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001206 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001208 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001210 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001213 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:21:14.010296 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001215 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001218 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001220 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001222 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001225 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001228 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001233 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001235 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001237 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001240 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001243 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001245 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001247 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001250 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001253 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001255 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001259 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001263 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001265 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001268 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:21:14.010874 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001271 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001274 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001276 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001280 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001284 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001287 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001292 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001295 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001298 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001300 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001302 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001305 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001307 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001310 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001312 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001314 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001317 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001321 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001324 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:21:14.011402 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001327 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001329 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001332 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001334 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001337 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001339 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001342 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001344 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001347 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001349 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001352 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001354 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001357 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001359 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001362 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001364 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001366 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001369 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001371 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001374 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:21:14.011930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001377 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:21:14.012478 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001380 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:21:14.012478 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.001384 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:21:14.012478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.001391 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:21:14.012478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.008614 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 12:21:14.012478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.008630 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 12:21:14.012478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.009581 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 12:21:14.012478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.009591 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 12:21:14.012478 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009648 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:21:14.012478 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009653 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:21:14.012478 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009656 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:21:14.012478 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009659 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:21:14.012478 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009662 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:21:14.012478 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009665 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:21:14.012478 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009667 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009670 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009673 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009675 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009678 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009680 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009683 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009686 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009688 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009690 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009693 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009695 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009714 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009717 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009720 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009723 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009725 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009728 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009731 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009734 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:21:14.012873 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009736 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009739 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009741 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009745 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009748 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009751 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009753 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009756 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009758 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009761 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009763 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009766 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009769 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009771 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009774 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009776 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009779 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009782 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009784 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:21:14.013387 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009787 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009791 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009795 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009798 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009801 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009804 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009807 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009809 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009812 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009814 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009817 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009820 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009823 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009825 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009828 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009832 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009836 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009839 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009842 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:21:14.013907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009845 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009848 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009850 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009853 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009855 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009857 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009860 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009862 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009865 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009867 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009870 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009872 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009875 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009877 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009880 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009882 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009885 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009887 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009889 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009892 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009894 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:21:14.014399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009897 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:21:14.015035 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009900 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:21:14.015035 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009904 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:21:14.015035 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009907 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:21:14.015035 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009910 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:21:14.015035 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009913 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:21:14.015035 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009916 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:21:14.015035 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009918 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:21:14.015035 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009921 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:21:14.015035 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009923 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:21:14.015035 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009926 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:21:14.015035 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009928 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:21:14.015035 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009931 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:21:14.015035 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.009933 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:21:14.015035 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.009938 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010045 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010049 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010053 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010055 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010058 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010061 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010063 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010066 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010068 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010072 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010075 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010078 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010080 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010083 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010085 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010088 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010091 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010093 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 12:21:14.015404 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010096 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010098 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010101 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010103 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010106 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010109 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010111 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010114 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010118 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010121 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010124 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010127 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010130 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010132 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010135 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010137 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010139 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010142 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010144 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010147 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 12:21:14.015907 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010149 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010151 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010154 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010156 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010159 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010162 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010164 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010167 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010169 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010172 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010174 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010177 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010179 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010182 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010184 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010186 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010189 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010191 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010195 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 12:21:14.016419 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010198 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010201 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010204 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010207 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010210 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010212 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010215 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010217 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010220 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010222 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010225 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010227 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010229 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010232 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010234 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010237 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010239 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010242 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010244 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010246 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 12:21:14.016922 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010249 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010253 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010256 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010259 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010261 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010263 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010266 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010268 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010271 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010273 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010275 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010278 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010281 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010283 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010286 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010288 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010290 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010293 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010295 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010298 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010301 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 12:21:14.017428 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:14.010304 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 12:21:14.018014 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.010309 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 12:21:14.018014 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.010402 2574 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 12:21:14.018014 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.014505 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 12:21:14.018014 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.015442 2574 server.go:1019] "Starting client certificate rotation" Sep 10 12:21:14.018014 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.015543 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 12:21:14.018014 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.015568 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 12:21:14.018537 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.018523 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 12:21:14.021547 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.021531 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 12:21:14.039253 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.039237 2574 log.go:25] "Validated CRI v1 runtime API" Sep 10 12:21:14.043830 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.043816 2574 log.go:25] "Validated CRI v1 image API" Sep 10 12:21:14.044736 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.044719 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 12:21:14.050453 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.050420 2574 fs.go:135] Filesystem UUIDs: map[13cfb1cb-a2dc-47c3-9bf5-1dd186357159:/dev/nvme0n1p3 338cafef-8aa3-478e-8414-87d39ebbbc73:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 10 12:21:14.050453 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.050447 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 12:21:14.056057 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.055949 2574 manager.go:216] Machine: {Timestamp:2026-09-10 12:21:14.055486603 +0000 UTC m=+0.384192528 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104886 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eb67e827190699d6cf5a01573dbe4 SystemUUID:ec2eb67e-8271-9069-9d6c-f5a01573dbe4 BootID:074b9ff3-924e-43e2-a8d6-9d61476d47f4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:29:cc:d3:4d:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:29:cc:d3:4d:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:ce:a3:cb:32:18 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 12:21:14.056057 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.056046 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 12:21:14.056176 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.056114 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 12:21:14.057755 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.057737 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 12:21:14.059400 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.059376 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 12:21:14.059527 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.059405 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-132.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 12:21:14.061208 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.061199 2574 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 12:21:14.061241 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.061212 2574 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 12:21:14.061241 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.061219 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 12:21:14.062097 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.062086 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 12:21:14.063076 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.063065 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 12:21:14.067156 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.067144 2574 state_mem.go:36] "Initialized new in-memory state store" Sep 10 12:21:14.067271 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.067261 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 12:21:14.067301 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.067291 2574 kubelet.go:486] "Attempting to sync node with API server" Sep 10 12:21:14.067334 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.067305 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 12:21:14.067334 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.067324 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 12:21:14.067391 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.067338 2574 kubelet.go:398] "Adding apiserver pod source" Sep 10 12:21:14.067391 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.067350 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 12:21:14.067729 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.067717 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 12:21:14.067778 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.067738 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 12:21:14.070137 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.070122 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 12:21:14.072771 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.072755 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 12:21:14.072855 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.072794 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 12:21:14.074217 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.074204 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 12:21:14.074284 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.074226 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 12:21:14.074284 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.074236 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 12:21:14.074284 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.074244 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 12:21:14.074284 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.074255 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 12:21:14.074284 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.074263 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 12:21:14.074284 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.074281 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 12:21:14.074506 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.074291 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 12:21:14.074506 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.074301 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 12:21:14.074506 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.074310 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 12:21:14.074506 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.074329 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 12:21:14.074506 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.074337 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 12:21:14.074506 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.074370 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 12:21:14.074506 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.074379 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 12:21:14.078124 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.078105 2574 server.go:1268] "Started kubelet" Sep 10 12:21:14.078258 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.078207 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 12:21:14.078833 ip-10-0-130-132 systemd[1]: Started Kubernetes Kubelet. Sep 10 12:21:14.078961 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.078816 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 12:21:14.078961 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.078875 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 12:21:14.080588 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.080572 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 12:21:14.080669 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.080618 2574 server.go:310] "Adding debug handlers to kubelet server" Sep 10 12:21:14.081652 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.081627 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-132.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 12:21:14.081764 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.081678 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 12:21:14.081848 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.081812 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-132.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 12:21:14.082801 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.082763 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 12:21:14.084608 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.083539 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-132.ec2.internal.18d3f503e55e10f3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-132.ec2.internal,UID:ip-10-0-130-132.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-132.ec2.internal,},FirstTimestamp:2026-09-10 12:21:14.078073075 +0000 UTC m=+0.406778980,LastTimestamp:2026-09-10 12:21:14.078073075 +0000 UTC m=+0.406778980,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-132.ec2.internal,}" Sep 10 12:21:14.087260 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.087240 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 12:21:14.087346 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.087295 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 12:21:14.087346 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.087335 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-132.ec2.internal\" not found" Sep 10 12:21:14.088079 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.088052 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 12:21:14.088079 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.088073 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 12:21:14.088208 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.088104 2574 factory.go:55] Registering systemd factory Sep 10 12:21:14.088208 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.088117 2574 factory.go:223] Registration of the systemd container factory successfully Sep 10 12:21:14.088208 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.088184 2574 reconstruct.go:97] "Volume reconstruction finished" Sep 10 12:21:14.088208 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.088192 2574 reconciler.go:29] "Reconciler: start to sync state" Sep 10 12:21:14.088475 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.088296 2574 factory.go:153] Registering CRI-O factory Sep 10 12:21:14.088475 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.088307 2574 factory.go:223] Registration of the crio container factory successfully Sep 10 12:21:14.088475 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.088354 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 12:21:14.088475 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.088373 2574 factory.go:103] Registering Raw factory Sep 10 12:21:14.088475 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.088386 2574 manager.go:1196] Started watching for new ooms in manager Sep 10 12:21:14.088803 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.088789 2574 manager.go:349] Starting recovery of all containers Sep 10 12:21:14.089507 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.089482 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 12:21:14.090605 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.090584 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5sg52" Sep 10 12:21:14.093881 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.093745 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-132.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 12:21:14.093881 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.093824 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 12:21:14.100022 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.099824 2574 manager.go:354] Recovery completed Sep 10 12:21:14.100272 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.100239 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5sg52" Sep 10 12:21:14.104432 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.104420 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:21:14.106003 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.105988 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:21:14.106074 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.106012 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:21:14.106074 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.106022 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:21:14.106603 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.106587 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 12:21:14.106603 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.106603 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 12:21:14.106722 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.106631 2574 state_mem.go:36] "Initialized new in-memory state store" Sep 10 12:21:14.106722 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.106591 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:21:14.107406 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.107390 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:21:14.107507 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.107421 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:21:14.107507 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.107437 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:21:14.108678 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.108617 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-132.ec2.internal.18d3f503e708354c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-132.ec2.internal,UID:ip-10-0-130-132.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-132.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-132.ec2.internal,},FirstTimestamp:2026-09-10 12:21:14.106000716 +0000 UTC m=+0.434706620,LastTimestamp:2026-09-10 12:21:14.106000716 +0000 UTC m=+0.434706620,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-132.ec2.internal,}" Sep 10 12:21:14.108854 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.108841 2574 policy_none.go:49] "None policy: Start" Sep 10 12:21:14.108935 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.108861 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 12:21:14.108935 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.108875 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 12:21:14.110946 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.110932 2574 policy_none.go:47] "Start" Sep 10 12:21:14.156553 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.156532 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 12:21:14.170129 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.157265 2574 manager.go:337] "Starting Device Plugin manager" Sep 10 12:21:14.170129 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.157298 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 12:21:14.170129 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.157309 2574 server.go:87] "Starting device plugin registration server" Sep 10 12:21:14.170129 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.157593 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 12:21:14.170129 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.157606 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 12:21:14.170129 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.157727 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 12:21:14.170129 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.157815 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 12:21:14.170129 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.157824 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 12:21:14.170129 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.157988 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 12:21:14.170129 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.158024 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 12:21:14.170129 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.158044 2574 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 12:21:14.170129 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.158089 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 12:21:14.170129 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.158444 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 12:21:14.170129 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.158516 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-132.ec2.internal\" not found" Sep 10 12:21:14.170129 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.160162 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:21:14.258608 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.258543 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-132.ec2.internal"] Sep 10 12:21:14.258608 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.258561 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:21:14.258754 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.258623 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:21:14.259509 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.259492 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:21:14.259560 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.259526 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:21:14.259560 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.259540 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:21:14.259620 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.259561 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.260210 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.260187 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:21:14.260269 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.260224 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:21:14.260269 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.260255 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:21:14.262455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.262443 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:21:14.262611 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.262599 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.262645 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.262625 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:21:14.263120 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.263106 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:21:14.263214 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.263127 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:21:14.263214 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.263140 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:21:14.263214 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.263165 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:21:14.263214 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.263191 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:21:14.263214 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.263208 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:21:14.265333 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.265320 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.265378 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.265344 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 12:21:14.266012 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.265997 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasSufficientMemory" Sep 10 12:21:14.266113 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.266021 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 12:21:14.266113 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.266031 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeHasSufficientPID" Sep 10 12:21:14.269506 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.269491 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.269570 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.269510 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-132.ec2.internal\": node \"ip-10-0-130-132.ec2.internal\" not found" Sep 10 12:21:14.286371 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.286348 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-132.ec2.internal\" not found" Sep 10 12:21:14.288292 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.288277 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-132.ec2.internal\" not found" node="ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.292681 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.292665 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-132.ec2.internal\" not found" node="ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.387170 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.387149 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-132.ec2.internal\" not found" Sep 10 12:21:14.389756 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.389738 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0fc9a15e83fe3b4f3cd821df1a82359f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-132.ec2.internal\" (UID: \"0fc9a15e83fe3b4f3cd821df1a82359f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.389833 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.389764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a228b5d83ce189d4cfc57b40abeb1f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal\" (UID: \"3a228b5d83ce189d4cfc57b40abeb1f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.389833 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.389796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a228b5d83ce189d4cfc57b40abeb1f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal\" (UID: \"3a228b5d83ce189d4cfc57b40abeb1f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.487562 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.487543 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-132.ec2.internal\" not found" Sep 10 12:21:14.490785 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.490773 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a228b5d83ce189d4cfc57b40abeb1f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal\" (UID: \"3a228b5d83ce189d4cfc57b40abeb1f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.490840 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.490792 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a228b5d83ce189d4cfc57b40abeb1f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal\" (UID: \"3a228b5d83ce189d4cfc57b40abeb1f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.490840 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.490810 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0fc9a15e83fe3b4f3cd821df1a82359f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-132.ec2.internal\" (UID: \"0fc9a15e83fe3b4f3cd821df1a82359f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.490912 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.490880 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0fc9a15e83fe3b4f3cd821df1a82359f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-132.ec2.internal\" (UID: \"0fc9a15e83fe3b4f3cd821df1a82359f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.490912 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.490887 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a228b5d83ce189d4cfc57b40abeb1f8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal\" (UID: \"3a228b5d83ce189d4cfc57b40abeb1f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.490974 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.490883 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a228b5d83ce189d4cfc57b40abeb1f8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal\" (UID: \"3a228b5d83ce189d4cfc57b40abeb1f8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.588244 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.588185 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-132.ec2.internal\" not found" Sep 10 12:21:14.591444 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.591428 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.597559 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:14.597542 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-132.ec2.internal" Sep 10 12:21:14.688275 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.688245 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-132.ec2.internal\" not found" Sep 10 12:21:14.788755 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.788729 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-132.ec2.internal\" not found" Sep 10 12:21:14.889266 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.889202 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-132.ec2.internal\" not found" Sep 10 12:21:14.989939 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:14.989914 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-132.ec2.internal\" not found" Sep 10 12:21:15.015198 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:15.015174 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 12:21:15.015342 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:15.015325 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 12:21:15.090006 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:15.089981 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-132.ec2.internal\" not found" Sep 10 12:21:15.105662 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:15.105622 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 12:16:15 +0000 UTC" deadline="2028-06-05 02:27:10.38110515 +0000 UTC" Sep 10 12:21:15.105662 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:15.105652 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15206h5m55.275457074s" Sep 10 12:21:15.105931 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:15.105912 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a228b5d83ce189d4cfc57b40abeb1f8.slice/crio-2a174f7fa18c579562fafb2213b9ac226c72c379c3c1704a31bfa5be9f3388e6 WatchSource:0}: Error finding container 2a174f7fa18c579562fafb2213b9ac226c72c379c3c1704a31bfa5be9f3388e6: Status 404 returned error can't find the container with id 2a174f7fa18c579562fafb2213b9ac226c72c379c3c1704a31bfa5be9f3388e6 Sep 10 12:21:15.106399 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:15.106378 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc9a15e83fe3b4f3cd821df1a82359f.slice/crio-01a3ff6118c422398a340437322998a1be3ba12378cadec3e053289fd495d1e4 WatchSource:0}: Error finding container 01a3ff6118c422398a340437322998a1be3ba12378cadec3e053289fd495d1e4: Status 404 returned error can't find the container with id 01a3ff6118c422398a340437322998a1be3ba12378cadec3e053289fd495d1e4 Sep 10 12:21:15.110333 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:15.110320 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:21:15.137050 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:15.137034 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:21:15.155381 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:15.155341 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:21:15.162049 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:15.162012 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal" event={"ID":"3a228b5d83ce189d4cfc57b40abeb1f8","Type":"ContainerStarted","Data":"2a174f7fa18c579562fafb2213b9ac226c72c379c3c1704a31bfa5be9f3388e6"} Sep 10 12:21:15.163136 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:15.163119 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-132.ec2.internal" event={"ID":"0fc9a15e83fe3b4f3cd821df1a82359f","Type":"ContainerStarted","Data":"01a3ff6118c422398a340437322998a1be3ba12378cadec3e053289fd495d1e4"} Sep 10 12:21:15.188273 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:15.188253 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-132.ec2.internal" Sep 10 12:21:15.197355 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:15.197335 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:21:15.229257 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:15.229235 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 12:21:15.230428 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:15.230417 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal" Sep 10 12:21:15.249893 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:15.249877 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 12:21:17.110771 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.110736 2574 apiserver.go:52] "Watching apiserver" Sep 10 12:21:17.121352 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.121324 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 12:21:17.121722 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.121701 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-bpn7r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal","openshift-multus/multus-gmg5v","openshift-multus/network-metrics-daemon-chlvc","openshift-network-diagnostics/network-check-target-prnjr","openshift-ovn-kubernetes/ovnkube-node-fm7wp","kube-system/global-pull-secret-syncer-w88dt","kube-system/konnectivity-agent-54t2x","kube-system/kube-apiserver-proxy-ip-10-0-130-132.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph","openshift-cluster-node-tuning-operator/tuned-tmxj6","openshift-dns/node-resolver-9n2jk","openshift-multus/multus-additional-cni-plugins-rwlkm","openshift-network-operator/iptables-alerter-bq7sl"] Sep 10 12:21:17.124321 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.124301 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:17.124422 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.124392 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:17.126459 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.126441 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.128541 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.128521 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.128868 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.128854 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 12:21:17.130645 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.130627 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:17.130762 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.130702 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:17.132788 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.132769 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:17.132890 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.132828 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:17.135281 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.135265 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 12:21:17.135484 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.135469 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 12:21:17.135681 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.135665 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 12:21:17.135737 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.135690 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n75dp\"" Sep 10 12:21:17.135987 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.135970 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 12:21:17.135987 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.135990 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x6846\"" Sep 10 12:21:17.136173 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.136160 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 12:21:17.136341 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.136321 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 12:21:17.136381 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.136364 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.137252 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-multus-cni-dir\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.137330 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137258 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-cni-binary-copy\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.137330 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137274 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-run-k8s-cni-cncf-io\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.137330 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137287 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-hostroot\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.137330 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137302 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-etc-kubernetes\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.137330 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137324 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtx8z\" (UniqueName: \"kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z\") pod \"network-check-target-prnjr\" (UID: \"e1c75fe5-5d36-4709-bd85-aec96a0ce2c3\") " pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:17.137639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137346 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7837a526-e410-47f6-8676-b6737e88b1e6-dbus\") pod \"global-pull-secret-syncer-w88dt\" (UID: \"7837a526-e410-47f6-8676-b6737e88b1e6\") " pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:17.137639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137364 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-system-cni-dir\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.137639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137380 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-var-lib-cni-multus\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.137639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137403 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-run-multus-certs\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.137639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137418 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b857cdde-fb6f-46f7-95bb-96227decda7c-system-cni-dir\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.137639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137442 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b857cdde-fb6f-46f7-95bb-96227decda7c-cnibin\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.137639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137468 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b857cdde-fb6f-46f7-95bb-96227decda7c-cni-binary-copy\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.137639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137488 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7837a526-e410-47f6-8676-b6737e88b1e6-kubelet-config\") pod \"global-pull-secret-syncer-w88dt\" (UID: \"7837a526-e410-47f6-8676-b6737e88b1e6\") " pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:17.137639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137514 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b857cdde-fb6f-46f7-95bb-96227decda7c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.137639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137533 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-cnibin\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.137639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137573 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-multus-socket-dir-parent\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.137639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137607 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs\") pod \"network-metrics-daemon-chlvc\" (UID: \"b1def400-ba5c-452a-af47-acdcc7572604\") " pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:17.137639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137631 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b857cdde-fb6f-46f7-95bb-96227decda7c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.138307 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137650 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-var-lib-kubelet\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.138307 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137668 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbwpk\" (UniqueName: \"kubernetes.io/projected/b1def400-ba5c-452a-af47-acdcc7572604-kube-api-access-jbwpk\") pod \"network-metrics-daemon-chlvc\" (UID: \"b1def400-ba5c-452a-af47-acdcc7572604\") " pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:17.138307 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137692 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b857cdde-fb6f-46f7-95bb-96227decda7c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.138307 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137717 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-run-netns\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.138307 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137736 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-multus-conf-dir\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.138307 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137765 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret\") pod \"global-pull-secret-syncer-w88dt\" (UID: \"7837a526-e410-47f6-8676-b6737e88b1e6\") " pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:17.138307 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gb65\" (UniqueName: \"kubernetes.io/projected/b857cdde-fb6f-46f7-95bb-96227decda7c-kube-api-access-6gb65\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.138307 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137812 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-var-lib-cni-bin\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.138307 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137825 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-multus-daemon-config\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.138307 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.137839 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg7wk\" (UniqueName: \"kubernetes.io/projected/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-kube-api-access-wg7wk\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.138307 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.138094 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bq7sl" Sep 10 12:21:17.140014 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.139994 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bpn7r" Sep 10 12:21:17.141069 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.141052 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 12:21:17.141163 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.141054 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 12:21:17.142873 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.142478 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-54t2x" Sep 10 12:21:17.142873 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.142528 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 12:21:17.144048 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.144028 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 12:21:17.144207 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.144045 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 12:21:17.144493 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.144476 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 12:21:17.144684 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.144666 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lkpkw\"" Sep 10 12:21:17.144780 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.144760 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rrpx5\"" Sep 10 12:21:17.144920 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.144895 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.145233 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.145215 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 12:21:17.145687 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.145668 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 12:21:17.145775 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.145756 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 12:21:17.146094 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.146074 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sf6hc\"" Sep 10 12:21:17.146207 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.146095 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 12:21:17.146207 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.146184 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 12:21:17.146520 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.146504 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 12:21:17.146731 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.146716 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:21:17.147222 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.147205 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nxjf5\"" Sep 10 12:21:17.147303 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.147247 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 12:21:17.149393 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.149376 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.151892 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.151533 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9n2jk" Sep 10 12:21:17.152228 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.152205 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 12:21:17.152441 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.152423 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:21:17.152521 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.152433 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k56vv\"" Sep 10 12:21:17.152577 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.152549 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 12:21:17.157260 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.156975 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 12:21:17.157260 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.156993 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 12:21:17.157260 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.157007 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 12:21:17.157260 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.156994 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 12:21:17.157260 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.157124 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9jvxj\"" Sep 10 12:21:17.157538 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.157361 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qx5zl\"" Sep 10 12:21:17.157538 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.157501 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 12:21:17.191357 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.191338 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-crxdd" Sep 10 12:21:17.206048 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.206028 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-crxdd" Sep 10 12:21:17.231674 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.231652 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 12:21:17.238347 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238326 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-multus-cni-dir\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.238453 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238359 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-cni-binary-copy\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.238453 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238384 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-run-k8s-cni-cncf-io\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.238453 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238407 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-hostroot\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.238453 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-etc-kubernetes\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.238654 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238458 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4-serviceca\") pod \"node-ca-bpn7r\" (UID: \"fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4\") " pod="openshift-image-registry/node-ca-bpn7r" Sep 10 12:21:17.238654 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238469 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-multus-cni-dir\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.238654 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238480 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-sysconfig\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.238654 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238502 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-hostroot\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.238654 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238511 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-run-ovn\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.238654 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238538 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.238654 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-cni-bin\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.238654 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238553 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-etc-kubernetes\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.238654 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238589 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t6kl\" (UniqueName: \"kubernetes.io/projected/fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4-kube-api-access-2t6kl\") pod \"node-ca-bpn7r\" (UID: \"fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4\") " pod="openshift-image-registry/node-ca-bpn7r" Sep 10 12:21:17.238654 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238613 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-systemd\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.238654 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238634 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13e01332-4382-4307-b9e9-d3970233bd9b-etc-tuned\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238647 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-run-k8s-cni-cncf-io\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238655 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13e01332-4382-4307-b9e9-d3970233bd9b-tmp\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238706 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-system-cni-dir\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-var-lib-cni-multus\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238771 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b857cdde-fb6f-46f7-95bb-96227decda7c-system-cni-dir\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238806 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b857cdde-fb6f-46f7-95bb-96227decda7c-cnibin\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238830 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b857cdde-fb6f-46f7-95bb-96227decda7c-cni-binary-copy\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238848 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-var-lib-cni-multus\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238865 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b857cdde-fb6f-46f7-95bb-96227decda7c-system-cni-dir\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dd906be-8681-4057-9033-c0abf30b61be-tmp-dir\") pod \"node-resolver-9n2jk\" (UID: \"7dd906be-8681-4057-9033-c0abf30b61be\") " pod="openshift-dns/node-resolver-9n2jk" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238913 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-slash\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238921 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-system-cni-dir\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238921 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b857cdde-fb6f-46f7-95bb-96227decda7c-cnibin\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238936 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-cni-netd\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.238934 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-cni-binary-copy\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239041 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b857cdde-fb6f-46f7-95bb-96227decda7c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.239175 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239066 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7dd906be-8681-4057-9033-c0abf30b61be-hosts-file\") pod \"node-resolver-9n2jk\" (UID: \"7dd906be-8681-4057-9033-c0abf30b61be\") " pod="openshift-dns/node-resolver-9n2jk" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239091 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-run-openvswitch\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239113 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-ovnkube-config\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239132 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-env-overrides\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239171 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/58389d29-7343-493e-9d25-a3e1dc81ce6a-iptables-alerter-script\") pod \"iptables-alerter-bq7sl\" (UID: \"58389d29-7343-493e-9d25-a3e1dc81ce6a\") " pod="openshift-network-operator/iptables-alerter-bq7sl" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239207 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58389d29-7343-493e-9d25-a3e1dc81ce6a-host-slash\") pod \"iptables-alerter-bq7sl\" (UID: \"58389d29-7343-493e-9d25-a3e1dc81ce6a\") " pod="openshift-network-operator/iptables-alerter-bq7sl" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239227 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngn82\" (UniqueName: \"kubernetes.io/projected/e660271a-5e36-4443-886a-6430b2ccc70b-kube-api-access-ngn82\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239259 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-cnibin\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239305 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-cnibin\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239341 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-multus-socket-dir-parent\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239380 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b857cdde-fb6f-46f7-95bb-96227decda7c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239407 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-run-systemd\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239427 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-etc-openvswitch\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239440 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-ovnkube-script-lib\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239453 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-sysctl-conf\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239456 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-multus-socket-dir-parent\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239472 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-lib-modules\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.240117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239476 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b857cdde-fb6f-46f7-95bb-96227decda7c-cni-binary-copy\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239491 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-var-lib-kubelet\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239523 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-var-lib-kubelet\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239545 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b857cdde-fb6f-46f7-95bb-96227decda7c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239575 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-run-netns\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239593 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b857cdde-fb6f-46f7-95bb-96227decda7c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gb65\" (UniqueName: \"kubernetes.io/projected/b857cdde-fb6f-46f7-95bb-96227decda7c-kube-api-access-6gb65\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkrvx\" (UniqueName: \"kubernetes.io/projected/7dd906be-8681-4057-9033-c0abf30b61be-kube-api-access-nkrvx\") pod \"node-resolver-9n2jk\" (UID: \"7dd906be-8681-4057-9033-c0abf30b61be\") " pod="openshift-dns/node-resolver-9n2jk" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239656 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-run-netns\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239656 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-socket-dir\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239700 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg7wk\" (UniqueName: \"kubernetes.io/projected/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-kube-api-access-wg7wk\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239704 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b857cdde-fb6f-46f7-95bb-96227decda7c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239717 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce1f09e0-b23e-483b-bb9a-4727b0a8157e-konnectivity-ca\") pod \"konnectivity-agent-54t2x\" (UID: \"ce1f09e0-b23e-483b-bb9a-4727b0a8157e\") " pod="kube-system/konnectivity-agent-54t2x" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239743 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239824 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b857cdde-fb6f-46f7-95bb-96227decda7c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-modprobe-d\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239860 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-host\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.240909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239875 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtx8z\" (UniqueName: \"kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z\") pod \"network-check-target-prnjr\" (UID: \"e1c75fe5-5d36-4709-bd85-aec96a0ce2c3\") " pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239898 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7837a526-e410-47f6-8676-b6737e88b1e6-dbus\") pod \"global-pull-secret-syncer-w88dt\" (UID: \"7837a526-e410-47f6-8676-b6737e88b1e6\") " pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-systemd-units\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239934 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-registration-dir\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239982 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-sys-fs\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.239995 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-kubernetes\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240008 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qsmf\" (UniqueName: \"kubernetes.io/projected/13e01332-4382-4307-b9e9-d3970233bd9b-kube-api-access-6qsmf\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240009 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7837a526-e410-47f6-8676-b6737e88b1e6-dbus\") pod \"global-pull-secret-syncer-w88dt\" (UID: \"7837a526-e410-47f6-8676-b6737e88b1e6\") " pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240021 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-kubelet\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240063 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-log-socket\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240109 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-ovn-node-metrics-cert\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7ntk\" (UniqueName: \"kubernetes.io/projected/58389d29-7343-493e-9d25-a3e1dc81ce6a-kube-api-access-x7ntk\") pod \"iptables-alerter-bq7sl\" (UID: \"58389d29-7343-493e-9d25-a3e1dc81ce6a\") " pod="openshift-network-operator/iptables-alerter-bq7sl" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240209 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-run-multus-certs\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce1f09e0-b23e-483b-bb9a-4727b0a8157e-agent-certs\") pod \"konnectivity-agent-54t2x\" (UID: \"ce1f09e0-b23e-483b-bb9a-4727b0a8157e\") " pod="kube-system/konnectivity-agent-54t2x" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240283 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-sysctl-d\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240294 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-run-multus-certs\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240306 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7837a526-e410-47f6-8676-b6737e88b1e6-kubelet-config\") pod \"global-pull-secret-syncer-w88dt\" (UID: \"7837a526-e410-47f6-8676-b6737e88b1e6\") " pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:17.241536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-device-dir\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.242106 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240364 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4-host\") pod \"node-ca-bpn7r\" (UID: \"fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4\") " pod="openshift-image-registry/node-ca-bpn7r" Sep 10 12:21:17.242106 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240370 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7837a526-e410-47f6-8676-b6737e88b1e6-kubelet-config\") pod \"global-pull-secret-syncer-w88dt\" (UID: \"7837a526-e410-47f6-8676-b6737e88b1e6\") " pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:17.242106 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs\") pod \"network-metrics-daemon-chlvc\" (UID: \"b1def400-ba5c-452a-af47-acdcc7572604\") " pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:17.242106 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.240483 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:21:17.242106 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.242106 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.240602 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs podName:b1def400-ba5c-452a-af47-acdcc7572604 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:17.740568097 +0000 UTC m=+3.027837753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs") pod "network-metrics-daemon-chlvc" (UID: "b1def400-ba5c-452a-af47-acdcc7572604") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:21:17.242106 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240616 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-var-lib-kubelet\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.242106 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbwpk\" (UniqueName: \"kubernetes.io/projected/b1def400-ba5c-452a-af47-acdcc7572604-kube-api-access-jbwpk\") pod \"network-metrics-daemon-chlvc\" (UID: \"b1def400-ba5c-452a-af47-acdcc7572604\") " pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:17.242106 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240734 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwvgw\" (UniqueName: \"kubernetes.io/projected/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-kube-api-access-gwvgw\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.242106 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240762 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-multus-conf-dir\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.242106 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240789 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret\") pod \"global-pull-secret-syncer-w88dt\" (UID: \"7837a526-e410-47f6-8676-b6737e88b1e6\") " pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:17.242106 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240824 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-node-log\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.242106 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240825 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-multus-conf-dir\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.242106 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240848 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.242106 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.240877 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:21:17.242106 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240882 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-run\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.242662 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.240917 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret podName:7837a526-e410-47f6-8676-b6737e88b1e6 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:17.740903164 +0000 UTC m=+3.028172819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret") pod "global-pull-secret-syncer-w88dt" (UID: "7837a526-e410-47f6-8676-b6737e88b1e6") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:21:17.242662 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240946 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-sys\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.242662 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.240985 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-var-lib-cni-bin\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.242662 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.241008 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-multus-daemon-config\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.242662 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.241030 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-run-netns\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.242662 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.241050 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-host-var-lib-cni-bin\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.242662 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.241051 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-var-lib-openvswitch\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.242662 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.241458 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-multus-daemon-config\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.265859 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.265837 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:21:17.265936 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.265864 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:21:17.265936 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.265877 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rtx8z for pod openshift-network-diagnostics/network-check-target-prnjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:21:17.266053 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.265966 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z podName:e1c75fe5-5d36-4709-bd85-aec96a0ce2c3 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:17.765948587 +0000 UTC m=+3.053218268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rtx8z" (UniqueName: "kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z") pod "network-check-target-prnjr" (UID: "e1c75fe5-5d36-4709-bd85-aec96a0ce2c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:21:17.266747 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.266705 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 12:21:17.271023 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.271002 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbwpk\" (UniqueName: \"kubernetes.io/projected/b1def400-ba5c-452a-af47-acdcc7572604-kube-api-access-jbwpk\") pod \"network-metrics-daemon-chlvc\" (UID: \"b1def400-ba5c-452a-af47-acdcc7572604\") " pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:17.272505 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.272462 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg7wk\" (UniqueName: \"kubernetes.io/projected/0dbc8454-9e65-498f-b7aa-7ef0f40aafda-kube-api-access-wg7wk\") pod \"multus-gmg5v\" (UID: \"0dbc8454-9e65-498f-b7aa-7ef0f40aafda\") " pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.273569 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.273552 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gb65\" (UniqueName: \"kubernetes.io/projected/b857cdde-fb6f-46f7-95bb-96227decda7c-kube-api-access-6gb65\") pod \"multus-additional-cni-plugins-rwlkm\" (UID: \"b857cdde-fb6f-46f7-95bb-96227decda7c\") " pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.342158 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342081 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-log-socket\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.342289 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342185 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-ovn-node-metrics-cert\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.342344 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342270 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-log-socket\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.342344 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342288 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7ntk\" (UniqueName: \"kubernetes.io/projected/58389d29-7343-493e-9d25-a3e1dc81ce6a-kube-api-access-x7ntk\") pod \"iptables-alerter-bq7sl\" (UID: \"58389d29-7343-493e-9d25-a3e1dc81ce6a\") " pod="openshift-network-operator/iptables-alerter-bq7sl" Sep 10 12:21:17.342439 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342340 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce1f09e0-b23e-483b-bb9a-4727b0a8157e-agent-certs\") pod \"konnectivity-agent-54t2x\" (UID: \"ce1f09e0-b23e-483b-bb9a-4727b0a8157e\") " pod="kube-system/konnectivity-agent-54t2x" Sep 10 12:21:17.342439 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342374 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-sysctl-d\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.342439 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342405 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-device-dir\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.342439 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342430 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4-host\") pod \"node-ca-bpn7r\" (UID: \"fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4\") " pod="openshift-image-registry/node-ca-bpn7r" Sep 10 12:21:17.342620 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342480 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.342620 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342510 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-var-lib-kubelet\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.342620 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342536 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwvgw\" (UniqueName: \"kubernetes.io/projected/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-kube-api-access-gwvgw\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.342620 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-node-log\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.342794 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342619 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.342794 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342654 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-run\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.342794 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342682 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-sys\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.342794 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-run-netns\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.342794 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342781 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-var-lib-openvswitch\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.342999 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4-serviceca\") pod \"node-ca-bpn7r\" (UID: \"fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4\") " pod="openshift-image-registry/node-ca-bpn7r" Sep 10 12:21:17.342999 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342844 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-sysconfig\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.342999 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.342903 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-run-ovn\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.343130 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343068 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-node-log\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.343130 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343071 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.343130 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343126 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.343283 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343126 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-cni-bin\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.343283 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343184 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-cni-bin\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.343283 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t6kl\" (UniqueName: \"kubernetes.io/projected/fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4-kube-api-access-2t6kl\") pod \"node-ca-bpn7r\" (UID: \"fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4\") " pod="openshift-image-registry/node-ca-bpn7r" Sep 10 12:21:17.343283 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343232 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-systemd\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.343283 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343266 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13e01332-4382-4307-b9e9-d3970233bd9b-etc-tuned\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.343494 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343296 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13e01332-4382-4307-b9e9-d3970233bd9b-tmp\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.343494 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343332 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dd906be-8681-4057-9033-c0abf30b61be-tmp-dir\") pod \"node-resolver-9n2jk\" (UID: \"7dd906be-8681-4057-9033-c0abf30b61be\") " pod="openshift-dns/node-resolver-9n2jk" Sep 10 12:21:17.343494 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-slash\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.343494 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343388 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-cni-netd\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.343494 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343417 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7dd906be-8681-4057-9033-c0abf30b61be-hosts-file\") pod \"node-resolver-9n2jk\" (UID: \"7dd906be-8681-4057-9033-c0abf30b61be\") " pod="openshift-dns/node-resolver-9n2jk" Sep 10 12:21:17.343494 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-run-openvswitch\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.343733 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343504 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-ovnkube-config\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.343733 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343510 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-run\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.343733 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343529 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-env-overrides\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.343733 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343560 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/58389d29-7343-493e-9d25-a3e1dc81ce6a-iptables-alerter-script\") pod \"iptables-alerter-bq7sl\" (UID: \"58389d29-7343-493e-9d25-a3e1dc81ce6a\") " pod="openshift-network-operator/iptables-alerter-bq7sl" Sep 10 12:21:17.343733 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343580 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-sys\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.343733 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343589 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58389d29-7343-493e-9d25-a3e1dc81ce6a-host-slash\") pod \"iptables-alerter-bq7sl\" (UID: \"58389d29-7343-493e-9d25-a3e1dc81ce6a\") " pod="openshift-network-operator/iptables-alerter-bq7sl" Sep 10 12:21:17.343733 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343618 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngn82\" (UniqueName: \"kubernetes.io/projected/e660271a-5e36-4443-886a-6430b2ccc70b-kube-api-access-ngn82\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.343733 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343631 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-run-netns\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.343733 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343652 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-run-systemd\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.343733 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343681 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-etc-openvswitch\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.343733 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343688 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-var-lib-openvswitch\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.343733 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.343710 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-ovnkube-script-lib\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.344251 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.344122 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4-serviceca\") pod \"node-ca-bpn7r\" (UID: \"fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4\") " pod="openshift-image-registry/node-ca-bpn7r" Sep 10 12:21:17.345359 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.344362 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-slash\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.345359 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.344533 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-sysctl-d\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.345359 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.344592 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-device-dir\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.345359 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.344643 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4-host\") pod \"node-ca-bpn7r\" (UID: \"fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4\") " pod="openshift-image-registry/node-ca-bpn7r" Sep 10 12:21:17.345359 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.344723 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.345359 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.344782 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-var-lib-kubelet\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.345359 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.344952 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-ovn-node-metrics-cert\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.345359 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345096 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-sysconfig\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.345359 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345168 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-run-ovn\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.345359 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345223 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-systemd\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345351 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345450 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-run-openvswitch\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345451 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-sysctl-conf\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345517 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-lib-modules\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345553 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkrvx\" (UniqueName: \"kubernetes.io/projected/7dd906be-8681-4057-9033-c0abf30b61be-kube-api-access-nkrvx\") pod \"node-resolver-9n2jk\" (UID: \"7dd906be-8681-4057-9033-c0abf30b61be\") " pod="openshift-dns/node-resolver-9n2jk" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345587 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-socket-dir\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345621 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce1f09e0-b23e-483b-bb9a-4727b0a8157e-konnectivity-ca\") pod \"konnectivity-agent-54t2x\" (UID: \"ce1f09e0-b23e-483b-bb9a-4727b0a8157e\") " pod="kube-system/konnectivity-agent-54t2x" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345653 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345678 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-modprobe-d\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345708 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-host\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-systemd-units\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345789 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-registration-dir\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345856 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-env-overrides\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345887 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-sys-fs\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345923 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-kubernetes\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345928 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/58389d29-7343-493e-9d25-a3e1dc81ce6a-iptables-alerter-script\") pod \"iptables-alerter-bq7sl\" (UID: \"58389d29-7343-493e-9d25-a3e1dc81ce6a\") " pod="openshift-network-operator/iptables-alerter-bq7sl" Sep 10 12:21:17.346065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345953 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qsmf\" (UniqueName: \"kubernetes.io/projected/13e01332-4382-4307-b9e9-d3970233bd9b-kube-api-access-6qsmf\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345979 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-kubelet\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346062 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-kubelet\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346093 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-sysctl-conf\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346115 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-sys-fs\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346119 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-host-cni-netd\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346195 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-registration-dir\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346219 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-lib-modules\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.345855 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58389d29-7343-493e-9d25-a3e1dc81ce6a-host-slash\") pod \"iptables-alerter-bq7sl\" (UID: \"58389d29-7343-493e-9d25-a3e1dc81ce6a\") " pod="openshift-network-operator/iptables-alerter-bq7sl" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346282 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dd906be-8681-4057-9033-c0abf30b61be-tmp-dir\") pod \"node-resolver-9n2jk\" (UID: \"7dd906be-8681-4057-9033-c0abf30b61be\") " pod="openshift-dns/node-resolver-9n2jk" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346292 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-socket-dir\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346285 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-kubernetes\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346358 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-run-systemd\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346371 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e660271a-5e36-4443-886a-6430b2ccc70b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346413 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-etc-openvswitch\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346431 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7dd906be-8681-4057-9033-c0abf30b61be-hosts-file\") pod \"node-resolver-9n2jk\" (UID: \"7dd906be-8681-4057-9033-c0abf30b61be\") " pod="openshift-dns/node-resolver-9n2jk" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346492 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-host\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346502 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13e01332-4382-4307-b9e9-d3970233bd9b-etc-modprobe-d\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.346787 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346527 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-systemd-units\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.347692 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.346734 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce1f09e0-b23e-483b-bb9a-4727b0a8157e-konnectivity-ca\") pod \"konnectivity-agent-54t2x\" (UID: \"ce1f09e0-b23e-483b-bb9a-4727b0a8157e\") " pod="kube-system/konnectivity-agent-54t2x" Sep 10 12:21:17.347692 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.347022 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-ovnkube-script-lib\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.347792 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.347748 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce1f09e0-b23e-483b-bb9a-4727b0a8157e-agent-certs\") pod \"konnectivity-agent-54t2x\" (UID: \"ce1f09e0-b23e-483b-bb9a-4727b0a8157e\") " pod="kube-system/konnectivity-agent-54t2x" Sep 10 12:21:17.348165 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.348125 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-ovnkube-config\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.348264 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.348168 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13e01332-4382-4307-b9e9-d3970233bd9b-tmp\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.348641 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.348623 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13e01332-4382-4307-b9e9-d3970233bd9b-etc-tuned\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.365048 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.365002 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7ntk\" (UniqueName: \"kubernetes.io/projected/58389d29-7343-493e-9d25-a3e1dc81ce6a-kube-api-access-x7ntk\") pod \"iptables-alerter-bq7sl\" (UID: \"58389d29-7343-493e-9d25-a3e1dc81ce6a\") " pod="openshift-network-operator/iptables-alerter-bq7sl" Sep 10 12:21:17.366497 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.366481 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwvgw\" (UniqueName: \"kubernetes.io/projected/c3aa8845-8086-4c23-92c6-e80ea5bf99a8-kube-api-access-gwvgw\") pod \"ovnkube-node-fm7wp\" (UID: \"c3aa8845-8086-4c23-92c6-e80ea5bf99a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.371986 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.371961 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t6kl\" (UniqueName: \"kubernetes.io/projected/fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4-kube-api-access-2t6kl\") pod \"node-ca-bpn7r\" (UID: \"fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4\") " pod="openshift-image-registry/node-ca-bpn7r" Sep 10 12:21:17.372239 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.372113 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qsmf\" (UniqueName: \"kubernetes.io/projected/13e01332-4382-4307-b9e9-d3970233bd9b-kube-api-access-6qsmf\") pod \"tuned-tmxj6\" (UID: \"13e01332-4382-4307-b9e9-d3970233bd9b\") " pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.373846 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.373818 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngn82\" (UniqueName: \"kubernetes.io/projected/e660271a-5e36-4443-886a-6430b2ccc70b-kube-api-access-ngn82\") pod \"aws-ebs-csi-driver-node-mk6ph\" (UID: \"e660271a-5e36-4443-886a-6430b2ccc70b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.374375 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.374360 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkrvx\" (UniqueName: \"kubernetes.io/projected/7dd906be-8681-4057-9033-c0abf30b61be-kube-api-access-nkrvx\") pod \"node-resolver-9n2jk\" (UID: \"7dd906be-8681-4057-9033-c0abf30b61be\") " pod="openshift-dns/node-resolver-9n2jk" Sep 10 12:21:17.439448 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.439319 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rwlkm" Sep 10 12:21:17.447621 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:17.447602 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb857cdde_fb6f_46f7_95bb_96227decda7c.slice/crio-4e3a7f9be75413d69280d938199f17d816a4c4de5444e2737e7105a3db2a4f5b WatchSource:0}: Error finding container 4e3a7f9be75413d69280d938199f17d816a4c4de5444e2737e7105a3db2a4f5b: Status 404 returned error can't find the container with id 4e3a7f9be75413d69280d938199f17d816a4c4de5444e2737e7105a3db2a4f5b Sep 10 12:21:17.448210 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.448190 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gmg5v" Sep 10 12:21:17.456388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.456371 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:17.456578 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:17.456561 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dbc8454_9e65_498f_b7aa_7ef0f40aafda.slice/crio-d826f87af93c714b6383aa9874339913b4a7c64bb556d8ca820cba49d239a3af WatchSource:0}: Error finding container d826f87af93c714b6383aa9874339913b4a7c64bb556d8ca820cba49d239a3af: Status 404 returned error can't find the container with id d826f87af93c714b6383aa9874339913b4a7c64bb556d8ca820cba49d239a3af Sep 10 12:21:17.462895 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.462876 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bq7sl" Sep 10 12:21:17.464632 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:17.464613 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3aa8845_8086_4c23_92c6_e80ea5bf99a8.slice/crio-0fde98aec5b0ac7d315285e12d1d5f9284b4d41ac21b908e9e8882e28cd0cd0a WatchSource:0}: Error finding container 0fde98aec5b0ac7d315285e12d1d5f9284b4d41ac21b908e9e8882e28cd0cd0a: Status 404 returned error can't find the container with id 0fde98aec5b0ac7d315285e12d1d5f9284b4d41ac21b908e9e8882e28cd0cd0a Sep 10 12:21:17.470210 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.470194 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bpn7r" Sep 10 12:21:17.470650 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:17.470630 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58389d29_7343_493e_9d25_a3e1dc81ce6a.slice/crio-074e97b013f3f136631b47ca4edf84cc2571e264253885c2ac091e54ab16639c WatchSource:0}: Error finding container 074e97b013f3f136631b47ca4edf84cc2571e264253885c2ac091e54ab16639c: Status 404 returned error can't find the container with id 074e97b013f3f136631b47ca4edf84cc2571e264253885c2ac091e54ab16639c Sep 10 12:21:17.476379 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.476358 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-54t2x" Sep 10 12:21:17.479425 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:17.479404 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfedf2f8e_9589_4d6a_ba1f_3f0a664e24d4.slice/crio-7b75075d7f9cfa6d32a97a68871e19c20aa71a7a749b8da223a83739dc337d88 WatchSource:0}: Error finding container 7b75075d7f9cfa6d32a97a68871e19c20aa71a7a749b8da223a83739dc337d88: Status 404 returned error can't find the container with id 7b75075d7f9cfa6d32a97a68871e19c20aa71a7a749b8da223a83739dc337d88 Sep 10 12:21:17.482647 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.482630 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" Sep 10 12:21:17.485177 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:17.485154 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1f09e0_b23e_483b_bb9a_4727b0a8157e.slice/crio-22e5ca87f71da6f8acfa78c650c932b06b8f57f4703aa4aab5053d960edbdb9d WatchSource:0}: Error finding container 22e5ca87f71da6f8acfa78c650c932b06b8f57f4703aa4aab5053d960edbdb9d: Status 404 returned error can't find the container with id 22e5ca87f71da6f8acfa78c650c932b06b8f57f4703aa4aab5053d960edbdb9d Sep 10 12:21:17.489057 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.489037 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" Sep 10 12:21:17.491614 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:17.491596 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode660271a_5e36_4443_886a_6430b2ccc70b.slice/crio-694b0995fbb002fe161d22c0047f8910b27a0db44378db1973b702329c1b529c WatchSource:0}: Error finding container 694b0995fbb002fe161d22c0047f8910b27a0db44378db1973b702329c1b529c: Status 404 returned error can't find the container with id 694b0995fbb002fe161d22c0047f8910b27a0db44378db1973b702329c1b529c Sep 10 12:21:17.494232 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.494207 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9n2jk" Sep 10 12:21:17.498225 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:17.498205 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e01332_4382_4307_b9e9_d3970233bd9b.slice/crio-0aa96a4be5aa3c6f88c4dbecee0688da8fc19dd11c608093e8f4034fea54c9ae WatchSource:0}: Error finding container 0aa96a4be5aa3c6f88c4dbecee0688da8fc19dd11c608093e8f4034fea54c9ae: Status 404 returned error can't find the container with id 0aa96a4be5aa3c6f88c4dbecee0688da8fc19dd11c608093e8f4034fea54c9ae Sep 10 12:21:17.504420 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:17.504399 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd906be_8681_4057_9033_c0abf30b61be.slice/crio-4be658c1b7fb41b5d736724b536108744fadf8d455ae3a445643b58ddba65704 WatchSource:0}: Error finding container 4be658c1b7fb41b5d736724b536108744fadf8d455ae3a445643b58ddba65704: Status 404 returned error can't find the container with id 4be658c1b7fb41b5d736724b536108744fadf8d455ae3a445643b58ddba65704 Sep 10 12:21:17.578937 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.578919 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 12:21:17.749335 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.749309 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs\") pod \"network-metrics-daemon-chlvc\" (UID: \"b1def400-ba5c-452a-af47-acdcc7572604\") " pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:17.749451 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.749354 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret\") pod \"global-pull-secret-syncer-w88dt\" (UID: \"7837a526-e410-47f6-8676-b6737e88b1e6\") " pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:17.749509 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.749463 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:21:17.749509 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.749463 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:21:17.749567 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.749527 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret podName:7837a526-e410-47f6-8676-b6737e88b1e6 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:18.749507562 +0000 UTC m=+4.036777235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret") pod "global-pull-secret-syncer-w88dt" (UID: "7837a526-e410-47f6-8676-b6737e88b1e6") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:21:17.749567 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.749548 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs podName:b1def400-ba5c-452a-af47-acdcc7572604 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:18.74953692 +0000 UTC m=+4.036806587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs") pod "network-metrics-daemon-chlvc" (UID: "b1def400-ba5c-452a-af47-acdcc7572604") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:21:17.850215 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:17.850176 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtx8z\" (UniqueName: \"kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z\") pod \"network-check-target-prnjr\" (UID: \"e1c75fe5-5d36-4709-bd85-aec96a0ce2c3\") " pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:17.850347 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.850313 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:21:17.850347 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.850331 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:21:17.850347 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.850342 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rtx8z for pod openshift-network-diagnostics/network-check-target-prnjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:21:17.850462 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:17.850394 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z podName:e1c75fe5-5d36-4709-bd85-aec96a0ce2c3 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:18.850375817 +0000 UTC m=+4.137645490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtx8z" (UniqueName: "kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z") pod "network-check-target-prnjr" (UID: "e1c75fe5-5d36-4709-bd85-aec96a0ce2c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:21:18.209328 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:18.209287 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 12:16:17 +0000 UTC" deadline="2028-03-12 19:05:40.443289922 +0000 UTC" Sep 10 12:21:18.209328 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:18.209326 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13182h44m22.233968839s" Sep 10 12:21:18.218802 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:18.218771 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9n2jk" event={"ID":"7dd906be-8681-4057-9033-c0abf30b61be","Type":"ContainerStarted","Data":"4be658c1b7fb41b5d736724b536108744fadf8d455ae3a445643b58ddba65704"} Sep 10 12:21:18.231862 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:18.231832 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" event={"ID":"13e01332-4382-4307-b9e9-d3970233bd9b","Type":"ContainerStarted","Data":"0aa96a4be5aa3c6f88c4dbecee0688da8fc19dd11c608093e8f4034fea54c9ae"} Sep 10 12:21:18.234716 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:18.234689 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bpn7r" event={"ID":"fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4","Type":"ContainerStarted","Data":"7b75075d7f9cfa6d32a97a68871e19c20aa71a7a749b8da223a83739dc337d88"} Sep 10 12:21:18.246513 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:18.246478 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bq7sl" event={"ID":"58389d29-7343-493e-9d25-a3e1dc81ce6a","Type":"ContainerStarted","Data":"074e97b013f3f136631b47ca4edf84cc2571e264253885c2ac091e54ab16639c"} Sep 10 12:21:18.267184 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:18.264241 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" event={"ID":"c3aa8845-8086-4c23-92c6-e80ea5bf99a8","Type":"ContainerStarted","Data":"0fde98aec5b0ac7d315285e12d1d5f9284b4d41ac21b908e9e8882e28cd0cd0a"} Sep 10 12:21:18.267184 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:18.266866 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwlkm" event={"ID":"b857cdde-fb6f-46f7-95bb-96227decda7c","Type":"ContainerStarted","Data":"4e3a7f9be75413d69280d938199f17d816a4c4de5444e2737e7105a3db2a4f5b"} Sep 10 12:21:18.272429 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:18.272404 2574 generic.go:356] "Generic (PLEG): container finished" podID="3a228b5d83ce189d4cfc57b40abeb1f8" containerID="bb12d88d552fc3756d6838942685c82150f2a059de2c48a6842e02d22c9ab645" exitCode=0 Sep 10 12:21:18.272534 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:18.272478 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal" event={"ID":"3a228b5d83ce189d4cfc57b40abeb1f8","Type":"ContainerDied","Data":"bb12d88d552fc3756d6838942685c82150f2a059de2c48a6842e02d22c9ab645"} Sep 10 12:21:18.282896 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:18.282872 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" event={"ID":"e660271a-5e36-4443-886a-6430b2ccc70b","Type":"ContainerStarted","Data":"694b0995fbb002fe161d22c0047f8910b27a0db44378db1973b702329c1b529c"} Sep 10 12:21:18.310189 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:18.310072 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-54t2x" event={"ID":"ce1f09e0-b23e-483b-bb9a-4727b0a8157e","Type":"ContainerStarted","Data":"22e5ca87f71da6f8acfa78c650c932b06b8f57f4703aa4aab5053d960edbdb9d"} Sep 10 12:21:18.328707 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:18.328631 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gmg5v" event={"ID":"0dbc8454-9e65-498f-b7aa-7ef0f40aafda","Type":"ContainerStarted","Data":"d826f87af93c714b6383aa9874339913b4a7c64bb556d8ca820cba49d239a3af"} Sep 10 12:21:18.757199 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:18.757093 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs\") pod \"network-metrics-daemon-chlvc\" (UID: \"b1def400-ba5c-452a-af47-acdcc7572604\") " pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:18.757199 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:18.757165 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret\") pod \"global-pull-secret-syncer-w88dt\" (UID: \"7837a526-e410-47f6-8676-b6737e88b1e6\") " pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:18.757429 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:18.757316 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:21:18.757429 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:18.757388 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret podName:7837a526-e410-47f6-8676-b6737e88b1e6 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:20.757370089 +0000 UTC m=+6.044639758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret") pod "global-pull-secret-syncer-w88dt" (UID: "7837a526-e410-47f6-8676-b6737e88b1e6") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:21:18.757429 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:18.757407 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:21:18.757582 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:18.757472 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs podName:b1def400-ba5c-452a-af47-acdcc7572604 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:20.757454497 +0000 UTC m=+6.044724153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs") pod "network-metrics-daemon-chlvc" (UID: "b1def400-ba5c-452a-af47-acdcc7572604") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:21:18.858393 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:18.857710 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtx8z\" (UniqueName: \"kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z\") pod \"network-check-target-prnjr\" (UID: \"e1c75fe5-5d36-4709-bd85-aec96a0ce2c3\") " pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:18.858393 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:18.857925 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:21:18.858393 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:18.857944 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:21:18.858393 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:18.857956 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rtx8z for pod openshift-network-diagnostics/network-check-target-prnjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:21:18.858393 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:18.858015 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z podName:e1c75fe5-5d36-4709-bd85-aec96a0ce2c3 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:20.857996885 +0000 UTC m=+6.145266550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtx8z" (UniqueName: "kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z") pod "network-check-target-prnjr" (UID: "e1c75fe5-5d36-4709-bd85-aec96a0ce2c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:21:19.201385 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:19.201292 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:19.201548 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:19.201432 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:19.201778 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:19.201298 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:19.201897 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:19.201875 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:19.202499 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:19.202048 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:19.202499 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:19.202154 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:19.210562 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:19.210473 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 12:16:17 +0000 UTC" deadline="2028-06-15 08:51:10.194706072 +0000 UTC" Sep 10 12:21:19.210562 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:19.210528 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15452h29m50.984182385s" Sep 10 12:21:19.356746 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:19.356703 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal" event={"ID":"3a228b5d83ce189d4cfc57b40abeb1f8","Type":"ContainerStarted","Data":"e0c934eda442093126f5a46048780e584afe7be5c256ef2e2e5c867cd0fb3400"} Sep 10 12:21:20.774025 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:20.773985 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs\") pod \"network-metrics-daemon-chlvc\" (UID: \"b1def400-ba5c-452a-af47-acdcc7572604\") " pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:20.774025 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:20.774037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret\") pod \"global-pull-secret-syncer-w88dt\" (UID: \"7837a526-e410-47f6-8676-b6737e88b1e6\") " pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:20.774596 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:20.774182 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:21:20.774596 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:20.774243 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret podName:7837a526-e410-47f6-8676-b6737e88b1e6 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:24.774225058 +0000 UTC m=+10.061494718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret") pod "global-pull-secret-syncer-w88dt" (UID: "7837a526-e410-47f6-8676-b6737e88b1e6") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:21:20.774719 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:20.774629 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:21:20.774719 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:20.774677 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs podName:b1def400-ba5c-452a-af47-acdcc7572604 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:24.774661554 +0000 UTC m=+10.061931216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs") pod "network-metrics-daemon-chlvc" (UID: "b1def400-ba5c-452a-af47-acdcc7572604") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:21:20.875381 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:20.874784 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtx8z\" (UniqueName: \"kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z\") pod \"network-check-target-prnjr\" (UID: \"e1c75fe5-5d36-4709-bd85-aec96a0ce2c3\") " pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:20.875381 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:20.875002 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:21:20.875381 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:20.875018 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:21:20.875381 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:20.875027 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rtx8z for pod openshift-network-diagnostics/network-check-target-prnjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:21:20.875381 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:20.875068 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z podName:e1c75fe5-5d36-4709-bd85-aec96a0ce2c3 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:24.875056374 +0000 UTC m=+10.162326043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtx8z" (UniqueName: "kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z") pod "network-check-target-prnjr" (UID: "e1c75fe5-5d36-4709-bd85-aec96a0ce2c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:21:21.201304 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:21.201108 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:21.201304 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:21.201285 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:21.202078 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:21.201649 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:21.202078 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:21.201753 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:21.202078 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:21.201759 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:21.202078 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:21.201925 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:23.200422 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:23.200383 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:23.200877 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:23.200436 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:23.200877 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:23.200383 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:23.200877 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:23.200519 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:23.200877 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:23.200588 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:23.200877 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:23.200655 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:24.810639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:24.810586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs\") pod \"network-metrics-daemon-chlvc\" (UID: \"b1def400-ba5c-452a-af47-acdcc7572604\") " pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:24.810639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:24.810631 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret\") pod \"global-pull-secret-syncer-w88dt\" (UID: \"7837a526-e410-47f6-8676-b6737e88b1e6\") " pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:24.811129 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:24.810706 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:21:24.811129 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:24.810706 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:21:24.811129 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:24.810769 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs podName:b1def400-ba5c-452a-af47-acdcc7572604 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:32.81075087 +0000 UTC m=+18.098020541 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs") pod "network-metrics-daemon-chlvc" (UID: "b1def400-ba5c-452a-af47-acdcc7572604") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:21:24.811129 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:24.810788 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret podName:7837a526-e410-47f6-8676-b6737e88b1e6 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:32.810779118 +0000 UTC m=+18.098048776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret") pod "global-pull-secret-syncer-w88dt" (UID: "7837a526-e410-47f6-8676-b6737e88b1e6") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:21:24.912390 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:24.911741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtx8z\" (UniqueName: \"kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z\") pod \"network-check-target-prnjr\" (UID: \"e1c75fe5-5d36-4709-bd85-aec96a0ce2c3\") " pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:24.912390 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:24.911943 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:21:24.912390 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:24.911966 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:21:24.912390 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:24.911978 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rtx8z for pod openshift-network-diagnostics/network-check-target-prnjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:21:24.912390 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:24.912033 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z podName:e1c75fe5-5d36-4709-bd85-aec96a0ce2c3 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:32.912015793 +0000 UTC m=+18.199285455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtx8z" (UniqueName: "kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z") pod "network-check-target-prnjr" (UID: "e1c75fe5-5d36-4709-bd85-aec96a0ce2c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:21:25.200976 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:25.200902 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:25.201120 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:25.201031 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:25.202112 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:25.202087 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:25.202232 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:25.202207 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:25.202287 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:25.202268 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:25.202351 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:25.202338 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:27.199699 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:27.199665 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:27.200166 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:27.199796 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:27.200679 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:27.200661 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:27.200810 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:27.200792 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:27.201176 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:27.200620 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:27.201315 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:27.201293 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:29.200315 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:29.200284 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:29.200764 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:29.200284 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:29.200764 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:29.200415 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:29.200764 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:29.200292 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:29.200764 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:29.200492 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:29.200764 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:29.200571 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:31.200304 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:31.200265 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:31.200304 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:31.200299 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:31.200771 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:31.200290 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:31.200771 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:31.200410 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:31.200771 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:31.200512 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:31.200771 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:31.200583 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:32.868693 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:32.868651 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs\") pod \"network-metrics-daemon-chlvc\" (UID: \"b1def400-ba5c-452a-af47-acdcc7572604\") " pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:32.869224 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:32.868702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret\") pod \"global-pull-secret-syncer-w88dt\" (UID: \"7837a526-e410-47f6-8676-b6737e88b1e6\") " pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:32.869224 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:32.868826 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:21:32.869224 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:32.868859 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:21:32.869224 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:32.868904 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs podName:b1def400-ba5c-452a-af47-acdcc7572604 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:48.868883134 +0000 UTC m=+34.156152816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs") pod "network-metrics-daemon-chlvc" (UID: "b1def400-ba5c-452a-af47-acdcc7572604") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:21:32.869224 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:32.868922 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret podName:7837a526-e410-47f6-8676-b6737e88b1e6 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:48.868915192 +0000 UTC m=+34.156184849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret") pod "global-pull-secret-syncer-w88dt" (UID: "7837a526-e410-47f6-8676-b6737e88b1e6") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:21:32.970014 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:32.969979 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtx8z\" (UniqueName: \"kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z\") pod \"network-check-target-prnjr\" (UID: \"e1c75fe5-5d36-4709-bd85-aec96a0ce2c3\") " pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:32.970218 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:32.970191 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:21:32.970218 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:32.970218 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:21:32.970309 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:32.970229 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rtx8z for pod openshift-network-diagnostics/network-check-target-prnjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:21:32.970309 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:32.970284 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z podName:e1c75fe5-5d36-4709-bd85-aec96a0ce2c3 nodeName:}" failed. No retries permitted until 2026-09-10 12:21:48.970268699 +0000 UTC m=+34.257538359 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtx8z" (UniqueName: "kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z") pod "network-check-target-prnjr" (UID: "e1c75fe5-5d36-4709-bd85-aec96a0ce2c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:21:33.200223 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:33.200187 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:33.200409 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:33.200235 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:33.200409 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:33.200205 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:33.200409 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:33.200331 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:33.200577 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:33.200410 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:33.200577 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:33.200484 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:35.200970 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:35.200757 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:35.201455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:35.200815 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:35.201455 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:35.201055 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:35.201455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:35.200845 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:35.201455 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:35.201180 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:35.201455 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:35.201286 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:37.200380 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.200214 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:37.201037 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.200230 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:37.201037 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:37.200460 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:37.201037 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.200269 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:37.201037 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:37.200532 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:37.201037 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:37.200592 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:37.394414 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.394339 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-132.ec2.internal" event={"ID":"0fc9a15e83fe3b4f3cd821df1a82359f","Type":"ContainerStarted","Data":"1239c346197e65fa13b72b6dda7bab344dbac416553a124b402d44ac67228115"} Sep 10 12:21:37.396062 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.396033 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" event={"ID":"e660271a-5e36-4443-886a-6430b2ccc70b","Type":"ContainerStarted","Data":"46eb2a313b8323191ae9dbc8a4c71df9fd8cf41b78d569db8ee54c8a5d76f49f"} Sep 10 12:21:37.397816 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.397790 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-54t2x" event={"ID":"ce1f09e0-b23e-483b-bb9a-4727b0a8157e","Type":"ContainerStarted","Data":"c8c5dc3bc4dcfa8fd927652b8e9795ca1e8cb71327b2cdd5eec3a3bef25321d4"} Sep 10 12:21:37.399996 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.399662 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gmg5v" event={"ID":"0dbc8454-9e65-498f-b7aa-7ef0f40aafda","Type":"ContainerStarted","Data":"0fb9cc84fc8893b9b339882b4882d1c4d9cc511b7aa37eefbb15bbe15359869e"} Sep 10 12:21:37.401286 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.401263 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9n2jk" event={"ID":"7dd906be-8681-4057-9033-c0abf30b61be","Type":"ContainerStarted","Data":"2cf160898198da66a5ba92d3edf2d1791290ddf889620995581fdf73daf91e52"} Sep 10 12:21:37.403174 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.403114 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" event={"ID":"13e01332-4382-4307-b9e9-d3970233bd9b","Type":"ContainerStarted","Data":"ce2d5d0784b9f19c46972e297f6fff5ee46b1efaf8bd3db151ac4954c5d0eb30"} Sep 10 12:21:37.404822 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.404801 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bpn7r" event={"ID":"fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4","Type":"ContainerStarted","Data":"5f1813b257b8ce23fa3e1828fc455aeb7c6c1584a9a16d14e5c2111f392cf54f"} Sep 10 12:21:37.408057 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.408028 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" event={"ID":"c3aa8845-8086-4c23-92c6-e80ea5bf99a8","Type":"ContainerStarted","Data":"516c3ae7e5247433051041f675f72332421e478c49ba3888c90442c17ed753cc"} Sep 10 12:21:37.408214 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.408093 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" event={"ID":"c3aa8845-8086-4c23-92c6-e80ea5bf99a8","Type":"ContainerStarted","Data":"5ee0ea8779d2d606b6c709ede80263d048b0a099407cff54f15f1b52f75bbf67"} Sep 10 12:21:37.408214 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.408165 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" event={"ID":"c3aa8845-8086-4c23-92c6-e80ea5bf99a8","Type":"ContainerStarted","Data":"0d7fcb13c35c5d7ff1c652f5c891ec44d95b26994937458535ea0baf657ae669"} Sep 10 12:21:37.408214 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.408206 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" event={"ID":"c3aa8845-8086-4c23-92c6-e80ea5bf99a8","Type":"ContainerStarted","Data":"e4e5e1b2137fa08feaeb33cfa212e7cd530c32b3495bcb7ed2f93828cc615752"} Sep 10 12:21:37.408517 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.408249 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" event={"ID":"c3aa8845-8086-4c23-92c6-e80ea5bf99a8","Type":"ContainerStarted","Data":"8aa795257e7fa8598229bc59245642ea19e27b2285e106dcbcd380a5357582ca"} Sep 10 12:21:37.408517 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.408296 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" event={"ID":"c3aa8845-8086-4c23-92c6-e80ea5bf99a8","Type":"ContainerStarted","Data":"bc094db465086a1b681e408c68734b579aa2137bc63a0989e6521bf312d81daa"} Sep 10 12:21:37.409706 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.409683 2574 generic.go:356] "Generic (PLEG): container finished" podID="b857cdde-fb6f-46f7-95bb-96227decda7c" containerID="a32c90de8dd6be565cbb5c3c1fa7f75794d32a8b9dd302ad117469171ea7cb7c" exitCode=0 Sep 10 12:21:37.409807 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.409718 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwlkm" event={"ID":"b857cdde-fb6f-46f7-95bb-96227decda7c","Type":"ContainerDied","Data":"a32c90de8dd6be565cbb5c3c1fa7f75794d32a8b9dd302ad117469171ea7cb7c"} Sep 10 12:21:37.415055 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.415006 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-132.ec2.internal" podStartSLOduration=21.414994644 podStartE2EDuration="21.414994644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:21:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:21:19.378334485 +0000 UTC m=+4.665604164" watchObservedRunningTime="2026-09-10 12:21:37.414994644 +0000 UTC m=+22.702264322" Sep 10 12:21:37.442074 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.442038 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-132.ec2.internal" podStartSLOduration=21.442027189 podStartE2EDuration="21.442027189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:21:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:21:37.414848704 +0000 UTC m=+22.702118381" watchObservedRunningTime="2026-09-10 12:21:37.442027189 +0000 UTC m=+22.729296866" Sep 10 12:21:37.459348 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.459313 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bpn7r" podStartSLOduration=3.5190525900000003 podStartE2EDuration="22.459301976s" totalImagesPullingTime="18.940249386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:21:37.458634021 +0000 UTC m=+22.745903700" watchObservedRunningTime="2026-09-10 12:21:37.459301976 +0000 UTC m=+22.746571673" Sep 10 12:21:37.477717 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.477684 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9n2jk" podStartSLOduration=3.56224462 podStartE2EDuration="22.477673507s" totalImagesPullingTime="18.915428887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:21:37.477525162 +0000 UTC m=+22.764794853" watchObservedRunningTime="2026-09-10 12:21:37.477673507 +0000 UTC m=+22.764943184" Sep 10 12:21:37.496508 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.496478 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gmg5v" podStartSLOduration=3.518937399 podStartE2EDuration="22.496466251s" totalImagesPullingTime="18.977528852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:21:37.495950608 +0000 UTC m=+22.783220286" watchObservedRunningTime="2026-09-10 12:21:37.496466251 +0000 UTC m=+22.783735910" Sep 10 12:21:37.513835 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.513790 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-54t2x" podStartSLOduration=3.579809468 podStartE2EDuration="22.513773949s" totalImagesPullingTime="18.933964481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:21:37.513261817 +0000 UTC m=+22.800531495" watchObservedRunningTime="2026-09-10 12:21:37.513773949 +0000 UTC m=+22.801043628" Sep 10 12:21:37.860534 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:37.860360 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 12:21:38.210827 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:38.210704 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T12:21:37.860531983Z","UUID":"f284cea7-a4ec-4c88-a430-31ba209799b5","Handler":null,"Name":"","Endpoint":""} Sep 10 12:21:38.212584 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:38.212565 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 12:21:38.212724 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:38.212593 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 12:21:38.412999 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:38.412961 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" event={"ID":"e660271a-5e36-4443-886a-6430b2ccc70b","Type":"ContainerStarted","Data":"4bb67c61d874173b6af79096910c1a822b477d56480e2960de686a47786e7e9d"} Sep 10 12:21:38.414433 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:38.414406 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bq7sl" event={"ID":"58389d29-7343-493e-9d25-a3e1dc81ce6a","Type":"ContainerStarted","Data":"2fc7e613db63df9acd3c214593e2e66a4afc88b8cc6392556b9d6b400b76086a"} Sep 10 12:21:38.434766 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:38.434719 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tmxj6" podStartSLOduration=4.512184598 podStartE2EDuration="23.43470751s" totalImagesPullingTime="18.922522912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:21:37.568036744 +0000 UTC m=+22.855306422" watchObservedRunningTime="2026-09-10 12:21:38.43470751 +0000 UTC m=+23.721977188" Sep 10 12:21:39.203320 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:39.203289 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:39.203490 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:39.203333 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:39.203490 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:39.203391 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:39.203490 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:39.203400 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:39.203490 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:39.203480 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:39.203671 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:39.203566 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:39.420784 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:39.420693 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" event={"ID":"c3aa8845-8086-4c23-92c6-e80ea5bf99a8","Type":"ContainerStarted","Data":"1550e0fc16a7f15d38376b0dee068c8618464387771ddff25c84251a0285327d"} Sep 10 12:21:39.632699 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:39.632663 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-54t2x" Sep 10 12:21:39.633323 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:39.633295 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-54t2x" Sep 10 12:21:39.652546 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:39.652491 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bq7sl" podStartSLOduration=5.724080184 podStartE2EDuration="24.652472561s" totalImagesPullingTime="18.928392377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:21:38.435318356 +0000 UTC m=+23.722588033" watchObservedRunningTime="2026-09-10 12:21:39.652472561 +0000 UTC m=+24.939742241" Sep 10 12:21:40.424995 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:40.424959 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" event={"ID":"e660271a-5e36-4443-886a-6430b2ccc70b","Type":"ContainerStarted","Data":"bf7c542677ee908b1304959755ee1ba72c13b899178414ceb573bc49fcaa444c"} Sep 10 12:21:40.425427 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:40.425169 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-54t2x" Sep 10 12:21:40.425566 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:40.425551 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-54t2x" Sep 10 12:21:40.470860 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:40.470814 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mk6ph" podStartSLOduration=3.6790448700000002 podStartE2EDuration="25.47079824s" totalImagesPullingTime="21.79175337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:21:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:21:40.448040362 +0000 UTC m=+25.735310040" watchObservedRunningTime="2026-09-10 12:21:40.47079824 +0000 UTC m=+25.758067918" Sep 10 12:21:41.203635 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:41.203605 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:41.203817 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:41.203605 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:41.203817 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:41.203748 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:41.203817 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:41.203786 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:41.203817 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:41.203610 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:41.203999 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:41.203880 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:41.432532 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:41.432331 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" event={"ID":"c3aa8845-8086-4c23-92c6-e80ea5bf99a8","Type":"ContainerStarted","Data":"655cbbb8d1579a86c26b5dfae5dc5397410e0102c2c8d6cc3ba8fa562c17030e"} Sep 10 12:21:41.481732 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:41.481672 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" podStartSLOduration=7.442942359 podStartE2EDuration="26.481650378s" totalImagesPullingTime="19.038708019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:21:41.479751391 +0000 UTC m=+26.767021069" watchObservedRunningTime="2026-09-10 12:21:41.481650378 +0000 UTC m=+26.768920056" Sep 10 12:21:41.657912 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:41.657731 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:41.763308 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:41.763271 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:42.435006 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:42.434976 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:42.435473 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:42.435062 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:42.435473 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:42.435112 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:42.452335 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:42.452294 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:42.452489 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:42.452429 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:21:43.204880 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:43.204849 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:43.205042 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:43.205016 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:43.205530 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:43.205511 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:43.205654 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:43.205635 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:43.205720 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:43.205709 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:43.205824 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:43.205808 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:43.298690 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:43.298661 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w88dt"] Sep 10 12:21:43.303426 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:43.303370 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-chlvc"] Sep 10 12:21:43.315363 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:43.315275 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-prnjr"] Sep 10 12:21:43.436885 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:43.436857 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:43.437557 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:43.436858 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:43.437557 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:43.436866 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:43.437557 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:43.437033 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:43.437557 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:43.437172 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:43.437752 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:43.437646 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:44.440331 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:44.440295 2574 generic.go:356] "Generic (PLEG): container finished" podID="b857cdde-fb6f-46f7-95bb-96227decda7c" containerID="11b065610496c0ed3300d68a7e75379ee137c3947021ab067e1c6fa9e86f49e0" exitCode=0 Sep 10 12:21:44.440987 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:44.440386 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwlkm" event={"ID":"b857cdde-fb6f-46f7-95bb-96227decda7c","Type":"ContainerDied","Data":"11b065610496c0ed3300d68a7e75379ee137c3947021ab067e1c6fa9e86f49e0"} Sep 10 12:21:45.200914 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:45.200880 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:45.201094 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:45.200976 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:45.201094 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:45.201005 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:45.201094 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:45.201023 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:45.201287 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:45.201117 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:45.201287 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:45.201224 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:46.446310 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:46.446055 2574 generic.go:356] "Generic (PLEG): container finished" podID="b857cdde-fb6f-46f7-95bb-96227decda7c" containerID="6c5e4a5869e139e29478bfe0d5067fe2083c07053713e104d645c9287d62f4aa" exitCode=0 Sep 10 12:21:46.446310 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:46.446146 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwlkm" event={"ID":"b857cdde-fb6f-46f7-95bb-96227decda7c","Type":"ContainerDied","Data":"6c5e4a5869e139e29478bfe0d5067fe2083c07053713e104d645c9287d62f4aa"} Sep 10 12:21:46.765125 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:46.765093 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:46.865800 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:46.865749 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:47.200606 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:47.200075 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:47.200606 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:47.200106 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:47.200606 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:47.200245 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:47.200606 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:47.200331 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:47.200606 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:47.200359 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:47.200606 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:47.200442 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:47.451110 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:47.451017 2574 generic.go:356] "Generic (PLEG): container finished" podID="b857cdde-fb6f-46f7-95bb-96227decda7c" containerID="c16c976d94efe91a4f9cbe26f9dc68f33c0c8ca14114ec8936a70572e0eef9a9" exitCode=0 Sep 10 12:21:47.451110 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:47.451074 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwlkm" event={"ID":"b857cdde-fb6f-46f7-95bb-96227decda7c","Type":"ContainerDied","Data":"c16c976d94efe91a4f9cbe26f9dc68f33c0c8ca14114ec8936a70572e0eef9a9"} Sep 10 12:21:47.836506 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:47.836475 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:47.939955 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:47.939909 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:48.037785 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:48.037724 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:48.139349 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:48.139260 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:48.798437 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:48.798380 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:48.890620 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:48.890589 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs\") pod \"network-metrics-daemon-chlvc\" (UID: \"b1def400-ba5c-452a-af47-acdcc7572604\") " pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:48.890814 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:48.890628 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret\") pod \"global-pull-secret-syncer-w88dt\" (UID: \"7837a526-e410-47f6-8676-b6737e88b1e6\") " pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:48.890814 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:48.890780 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:21:48.890814 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:48.890799 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 12:21:48.890989 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:48.890854 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs podName:b1def400-ba5c-452a-af47-acdcc7572604 nodeName:}" failed. No retries permitted until 2026-09-10 12:22:20.890834564 +0000 UTC m=+66.178104220 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs") pod "network-metrics-daemon-chlvc" (UID: "b1def400-ba5c-452a-af47-acdcc7572604") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 12:21:48.890989 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:48.890876 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret podName:7837a526-e410-47f6-8676-b6737e88b1e6 nodeName:}" failed. No retries permitted until 2026-09-10 12:22:20.890866 +0000 UTC m=+66.178135660 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret") pod "global-pull-secret-syncer-w88dt" (UID: "7837a526-e410-47f6-8676-b6737e88b1e6") : object "kube-system"/"original-pull-secret" not registered Sep 10 12:21:48.991445 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:48.991413 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtx8z\" (UniqueName: \"kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z\") pod \"network-check-target-prnjr\" (UID: \"e1c75fe5-5d36-4709-bd85-aec96a0ce2c3\") " pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:48.992001 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:48.991808 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 12:21:48.992071 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:48.992011 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 12:21:48.992071 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:48.992035 2574 projected.go:196] Error preparing data for projected volume kube-api-access-rtx8z for pod openshift-network-diagnostics/network-check-target-prnjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:21:48.995180 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:48.992284 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z podName:e1c75fe5-5d36-4709-bd85-aec96a0ce2c3 nodeName:}" failed. No retries permitted until 2026-09-10 12:22:20.992256133 +0000 UTC m=+66.279525806 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtx8z" (UniqueName: "kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z") pod "network-check-target-prnjr" (UID: "e1c75fe5-5d36-4709-bd85-aec96a0ce2c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 12:21:49.190687 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.190593 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:49.200759 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.200722 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:49.200876 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.200722 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:49.200876 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:49.200833 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prnjr" podUID="e1c75fe5-5d36-4709-bd85-aec96a0ce2c3" Sep 10 12:21:49.200989 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:49.200925 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w88dt" podUID="7837a526-e410-47f6-8676-b6737e88b1e6" Sep 10 12:21:49.200989 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.200740 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:49.201085 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:49.201035 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-chlvc" podUID="b1def400-ba5c-452a-af47-acdcc7572604" Sep 10 12:21:49.290100 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.290069 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:49.490686 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.490659 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-132.ec2.internal" event="NodeReady" Sep 10 12:21:49.490867 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.490822 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 12:21:49.549974 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.549929 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cb54b5566-9v2jw"] Sep 10 12:21:49.553903 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.553886 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.554868 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.554846 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9mtfb"] Sep 10 12:21:49.559369 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.559348 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6ckhj"] Sep 10 12:21:49.559490 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.559472 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9mtfb" Sep 10 12:21:49.560793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.560647 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 12:21:49.560793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.560693 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 12:21:49.561174 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.561131 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 12:21:49.561256 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.561222 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q8zld\"" Sep 10 12:21:49.562535 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.562517 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 12:21:49.562848 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.562835 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 12:21:49.563129 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.563110 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6ckhj" Sep 10 12:21:49.567111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.567094 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 12:21:49.567220 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.567169 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2wbft\"" Sep 10 12:21:49.568002 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.567983 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5vdn9\"" Sep 10 12:21:49.568154 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.568011 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 12:21:49.568260 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.568245 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 12:21:49.568325 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.568251 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 12:21:49.574960 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.574938 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9mtfb"] Sep 10 12:21:49.575191 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.575175 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb54b5566-9v2jw"] Sep 10 12:21:49.578682 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.578663 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6ckhj"] Sep 10 12:21:49.696071 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.696027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.696071 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.696064 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/44cc9151-0956-4e90-9be6-5f792389eabe-installation-pull-secrets\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.696335 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.696089 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:21:49.696335 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.696113 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f1a26af-be97-46a4-87a9-6f3e8da1123e-tmp-dir\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:21:49.696335 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.696246 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/44cc9151-0956-4e90-9be6-5f792389eabe-registry-certificates\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.696335 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.696293 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ade03c9-a18b-4685-b3f5-f5a0afe370db-cert\") pod \"ingress-canary-6ckhj\" (UID: \"8ade03c9-a18b-4685-b3f5-f5a0afe370db\") " pod="openshift-ingress-canary/ingress-canary-6ckhj" Sep 10 12:21:49.696540 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.696344 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-bound-sa-token\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.696540 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.696376 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/44cc9151-0956-4e90-9be6-5f792389eabe-image-registry-private-configuration\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.696540 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.696436 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/44cc9151-0956-4e90-9be6-5f792389eabe-ca-trust-extracted\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.696540 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.696469 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44cc9151-0956-4e90-9be6-5f792389eabe-trusted-ca\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.696540 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.696493 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7d8r\" (UniqueName: \"kubernetes.io/projected/8ade03c9-a18b-4685-b3f5-f5a0afe370db-kube-api-access-r7d8r\") pod \"ingress-canary-6ckhj\" (UID: \"8ade03c9-a18b-4685-b3f5-f5a0afe370db\") " pod="openshift-ingress-canary/ingress-canary-6ckhj" Sep 10 12:21:49.696540 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.696526 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pmqp\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-kube-api-access-4pmqp\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.696789 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.696550 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f1a26af-be97-46a4-87a9-6f3e8da1123e-config-volume\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:21:49.696789 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.696608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s74hq\" (UniqueName: \"kubernetes.io/projected/4f1a26af-be97-46a4-87a9-6f3e8da1123e-kube-api-access-s74hq\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:21:49.754984 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.754855 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:49.797885 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.797844 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/44cc9151-0956-4e90-9be6-5f792389eabe-registry-certificates\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.797885 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.797886 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ade03c9-a18b-4685-b3f5-f5a0afe370db-cert\") pod \"ingress-canary-6ckhj\" (UID: \"8ade03c9-a18b-4685-b3f5-f5a0afe370db\") " pod="openshift-ingress-canary/ingress-canary-6ckhj" Sep 10 12:21:49.798091 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.798015 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-bound-sa-token\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.798091 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.798057 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/44cc9151-0956-4e90-9be6-5f792389eabe-image-registry-private-configuration\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.798091 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.798084 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/44cc9151-0956-4e90-9be6-5f792389eabe-ca-trust-extracted\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.798243 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.798127 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44cc9151-0956-4e90-9be6-5f792389eabe-trusted-ca\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.798243 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.798178 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7d8r\" (UniqueName: \"kubernetes.io/projected/8ade03c9-a18b-4685-b3f5-f5a0afe370db-kube-api-access-r7d8r\") pod \"ingress-canary-6ckhj\" (UID: \"8ade03c9-a18b-4685-b3f5-f5a0afe370db\") " pod="openshift-ingress-canary/ingress-canary-6ckhj" Sep 10 12:21:49.798355 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.798300 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pmqp\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-kube-api-access-4pmqp\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.798355 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.798348 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f1a26af-be97-46a4-87a9-6f3e8da1123e-config-volume\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:21:49.798454 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.798395 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s74hq\" (UniqueName: \"kubernetes.io/projected/4f1a26af-be97-46a4-87a9-6f3e8da1123e-kube-api-access-s74hq\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:21:49.798509 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.798452 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.798509 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.798487 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/44cc9151-0956-4e90-9be6-5f792389eabe-installation-pull-secrets\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.798933 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.798514 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:21:49.798933 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.798537 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f1a26af-be97-46a4-87a9-6f3e8da1123e-tmp-dir\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:21:49.798933 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.798551 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/44cc9151-0956-4e90-9be6-5f792389eabe-registry-certificates\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.798933 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:49.798567 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:21:49.798933 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:49.798583 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb54b5566-9v2jw: secret "image-registry-tls" not found Sep 10 12:21:49.798933 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:49.798637 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls podName:44cc9151-0956-4e90-9be6-5f792389eabe nodeName:}" failed. No retries permitted until 2026-09-10 12:21:50.298617845 +0000 UTC m=+35.585887502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls") pod "image-registry-5cb54b5566-9v2jw" (UID: "44cc9151-0956-4e90-9be6-5f792389eabe") : secret "image-registry-tls" not found Sep 10 12:21:49.798933 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:49.798679 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:21:49.798933 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:49.798731 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls podName:4f1a26af-be97-46a4-87a9-6f3e8da1123e nodeName:}" failed. No retries permitted until 2026-09-10 12:21:50.298714222 +0000 UTC m=+35.585983890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls") pod "dns-default-9mtfb" (UID: "4f1a26af-be97-46a4-87a9-6f3e8da1123e") : secret "dns-default-metrics-tls" not found Sep 10 12:21:49.799347 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.798973 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/44cc9151-0956-4e90-9be6-5f792389eabe-ca-trust-extracted\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.799347 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.798975 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f1a26af-be97-46a4-87a9-6f3e8da1123e-config-volume\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:21:49.799347 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.799005 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f1a26af-be97-46a4-87a9-6f3e8da1123e-tmp-dir\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:21:49.799347 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.799206 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44cc9151-0956-4e90-9be6-5f792389eabe-trusted-ca\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.802371 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.802349 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/44cc9151-0956-4e90-9be6-5f792389eabe-image-registry-private-configuration\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.802371 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.802362 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ade03c9-a18b-4685-b3f5-f5a0afe370db-cert\") pod \"ingress-canary-6ckhj\" (UID: \"8ade03c9-a18b-4685-b3f5-f5a0afe370db\") " pod="openshift-ingress-canary/ingress-canary-6ckhj" Sep 10 12:21:49.802491 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.802350 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/44cc9151-0956-4e90-9be6-5f792389eabe-installation-pull-secrets\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.811457 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.811425 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-bound-sa-token\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.814668 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.814641 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s74hq\" (UniqueName: \"kubernetes.io/projected/4f1a26af-be97-46a4-87a9-6f3e8da1123e-kube-api-access-s74hq\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:21:49.814793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.814661 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pmqp\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-kube-api-access-4pmqp\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:49.814793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.814762 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7d8r\" (UniqueName: \"kubernetes.io/projected/8ade03c9-a18b-4685-b3f5-f5a0afe370db-kube-api-access-r7d8r\") pod \"ingress-canary-6ckhj\" (UID: \"8ade03c9-a18b-4685-b3f5-f5a0afe370db\") " pod="openshift-ingress-canary/ingress-canary-6ckhj" Sep 10 12:21:49.860396 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.860354 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:49.876132 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.876090 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6ckhj" Sep 10 12:21:49.922321 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:49.922268 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:50.168824 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:50.168740 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6ckhj"] Sep 10 12:21:50.172265 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:21:50.172241 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ade03c9_a18b_4685_b3f5_f5a0afe370db.slice/crio-e397030b04ac95c904f93cef0b60d958b61564d76aa46c233ff68357e6b99c79 WatchSource:0}: Error finding container e397030b04ac95c904f93cef0b60d958b61564d76aa46c233ff68357e6b99c79: Status 404 returned error can't find the container with id e397030b04ac95c904f93cef0b60d958b61564d76aa46c233ff68357e6b99c79 Sep 10 12:21:50.302909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:50.302868 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:50.302909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:50.302908 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:21:50.303175 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:50.303011 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:21:50.303175 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:50.303031 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:21:50.303175 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:50.303049 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb54b5566-9v2jw: secret "image-registry-tls" not found Sep 10 12:21:50.303175 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:50.303062 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls podName:4f1a26af-be97-46a4-87a9-6f3e8da1123e nodeName:}" failed. No retries permitted until 2026-09-10 12:21:51.303048076 +0000 UTC m=+36.590317745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls") pod "dns-default-9mtfb" (UID: "4f1a26af-be97-46a4-87a9-6f3e8da1123e") : secret "dns-default-metrics-tls" not found Sep 10 12:21:50.303175 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:50.303101 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls podName:44cc9151-0956-4e90-9be6-5f792389eabe nodeName:}" failed. No retries permitted until 2026-09-10 12:21:51.303083793 +0000 UTC m=+36.590353468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls") pod "image-registry-5cb54b5566-9v2jw" (UID: "44cc9151-0956-4e90-9be6-5f792389eabe") : secret "image-registry-tls" not found Sep 10 12:21:50.460295 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:50.460210 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6ckhj" event={"ID":"8ade03c9-a18b-4685-b3f5-f5a0afe370db","Type":"ContainerStarted","Data":"e397030b04ac95c904f93cef0b60d958b61564d76aa46c233ff68357e6b99c79"} Sep 10 12:21:50.718123 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:50.718093 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:50.824148 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:50.824108 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:51.200100 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:51.200021 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:21:51.200100 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:51.200046 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:21:51.200384 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:51.200022 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:21:51.203718 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:51.203695 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 12:21:51.205277 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:51.205031 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 12:21:51.205277 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:51.205051 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-clmmz\"" Sep 10 12:21:51.205277 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:51.205185 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h2jhp\"" Sep 10 12:21:51.205554 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:51.205538 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 12:21:51.205777 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:51.205759 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 12:21:51.312444 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:51.312408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:21:51.312627 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:51.312556 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:51.312627 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:51.312584 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:21:51.312765 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:51.312665 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls podName:4f1a26af-be97-46a4-87a9-6f3e8da1123e nodeName:}" failed. No retries permitted until 2026-09-10 12:21:53.312640885 +0000 UTC m=+38.599910562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls") pod "dns-default-9mtfb" (UID: "4f1a26af-be97-46a4-87a9-6f3e8da1123e") : secret "dns-default-metrics-tls" not found Sep 10 12:21:51.312765 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:51.312665 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:21:51.312765 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:51.312683 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb54b5566-9v2jw: secret "image-registry-tls" not found Sep 10 12:21:51.312765 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:51.312728 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls podName:44cc9151-0956-4e90-9be6-5f792389eabe nodeName:}" failed. No retries permitted until 2026-09-10 12:21:53.31271409 +0000 UTC m=+38.599983761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls") pod "image-registry-5cb54b5566-9v2jw" (UID: "44cc9151-0956-4e90-9be6-5f792389eabe") : secret "image-registry-tls" not found Sep 10 12:21:52.421676 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:52.421638 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:53.329093 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:53.329056 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:53.329303 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:53.329101 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:21:53.329303 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:53.329237 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:21:53.329303 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:53.329240 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:21:53.329303 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:53.329260 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb54b5566-9v2jw: secret "image-registry-tls" not found Sep 10 12:21:53.329303 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:53.329305 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls podName:4f1a26af-be97-46a4-87a9-6f3e8da1123e nodeName:}" failed. No retries permitted until 2026-09-10 12:21:57.329286115 +0000 UTC m=+42.616555786 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls") pod "dns-default-9mtfb" (UID: "4f1a26af-be97-46a4-87a9-6f3e8da1123e") : secret "dns-default-metrics-tls" not found Sep 10 12:21:53.329562 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:53.329322 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls podName:44cc9151-0956-4e90-9be6-5f792389eabe nodeName:}" failed. No retries permitted until 2026-09-10 12:21:57.329313679 +0000 UTC m=+42.616583337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls") pod "image-registry-5cb54b5566-9v2jw" (UID: "44cc9151-0956-4e90-9be6-5f792389eabe") : secret "image-registry-tls" not found Sep 10 12:21:53.473471 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:53.473441 2574 generic.go:356] "Generic (PLEG): container finished" podID="b857cdde-fb6f-46f7-95bb-96227decda7c" containerID="19c5dfb009d9e4a660ce8089d57b1801e0d13e5e670d65b53999b0cb3ca60c70" exitCode=0 Sep 10 12:21:53.474077 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:53.473487 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwlkm" event={"ID":"b857cdde-fb6f-46f7-95bb-96227decda7c","Type":"ContainerDied","Data":"19c5dfb009d9e4a660ce8089d57b1801e0d13e5e670d65b53999b0cb3ca60c70"} Sep 10 12:21:54.483188 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:54.483130 2574 generic.go:356] "Generic (PLEG): container finished" podID="b857cdde-fb6f-46f7-95bb-96227decda7c" containerID="0c71caf5a2f3bdca3f5ba276ab17ecb475947d29201659831f765912b9760acc" exitCode=0 Sep 10 12:21:54.483616 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:54.483209 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwlkm" event={"ID":"b857cdde-fb6f-46f7-95bb-96227decda7c","Type":"ContainerDied","Data":"0c71caf5a2f3bdca3f5ba276ab17ecb475947d29201659831f765912b9760acc"} Sep 10 12:21:54.931182 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:54.930924 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:55.034212 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:55.034174 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:55.488334 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:55.488297 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rwlkm" event={"ID":"b857cdde-fb6f-46f7-95bb-96227decda7c","Type":"ContainerStarted","Data":"6941dd223812f8806ca56e0325ff4001576e44b78d7be6b3317b7d241d4dd6e7"} Sep 10 12:21:55.489726 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:55.489703 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6ckhj" event={"ID":"8ade03c9-a18b-4685-b3f5-f5a0afe370db","Type":"ContainerStarted","Data":"e3eb5c59a9cd4c64e458505327a602b79c38ddc9d2f6992a2e50d67ff7519e4e"} Sep 10 12:21:55.517619 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:55.517568 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rwlkm" podStartSLOduration=8.095569865 podStartE2EDuration="40.517554089s" totalImagesPullingTime="32.421984224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:21:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:21:55.515616869 +0000 UTC m=+40.802886549" watchObservedRunningTime="2026-09-10 12:21:55.517554089 +0000 UTC m=+40.804823765" Sep 10 12:21:55.535726 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:55.535678 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6ckhj" podStartSLOduration=1.832312234 podStartE2EDuration="6.535661551s" totalImagesPullingTime="4.703349317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:21:55.534983177 +0000 UTC m=+40.822252882" watchObservedRunningTime="2026-09-10 12:21:55.535661551 +0000 UTC m=+40.822931243" Sep 10 12:21:55.652010 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:55.651978 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:55.758426 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:55.758336 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:57.363177 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:57.363116 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:21:57.363177 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:57.363175 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:21:57.363600 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:57.363273 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:21:57.363600 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:57.363284 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:21:57.363600 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:57.363292 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb54b5566-9v2jw: secret "image-registry-tls" not found Sep 10 12:21:57.363600 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:57.363339 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls podName:44cc9151-0956-4e90-9be6-5f792389eabe nodeName:}" failed. No retries permitted until 2026-09-10 12:22:05.36332553 +0000 UTC m=+50.650595187 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls") pod "image-registry-5cb54b5566-9v2jw" (UID: "44cc9151-0956-4e90-9be6-5f792389eabe") : secret "image-registry-tls" not found Sep 10 12:21:57.363600 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:21:57.363354 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls podName:4f1a26af-be97-46a4-87a9-6f3e8da1123e nodeName:}" failed. No retries permitted until 2026-09-10 12:22:05.36334709 +0000 UTC m=+50.650616745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls") pod "dns-default-9mtfb" (UID: "4f1a26af-be97-46a4-87a9-6f3e8da1123e") : secret "dns-default-metrics-tls" not found Sep 10 12:21:59.533828 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:59.533794 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:21:59.628655 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:21:59.628618 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:00.504103 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:00.504065 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:00.648016 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:00.647973 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:01.863833 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:01.863799 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7pvnm"] Sep 10 12:22:01.868729 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:01.868699 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:01.903155 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:01.903113 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7pvnm"] Sep 10 12:22:01.903270 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:01.903233 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:01.906551 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:01.906527 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 12:22:01.906755 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:01.906740 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6gvwr\"" Sep 10 12:22:01.906867 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:01.906844 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 12:22:01.907308 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:01.907287 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 12:22:01.907393 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:01.907324 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 12:22:01.982317 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:01.982288 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:01.993227 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:01.993200 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:01.993316 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:01.993235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp5lb\" (UniqueName: \"kubernetes.io/projected/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-api-access-xp5lb\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:01.993375 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:01.993357 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6cb426d-295d-410d-b8ca-648bb4caa6f2-crio-socket\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:01.993435 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:01.993420 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6cb426d-295d-410d-b8ca-648bb4caa6f2-data-volume\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:01.993484 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:01.993463 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:02.094149 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:02.094112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6cb426d-295d-410d-b8ca-648bb4caa6f2-crio-socket\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:02.094311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:02.094176 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6cb426d-295d-410d-b8ca-648bb4caa6f2-data-volume\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:02.094311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:02.094192 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:02.094311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:02.094220 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:02.094311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:02.094238 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp5lb\" (UniqueName: \"kubernetes.io/projected/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-api-access-xp5lb\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:02.094311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:02.094290 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6cb426d-295d-410d-b8ca-648bb4caa6f2-crio-socket\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:02.094534 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:02.094320 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:22:02.094534 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:02.094358 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:22:02.094534 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:02.094403 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm podName:c6cb426d-295d-410d-b8ca-648bb4caa6f2 nodeName:}" failed. No retries permitted until 2026-09-10 12:22:02.594381418 +0000 UTC m=+47.881651099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7pvnm" (UID: "c6cb426d-295d-410d-b8ca-648bb4caa6f2") : configmap "kube-rbac-proxy" not found Sep 10 12:22:02.094534 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:02.094430 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls podName:c6cb426d-295d-410d-b8ca-648bb4caa6f2 nodeName:}" failed. No retries permitted until 2026-09-10 12:22:02.594410879 +0000 UTC m=+47.881680542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7pvnm" (UID: "c6cb426d-295d-410d-b8ca-648bb4caa6f2") : secret "insights-runtime-extractor-tls" not found Sep 10 12:22:02.094767 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:02.094582 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6cb426d-295d-410d-b8ca-648bb4caa6f2-data-volume\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:02.106583 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:02.106560 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp5lb\" (UniqueName: \"kubernetes.io/projected/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-api-access-xp5lb\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:02.274769 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:02.274727 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:02.347997 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:02.347961 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:02.527314 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:02.527227 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:02.598397 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:02.598353 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:02.598556 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:02.598421 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:02.598556 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:02.598481 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:22:02.598664 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:02.598561 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:22:02.598664 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:02.598566 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm podName:c6cb426d-295d-410d-b8ca-648bb4caa6f2 nodeName:}" failed. No retries permitted until 2026-09-10 12:22:03.598543744 +0000 UTC m=+48.885813405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7pvnm" (UID: "c6cb426d-295d-410d-b8ca-648bb4caa6f2") : configmap "kube-rbac-proxy" not found Sep 10 12:22:02.598664 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:02.598609 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls podName:c6cb426d-295d-410d-b8ca-648bb4caa6f2 nodeName:}" failed. No retries permitted until 2026-09-10 12:22:03.598598881 +0000 UTC m=+48.885868551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7pvnm" (UID: "c6cb426d-295d-410d-b8ca-648bb4caa6f2") : secret "insights-runtime-extractor-tls" not found Sep 10 12:22:02.689936 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:02.689901 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:02.788131 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:02.788046 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:02.954896 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:02.954856 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:03.047715 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:03.047631 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:03.564001 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:03.563973 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9n2jk_7dd906be-8681-4057-9033-c0abf30b61be/dns-node-resolver/0.log" Sep 10 12:22:03.606302 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:03.606264 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:03.606463 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:03.606323 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:03.606463 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:03.606387 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:22:03.606463 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:03.606448 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm podName:c6cb426d-295d-410d-b8ca-648bb4caa6f2 nodeName:}" failed. No retries permitted until 2026-09-10 12:22:05.606432905 +0000 UTC m=+50.893702578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7pvnm" (UID: "c6cb426d-295d-410d-b8ca-648bb4caa6f2") : configmap "kube-rbac-proxy" not found Sep 10 12:22:03.606608 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:03.606489 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:22:03.606608 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:03.606548 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls podName:c6cb426d-295d-410d-b8ca-648bb4caa6f2 nodeName:}" failed. No retries permitted until 2026-09-10 12:22:05.606532487 +0000 UTC m=+50.893802162 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7pvnm" (UID: "c6cb426d-295d-410d-b8ca-648bb4caa6f2") : secret "insights-runtime-extractor-tls" not found Sep 10 12:22:04.563362 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.563330 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bpn7r_fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4/node-ca/0.log" Sep 10 12:22:04.586308 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.586278 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-f4p2t"] Sep 10 12:22:04.598119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.598096 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-f4p2t" Sep 10 12:22:04.604305 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.603921 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 10 12:22:04.605197 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.605170 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6q6z8\"" Sep 10 12:22:04.605310 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.605204 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 10 12:22:04.605310 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.605167 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 10 12:22:04.605430 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.605355 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 10 12:22:04.606864 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.606845 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-f4p2t"] Sep 10 12:22:04.643838 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.643812 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:04.714581 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.714552 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f816c899-44b3-44af-8e5b-54c7fec040ae-signing-key\") pod \"service-ca-75d99c484-f4p2t\" (UID: \"f816c899-44b3-44af-8e5b-54c7fec040ae\") " pod="openshift-service-ca/service-ca-75d99c484-f4p2t" Sep 10 12:22:04.714733 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.714617 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f816c899-44b3-44af-8e5b-54c7fec040ae-signing-cabundle\") pod \"service-ca-75d99c484-f4p2t\" (UID: \"f816c899-44b3-44af-8e5b-54c7fec040ae\") " pod="openshift-service-ca/service-ca-75d99c484-f4p2t" Sep 10 12:22:04.714733 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.714645 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf2fp\" (UniqueName: \"kubernetes.io/projected/f816c899-44b3-44af-8e5b-54c7fec040ae-kube-api-access-hf2fp\") pod \"service-ca-75d99c484-f4p2t\" (UID: \"f816c899-44b3-44af-8e5b-54c7fec040ae\") " pod="openshift-service-ca/service-ca-75d99c484-f4p2t" Sep 10 12:22:04.740909 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.740880 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:04.815778 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.815702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f816c899-44b3-44af-8e5b-54c7fec040ae-signing-key\") pod \"service-ca-75d99c484-f4p2t\" (UID: \"f816c899-44b3-44af-8e5b-54c7fec040ae\") " pod="openshift-service-ca/service-ca-75d99c484-f4p2t" Sep 10 12:22:04.815778 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.815767 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f816c899-44b3-44af-8e5b-54c7fec040ae-signing-cabundle\") pod \"service-ca-75d99c484-f4p2t\" (UID: \"f816c899-44b3-44af-8e5b-54c7fec040ae\") " pod="openshift-service-ca/service-ca-75d99c484-f4p2t" Sep 10 12:22:04.815955 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.815794 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf2fp\" (UniqueName: \"kubernetes.io/projected/f816c899-44b3-44af-8e5b-54c7fec040ae-kube-api-access-hf2fp\") pod \"service-ca-75d99c484-f4p2t\" (UID: \"f816c899-44b3-44af-8e5b-54c7fec040ae\") " pod="openshift-service-ca/service-ca-75d99c484-f4p2t" Sep 10 12:22:04.816574 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.816527 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f816c899-44b3-44af-8e5b-54c7fec040ae-signing-cabundle\") pod \"service-ca-75d99c484-f4p2t\" (UID: \"f816c899-44b3-44af-8e5b-54c7fec040ae\") " pod="openshift-service-ca/service-ca-75d99c484-f4p2t" Sep 10 12:22:04.818422 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.818398 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f816c899-44b3-44af-8e5b-54c7fec040ae-signing-key\") pod \"service-ca-75d99c484-f4p2t\" (UID: \"f816c899-44b3-44af-8e5b-54c7fec040ae\") " pod="openshift-service-ca/service-ca-75d99c484-f4p2t" Sep 10 12:22:04.824963 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.824941 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf2fp\" (UniqueName: \"kubernetes.io/projected/f816c899-44b3-44af-8e5b-54c7fec040ae-kube-api-access-hf2fp\") pod \"service-ca-75d99c484-f4p2t\" (UID: \"f816c899-44b3-44af-8e5b-54c7fec040ae\") " pod="openshift-service-ca/service-ca-75d99c484-f4p2t" Sep 10 12:22:04.907301 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:04.907265 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-f4p2t" Sep 10 12:22:05.199091 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:05.199016 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-f4p2t"] Sep 10 12:22:05.201954 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:22:05.201917 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf816c899_44b3_44af_8e5b_54c7fec040ae.slice/crio-5153415ce8e10b7e93fa55babdeff52f6875eac76e7807009199e35c06c1bd43 WatchSource:0}: Error finding container 5153415ce8e10b7e93fa55babdeff52f6875eac76e7807009199e35c06c1bd43: Status 404 returned error can't find the container with id 5153415ce8e10b7e93fa55babdeff52f6875eac76e7807009199e35c06c1bd43 Sep 10 12:22:05.365454 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:05.365420 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6ckhj_8ade03c9-a18b-4685-b3f5-f5a0afe370db/serve-healthcheck-canary/0.log" Sep 10 12:22:05.421666 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:05.421635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:22:05.421774 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:05.421672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:22:05.421823 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:05.421771 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 12:22:05.421823 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:05.421779 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 12:22:05.421823 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:05.421796 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb54b5566-9v2jw: secret "image-registry-tls" not found Sep 10 12:22:05.421823 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:05.421823 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls podName:4f1a26af-be97-46a4-87a9-6f3e8da1123e nodeName:}" failed. No retries permitted until 2026-09-10 12:22:21.421809592 +0000 UTC m=+66.709079252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls") pod "dns-default-9mtfb" (UID: "4f1a26af-be97-46a4-87a9-6f3e8da1123e") : secret "dns-default-metrics-tls" not found Sep 10 12:22:05.421962 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:05.421846 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls podName:44cc9151-0956-4e90-9be6-5f792389eabe nodeName:}" failed. No retries permitted until 2026-09-10 12:22:21.421832947 +0000 UTC m=+66.709102636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls") pod "image-registry-5cb54b5566-9v2jw" (UID: "44cc9151-0956-4e90-9be6-5f792389eabe") : secret "image-registry-tls" not found Sep 10 12:22:05.512363 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:05.512327 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-f4p2t" event={"ID":"f816c899-44b3-44af-8e5b-54c7fec040ae","Type":"ContainerStarted","Data":"5153415ce8e10b7e93fa55babdeff52f6875eac76e7807009199e35c06c1bd43"} Sep 10 12:22:05.623397 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:05.623361 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:05.623773 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:05.623410 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:05.623773 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:05.623486 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:22:05.623773 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:05.623500 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:22:05.623773 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:05.623552 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm podName:c6cb426d-295d-410d-b8ca-648bb4caa6f2 nodeName:}" failed. No retries permitted until 2026-09-10 12:22:09.623535978 +0000 UTC m=+54.910805638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7pvnm" (UID: "c6cb426d-295d-410d-b8ca-648bb4caa6f2") : configmap "kube-rbac-proxy" not found Sep 10 12:22:05.623773 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:05.623566 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls podName:c6cb426d-295d-410d-b8ca-648bb4caa6f2 nodeName:}" failed. No retries permitted until 2026-09-10 12:22:09.623559909 +0000 UTC m=+54.910829567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7pvnm" (UID: "c6cb426d-295d-410d-b8ca-648bb4caa6f2") : secret "insights-runtime-extractor-tls" not found Sep 10 12:22:05.761067 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:05.761026 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:05.863896 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:05.863790 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:08.521196 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:08.521160 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-f4p2t" event={"ID":"f816c899-44b3-44af-8e5b-54c7fec040ae","Type":"ContainerStarted","Data":"55019d4f4459645b7c20042b09e6b977ebacd1ec2ed9d1a3029c488b9843d4c8"} Sep 10 12:22:08.543641 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:08.543598 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-f4p2t" podStartSLOduration=2.088326114 podStartE2EDuration="4.543584551s" totalImagesPullingTime="2.455258437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:22:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:22:08.543299502 +0000 UTC m=+53.830569182" watchObservedRunningTime="2026-09-10 12:22:08.543584551 +0000 UTC m=+53.830854228" Sep 10 12:22:09.236916 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:09.236885 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:09.450535 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:09.450485 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:09.555369 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:09.555247 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:09.655681 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:09.655637 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:09.656673 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:09.656649 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:09.656747 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:09.656705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:09.656808 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:09.656781 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 12:22:09.656862 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:09.656844 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm podName:c6cb426d-295d-410d-b8ca-648bb4caa6f2 nodeName:}" failed. No retries permitted until 2026-09-10 12:22:17.65682556 +0000 UTC m=+62.944095229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7pvnm" (UID: "c6cb426d-295d-410d-b8ca-648bb4caa6f2") : configmap "kube-rbac-proxy" not found Sep 10 12:22:09.657334 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:09.656975 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:22:09.657334 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:09.657029 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls podName:c6cb426d-295d-410d-b8ca-648bb4caa6f2 nodeName:}" failed. No retries permitted until 2026-09-10 12:22:17.657015811 +0000 UTC m=+62.944285480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7pvnm" (UID: "c6cb426d-295d-410d-b8ca-648bb4caa6f2") : secret "insights-runtime-extractor-tls" not found Sep 10 12:22:09.936080 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:09.935988 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:10.145633 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:10.145590 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:10.736970 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:10.736937 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:11.375306 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:11.375256 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:11.586826 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:11.586792 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:11.734327 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:11.734293 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:12.159768 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:12.159677 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:12.881877 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:12.881846 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:12.982096 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:12.982064 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:13.134715 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:13.134629 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:13.331602 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:13.331568 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:13.549763 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:13.549733 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:13.754683 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:13.754651 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:13.849866 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:13.849786 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:14.144708 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:14.144628 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:14.457818 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:14.457739 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fm7wp" Sep 10 12:22:14.735816 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:14.735784 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:15.000341 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:15.000244 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:15.337577 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:15.337501 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:15.534642 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:15.534606 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:15.710311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:15.710231 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:15.953454 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:15.953424 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:16.168336 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:16.168294 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:16.552358 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:16.552314 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:17.721895 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:17.721850 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:17.722331 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:17.721915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:17.722331 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:17.722023 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 12:22:17.722331 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:17.722077 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls podName:c6cb426d-295d-410d-b8ca-648bb4caa6f2 nodeName:}" failed. No retries permitted until 2026-09-10 12:22:33.722063234 +0000 UTC m=+79.009332895 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7pvnm" (UID: "c6cb426d-295d-410d-b8ca-648bb4caa6f2") : secret "insights-runtime-extractor-tls" not found Sep 10 12:22:17.722531 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:17.722508 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6cb426d-295d-410d-b8ca-648bb4caa6f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:18.156697 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:18.156610 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:18.300295 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:18.300264 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:18.571431 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:18.571394 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:18.748008 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:18.747977 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:19.617869 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:19.617835 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:19.764945 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:19.764914 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:19.969560 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:19.969527 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:20.754249 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:20.754212 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:20.845566 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:20.845540 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:20.946086 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:20.946063 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs\") pod \"network-metrics-daemon-chlvc\" (UID: \"b1def400-ba5c-452a-af47-acdcc7572604\") " pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:22:20.946208 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:20.946095 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret\") pod \"global-pull-secret-syncer-w88dt\" (UID: \"7837a526-e410-47f6-8676-b6737e88b1e6\") " pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:22:20.949208 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:20.949193 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 12:22:20.950279 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:20.950264 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 12:22:20.958760 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:20.958741 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1def400-ba5c-452a-af47-acdcc7572604-metrics-certs\") pod \"network-metrics-daemon-chlvc\" (UID: \"b1def400-ba5c-452a-af47-acdcc7572604\") " pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:22:20.958842 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:20.958807 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7837a526-e410-47f6-8676-b6737e88b1e6-original-pull-secret\") pod \"global-pull-secret-syncer-w88dt\" (UID: \"7837a526-e410-47f6-8676-b6737e88b1e6\") " pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:22:21.047174 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.047106 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtx8z\" (UniqueName: \"kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z\") pod \"network-check-target-prnjr\" (UID: \"e1c75fe5-5d36-4709-bd85-aec96a0ce2c3\") " pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:22:21.050145 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.050119 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 12:22:21.061019 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.061002 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 12:22:21.070057 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.070031 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtx8z\" (UniqueName: \"kubernetes.io/projected/e1c75fe5-5d36-4709-bd85-aec96a0ce2c3-kube-api-access-rtx8z\") pod \"network-check-target-prnjr\" (UID: \"e1c75fe5-5d36-4709-bd85-aec96a0ce2c3\") " pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:22:21.212332 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.212307 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w88dt" Sep 10 12:22:21.220551 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.220536 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h2jhp\"" Sep 10 12:22:21.226765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.226741 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-clmmz\"" Sep 10 12:22:21.228813 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.228794 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-chlvc" Sep 10 12:22:21.234582 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.234561 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:22:21.450402 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.450371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:22:21.450402 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.450404 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:22:21.452713 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.452692 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f1a26af-be97-46a4-87a9-6f3e8da1123e-metrics-tls\") pod \"dns-default-9mtfb\" (UID: \"4f1a26af-be97-46a4-87a9-6f3e8da1123e\") " pod="openshift-dns/dns-default-9mtfb" Sep 10 12:22:21.452829 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.452812 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls\") pod \"image-registry-5cb54b5566-9v2jw\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:22:21.486568 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.486540 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w88dt"] Sep 10 12:22:21.490092 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:22:21.490063 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7837a526_e410_47f6_8676_b6737e88b1e6.slice/crio-9ed178928347e8732781947b8a66c0b3d65dae927cd64aaff58a5b7041d075a7 WatchSource:0}: Error finding container 9ed178928347e8732781947b8a66c0b3d65dae927cd64aaff58a5b7041d075a7: Status 404 returned error can't find the container with id 9ed178928347e8732781947b8a66c0b3d65dae927cd64aaff58a5b7041d075a7 Sep 10 12:22:21.510032 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.510013 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-chlvc"] Sep 10 12:22:21.512156 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:22:21.512117 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1def400_ba5c_452a_af47_acdcc7572604.slice/crio-a6314bc851c17c600a5fc9b2b0115e8a490fe9a95be6e1e79150480c09499ae8 WatchSource:0}: Error finding container a6314bc851c17c600a5fc9b2b0115e8a490fe9a95be6e1e79150480c09499ae8: Status 404 returned error can't find the container with id a6314bc851c17c600a5fc9b2b0115e8a490fe9a95be6e1e79150480c09499ae8 Sep 10 12:22:21.520605 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.520584 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-prnjr"] Sep 10 12:22:21.523767 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:22:21.523748 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c75fe5_5d36_4709_bd85_aec96a0ce2c3.slice/crio-d24f333dc9c22370e67db763b2244291f90a5f3d1cae3b57b696e98ab320c837 WatchSource:0}: Error finding container d24f333dc9c22370e67db763b2244291f90a5f3d1cae3b57b696e98ab320c837: Status 404 returned error can't find the container with id d24f333dc9c22370e67db763b2244291f90a5f3d1cae3b57b696e98ab320c837 Sep 10 12:22:21.553065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.553043 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-chlvc" event={"ID":"b1def400-ba5c-452a-af47-acdcc7572604","Type":"ContainerStarted","Data":"a6314bc851c17c600a5fc9b2b0115e8a490fe9a95be6e1e79150480c09499ae8"} Sep 10 12:22:21.554224 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.554203 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w88dt" event={"ID":"7837a526-e410-47f6-8676-b6737e88b1e6","Type":"ContainerStarted","Data":"9ed178928347e8732781947b8a66c0b3d65dae927cd64aaff58a5b7041d075a7"} Sep 10 12:22:21.555274 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.555257 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-prnjr" event={"ID":"e1c75fe5-5d36-4709-bd85-aec96a0ce2c3","Type":"ContainerStarted","Data":"d24f333dc9c22370e67db763b2244291f90a5f3d1cae3b57b696e98ab320c837"} Sep 10 12:22:21.666513 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.666453 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q8zld\"" Sep 10 12:22:21.673309 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.673287 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2wbft\"" Sep 10 12:22:21.674338 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.674324 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:22:21.681856 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.681833 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9mtfb" Sep 10 12:22:21.953048 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.952977 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb54b5566-9v2jw"] Sep 10 12:22:21.955825 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:22:21.955802 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44cc9151_0956_4e90_9be6_5f792389eabe.slice/crio-98e2f5ce93af7affa17e1763de8f69c755026c07364d6db37b85c4e34250494e WatchSource:0}: Error finding container 98e2f5ce93af7affa17e1763de8f69c755026c07364d6db37b85c4e34250494e: Status 404 returned error can't find the container with id 98e2f5ce93af7affa17e1763de8f69c755026c07364d6db37b85c4e34250494e Sep 10 12:22:21.969206 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:21.969161 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9mtfb"] Sep 10 12:22:21.971733 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:22:21.971701 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f1a26af_be97_46a4_87a9_6f3e8da1123e.slice/crio-6cea8595ffb8bde2e7a3efcaae5bf8bf88f95b66c15c01f5c5ff46bff775fcfd WatchSource:0}: Error finding container 6cea8595ffb8bde2e7a3efcaae5bf8bf88f95b66c15c01f5c5ff46bff775fcfd: Status 404 returned error can't find the container with id 6cea8595ffb8bde2e7a3efcaae5bf8bf88f95b66c15c01f5c5ff46bff775fcfd Sep 10 12:22:22.559661 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:22.559613 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9mtfb" event={"ID":"4f1a26af-be97-46a4-87a9-6f3e8da1123e","Type":"ContainerStarted","Data":"6cea8595ffb8bde2e7a3efcaae5bf8bf88f95b66c15c01f5c5ff46bff775fcfd"} Sep 10 12:22:22.561326 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:22.561297 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" event={"ID":"44cc9151-0956-4e90-9be6-5f792389eabe","Type":"ContainerStarted","Data":"c1793a55e36179b9974ae4b75000049f17fe9dd48888583f6fcbc9cd6886d41e"} Sep 10 12:22:22.561464 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:22.561346 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" event={"ID":"44cc9151-0956-4e90-9be6-5f792389eabe","Type":"ContainerStarted","Data":"98e2f5ce93af7affa17e1763de8f69c755026c07364d6db37b85c4e34250494e"} Sep 10 12:22:22.562080 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:22.562055 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:22:22.592032 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:22.591979 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" podStartSLOduration=55.591962013 podStartE2EDuration="55.591962013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:22:22.591506254 +0000 UTC m=+67.878775949" watchObservedRunningTime="2026-09-10 12:22:22.591962013 +0000 UTC m=+67.879231697" Sep 10 12:22:23.566555 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:23.566520 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-chlvc" event={"ID":"b1def400-ba5c-452a-af47-acdcc7572604","Type":"ContainerStarted","Data":"74ab2b39429c889bb7db46db9501f164dbafcce326e41d7215b488a6335e266a"} Sep 10 12:22:23.566969 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:23.566579 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-chlvc" event={"ID":"b1def400-ba5c-452a-af47-acdcc7572604","Type":"ContainerStarted","Data":"74086a67b9f09060f82c88d7eb8ca20af1053541696b6adf9c281a0cc4647d92"} Sep 10 12:22:23.587661 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:23.587613 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-chlvc" podStartSLOduration=67.44931143 podStartE2EDuration="1m8.587597497s" totalImagesPullingTime="1.138286067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:22:23.586171064 +0000 UTC m=+68.873440747" watchObservedRunningTime="2026-09-10 12:22:23.587597497 +0000 UTC m=+68.874867174" Sep 10 12:22:24.574847 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:24.574814 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9mtfb" event={"ID":"4f1a26af-be97-46a4-87a9-6f3e8da1123e","Type":"ContainerStarted","Data":"fa034cfd2bd949e6f1ca301bdd98f42ec9be33f9cb09592e212c1f8958a0f23d"} Sep 10 12:22:24.575327 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:24.574866 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9mtfb" event={"ID":"4f1a26af-be97-46a4-87a9-6f3e8da1123e","Type":"ContainerStarted","Data":"44881055fc2c4d2fdfde85db717656b59cfd68242e5a2829b42b16bca27b86b2"} Sep 10 12:22:24.575327 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:24.575214 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9mtfb" Sep 10 12:22:24.608894 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:24.608002 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9mtfb" podStartSLOduration=33.377810131 podStartE2EDuration="35.60798378s" totalImagesPullingTime="2.230173649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:22:24.606624064 +0000 UTC m=+69.893893746" watchObservedRunningTime="2026-09-10 12:22:24.60798378 +0000 UTC m=+69.895253459" Sep 10 12:22:26.669954 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:26.669926 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cb54b5566-9v2jw"] Sep 10 12:22:26.758983 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:26.758933 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:26.889859 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:26.889815 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:27.011087 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:27.011029 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:27.110796 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:27.110701 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:28.589016 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:28.588980 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-prnjr" event={"ID":"e1c75fe5-5d36-4709-bd85-aec96a0ce2c3","Type":"ContainerStarted","Data":"9286b112c79fd2d6d51c4c3ce5283bd75228b604fee2cdcfdaaf67a79eda8f6a"} Sep 10 12:22:28.589496 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:28.589032 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:22:28.590502 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:28.590479 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w88dt" event={"ID":"7837a526-e410-47f6-8676-b6737e88b1e6","Type":"ContainerStarted","Data":"76091e8d4747260c9671be74e82f1ef604b0e32d34554bd270c1e242a297541b"} Sep 10 12:22:28.608343 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:28.608285 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-prnjr" podStartSLOduration=67.493318417 podStartE2EDuration="1m13.60826894s" totalImagesPullingTime="6.114950523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:22:28.607198683 +0000 UTC m=+73.894468361" watchObservedRunningTime="2026-09-10 12:22:28.60826894 +0000 UTC m=+73.895538675" Sep 10 12:22:28.634508 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:28.632281 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w88dt" podStartSLOduration=67.49274233 podStartE2EDuration="1m13.632259192s" totalImagesPullingTime="6.139516862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:22:28.631593037 +0000 UTC m=+73.918862716" watchObservedRunningTime="2026-09-10 12:22:28.632259192 +0000 UTC m=+73.919528871" Sep 10 12:22:33.014598 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:33.014564 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:33.117587 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:33.117552 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:33.740759 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:33.740721 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:33.743069 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:33.743042 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6cb426d-295d-410d-b8ca-648bb4caa6f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7pvnm\" (UID: \"c6cb426d-295d-410d-b8ca-648bb4caa6f2\") " pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:34.014554 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:34.014481 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6gvwr\"" Sep 10 12:22:34.021850 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:34.021835 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7pvnm" Sep 10 12:22:34.301230 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:34.301083 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7pvnm"] Sep 10 12:22:34.304026 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:22:34.304006 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6cb426d_295d_410d_b8ca_648bb4caa6f2.slice/crio-ced7d1d62f376af63fbd4fd5b95c26b4cc4811b554458fef3b54af01aa21d82a WatchSource:0}: Error finding container ced7d1d62f376af63fbd4fd5b95c26b4cc4811b554458fef3b54af01aa21d82a: Status 404 returned error can't find the container with id ced7d1d62f376af63fbd4fd5b95c26b4cc4811b554458fef3b54af01aa21d82a Sep 10 12:22:34.609735 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:34.609660 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7pvnm" event={"ID":"c6cb426d-295d-410d-b8ca-648bb4caa6f2","Type":"ContainerStarted","Data":"006b1a4b32855482d8882c5cb54187ca88ed25746af0ef57bc38916e1d9609b4"} Sep 10 12:22:34.609735 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:34.609718 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7pvnm" event={"ID":"c6cb426d-295d-410d-b8ca-648bb4caa6f2","Type":"ContainerStarted","Data":"ced7d1d62f376af63fbd4fd5b95c26b4cc4811b554458fef3b54af01aa21d82a"} Sep 10 12:22:35.574690 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:35.574656 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:35.584112 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:35.584089 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9mtfb" Sep 10 12:22:35.614347 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:35.614320 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7pvnm" event={"ID":"c6cb426d-295d-410d-b8ca-648bb4caa6f2","Type":"ContainerStarted","Data":"601589623be62470325af5ba09480591308b089e8c06f506cf1b155b2d18d9e6"} Sep 10 12:22:35.671987 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:35.671954 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:36.568814 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:36.568703 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:36.670288 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:36.670257 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:37.621694 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:37.621664 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7pvnm" event={"ID":"c6cb426d-295d-410d-b8ca-648bb4caa6f2","Type":"ContainerStarted","Data":"c9dacfe492ec61077325ee8921b2a2ad499dcfa3e971b48c2fdf07027e595fba"} Sep 10 12:22:37.652228 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:37.652186 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7pvnm" podStartSLOduration=34.485934169 podStartE2EDuration="36.652171592s" totalImagesPullingTime="2.166237423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:22:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:22:37.651001749 +0000 UTC m=+82.938271428" watchObservedRunningTime="2026-09-10 12:22:37.652171592 +0000 UTC m=+82.939441269" Sep 10 12:22:39.666557 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:39.666523 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:39.754417 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:39.754383 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:45.609035 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:45.608995 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:45.716042 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:45.716004 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:46.675624 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:46.675597 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:22:48.218570 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:48.218522 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:48.331616 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:48.331587 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:48.429537 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:48.429505 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z52fc"] Sep 10 12:22:48.434831 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:48.434815 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z52fc" Sep 10 12:22:48.437519 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:48.437497 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 10 12:22:48.437603 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:48.437552 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zsbqm\"" Sep 10 12:22:48.444451 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:48.444425 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:48.444974 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:48.444955 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z52fc"] Sep 10 12:22:48.537720 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:48.537645 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d063e011-7e3c-465f-be14-8e69aca02b73-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-z52fc\" (UID: \"d063e011-7e3c-465f-be14-8e69aca02b73\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z52fc" Sep 10 12:22:48.566485 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:48.566461 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:48.638343 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:48.638320 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d063e011-7e3c-465f-be14-8e69aca02b73-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-z52fc\" (UID: \"d063e011-7e3c-465f-be14-8e69aca02b73\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z52fc" Sep 10 12:22:48.640809 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:48.640780 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d063e011-7e3c-465f-be14-8e69aca02b73-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-z52fc\" (UID: \"d063e011-7e3c-465f-be14-8e69aca02b73\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z52fc" Sep 10 12:22:48.644484 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:48.644451 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:48.743471 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:48.743433 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z52fc" Sep 10 12:22:48.776628 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:48.776596 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:48.878835 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:48.878803 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:49.016694 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:49.016670 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z52fc"] Sep 10 12:22:49.018989 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:49.018958 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:49.019343 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:22:49.019323 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd063e011_7e3c_465f_be14_8e69aca02b73.slice/crio-613c9bdfc6fc6777900c3f96ff31aee79c64f48d8454ce30dec791018937d201 WatchSource:0}: Error finding container 613c9bdfc6fc6777900c3f96ff31aee79c64f48d8454ce30dec791018937d201: Status 404 returned error can't find the container with id 613c9bdfc6fc6777900c3f96ff31aee79c64f48d8454ce30dec791018937d201 Sep 10 12:22:49.123975 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:49.123891 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:49.659298 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:49.659251 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z52fc" event={"ID":"d063e011-7e3c-465f-be14-8e69aca02b73","Type":"ContainerStarted","Data":"613c9bdfc6fc6777900c3f96ff31aee79c64f48d8454ce30dec791018937d201"} Sep 10 12:22:50.664255 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:50.664223 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z52fc" event={"ID":"d063e011-7e3c-465f-be14-8e69aca02b73","Type":"ContainerStarted","Data":"dae1fd24aae98331c458d1449a406032f800dffa7f1baf99264a784f43cfb431"} Sep 10 12:22:50.664678 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:50.664391 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z52fc" Sep 10 12:22:50.669160 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:50.669124 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z52fc" Sep 10 12:22:50.687710 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:50.687668 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-z52fc" podStartSLOduration=1.518814154 podStartE2EDuration="2.6876555s" totalImagesPullingTime="1.168841346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:22:50.686957802 +0000 UTC m=+95.974227480" watchObservedRunningTime="2026-09-10 12:22:50.6876555 +0000 UTC m=+95.974925177" Sep 10 12:22:50.922016 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:50.921928 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:51.082016 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.081976 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:51.457755 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.457711 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:51.491336 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.491312 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-kqzfd"] Sep 10 12:22:51.494269 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.494255 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" Sep 10 12:22:51.498289 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.498265 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 12:22:51.498289 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.498279 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 10 12:22:51.498458 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.498292 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-b6pjw\"" Sep 10 12:22:51.498458 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.498300 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 12:22:51.498458 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.498285 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 10 12:22:51.498699 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.498682 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 12:22:51.504803 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.504779 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-kqzfd"] Sep 10 12:22:51.558106 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.558081 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/90ae54f4-6a24-415f-a59c-eaa6f1fb55c8-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-kqzfd\" (UID: \"90ae54f4-6a24-415f-a59c-eaa6f1fb55c8\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" Sep 10 12:22:51.558220 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.558119 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90ae54f4-6a24-415f-a59c-eaa6f1fb55c8-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-kqzfd\" (UID: \"90ae54f4-6a24-415f-a59c-eaa6f1fb55c8\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" Sep 10 12:22:51.558220 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.558152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqc8n\" (UniqueName: \"kubernetes.io/projected/90ae54f4-6a24-415f-a59c-eaa6f1fb55c8-kube-api-access-tqc8n\") pod \"prometheus-operator-6f4946db56-kqzfd\" (UID: \"90ae54f4-6a24-415f-a59c-eaa6f1fb55c8\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" Sep 10 12:22:51.558220 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.558209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90ae54f4-6a24-415f-a59c-eaa6f1fb55c8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-kqzfd\" (UID: \"90ae54f4-6a24-415f-a59c-eaa6f1fb55c8\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" Sep 10 12:22:51.579178 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.579154 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:51.659231 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.659203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90ae54f4-6a24-415f-a59c-eaa6f1fb55c8-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-kqzfd\" (UID: \"90ae54f4-6a24-415f-a59c-eaa6f1fb55c8\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" Sep 10 12:22:51.659335 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.659236 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqc8n\" (UniqueName: \"kubernetes.io/projected/90ae54f4-6a24-415f-a59c-eaa6f1fb55c8-kube-api-access-tqc8n\") pod \"prometheus-operator-6f4946db56-kqzfd\" (UID: \"90ae54f4-6a24-415f-a59c-eaa6f1fb55c8\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" Sep 10 12:22:51.659335 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.659285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90ae54f4-6a24-415f-a59c-eaa6f1fb55c8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-kqzfd\" (UID: \"90ae54f4-6a24-415f-a59c-eaa6f1fb55c8\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" Sep 10 12:22:51.659335 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.659318 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/90ae54f4-6a24-415f-a59c-eaa6f1fb55c8-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-kqzfd\" (UID: \"90ae54f4-6a24-415f-a59c-eaa6f1fb55c8\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" Sep 10 12:22:51.659488 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:51.659431 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 10 12:22:51.659534 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:51.659498 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90ae54f4-6a24-415f-a59c-eaa6f1fb55c8-prometheus-operator-tls podName:90ae54f4-6a24-415f-a59c-eaa6f1fb55c8 nodeName:}" failed. No retries permitted until 2026-09-10 12:22:52.159477963 +0000 UTC m=+97.446747632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/90ae54f4-6a24-415f-a59c-eaa6f1fb55c8-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-kqzfd" (UID: "90ae54f4-6a24-415f-a59c-eaa6f1fb55c8") : secret "prometheus-operator-tls" not found Sep 10 12:22:51.659874 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.659854 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90ae54f4-6a24-415f-a59c-eaa6f1fb55c8-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-kqzfd\" (UID: \"90ae54f4-6a24-415f-a59c-eaa6f1fb55c8\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" Sep 10 12:22:51.661815 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.661794 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90ae54f4-6a24-415f-a59c-eaa6f1fb55c8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-kqzfd\" (UID: \"90ae54f4-6a24-415f-a59c-eaa6f1fb55c8\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" Sep 10 12:22:51.670779 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.670757 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqc8n\" (UniqueName: \"kubernetes.io/projected/90ae54f4-6a24-415f-a59c-eaa6f1fb55c8-kube-api-access-tqc8n\") pod \"prometheus-operator-6f4946db56-kqzfd\" (UID: \"90ae54f4-6a24-415f-a59c-eaa6f1fb55c8\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" Sep 10 12:22:51.692343 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.692314 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" podUID="44cc9151-0956-4e90-9be6-5f792389eabe" containerName="registry" containerID="cri-o://c1793a55e36179b9974ae4b75000049f17fe9dd48888583f6fcbc9cd6886d41e" gracePeriod=30 Sep 10 12:22:51.930475 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:51.930450 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:22:52.007788 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.007752 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:52.062959 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.062898 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/44cc9151-0956-4e90-9be6-5f792389eabe-installation-pull-secrets\") pod \"44cc9151-0956-4e90-9be6-5f792389eabe\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " Sep 10 12:22:52.062959 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.062933 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/44cc9151-0956-4e90-9be6-5f792389eabe-image-registry-private-configuration\") pod \"44cc9151-0956-4e90-9be6-5f792389eabe\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " Sep 10 12:22:52.062959 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.062953 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls\") pod \"44cc9151-0956-4e90-9be6-5f792389eabe\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " Sep 10 12:22:52.063244 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.062970 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/44cc9151-0956-4e90-9be6-5f792389eabe-ca-trust-extracted\") pod \"44cc9151-0956-4e90-9be6-5f792389eabe\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " Sep 10 12:22:52.063244 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.062995 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-bound-sa-token\") pod \"44cc9151-0956-4e90-9be6-5f792389eabe\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " Sep 10 12:22:52.063244 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.063017 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44cc9151-0956-4e90-9be6-5f792389eabe-trusted-ca\") pod \"44cc9151-0956-4e90-9be6-5f792389eabe\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " Sep 10 12:22:52.063244 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.063040 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pmqp\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-kube-api-access-4pmqp\") pod \"44cc9151-0956-4e90-9be6-5f792389eabe\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " Sep 10 12:22:52.063244 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.063076 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/44cc9151-0956-4e90-9be6-5f792389eabe-registry-certificates\") pod \"44cc9151-0956-4e90-9be6-5f792389eabe\" (UID: \"44cc9151-0956-4e90-9be6-5f792389eabe\") " Sep 10 12:22:52.063551 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.063525 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44cc9151-0956-4e90-9be6-5f792389eabe-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "44cc9151-0956-4e90-9be6-5f792389eabe" (UID: "44cc9151-0956-4e90-9be6-5f792389eabe"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:22:52.063685 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.063585 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44cc9151-0956-4e90-9be6-5f792389eabe-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "44cc9151-0956-4e90-9be6-5f792389eabe" (UID: "44cc9151-0956-4e90-9be6-5f792389eabe"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:22:52.065426 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.065397 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44cc9151-0956-4e90-9be6-5f792389eabe-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "44cc9151-0956-4e90-9be6-5f792389eabe" (UID: "44cc9151-0956-4e90-9be6-5f792389eabe"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:22:52.065521 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.065441 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-kube-api-access-4pmqp" (OuterVolumeSpecName: "kube-api-access-4pmqp") pod "44cc9151-0956-4e90-9be6-5f792389eabe" (UID: "44cc9151-0956-4e90-9be6-5f792389eabe"). InnerVolumeSpecName "kube-api-access-4pmqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:22:52.065730 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.065710 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44cc9151-0956-4e90-9be6-5f792389eabe-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "44cc9151-0956-4e90-9be6-5f792389eabe" (UID: "44cc9151-0956-4e90-9be6-5f792389eabe"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:22:52.065834 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.065816 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "44cc9151-0956-4e90-9be6-5f792389eabe" (UID: "44cc9151-0956-4e90-9be6-5f792389eabe"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:22:52.065901 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.065887 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "44cc9151-0956-4e90-9be6-5f792389eabe" (UID: "44cc9151-0956-4e90-9be6-5f792389eabe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:22:52.071180 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.071159 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44cc9151-0956-4e90-9be6-5f792389eabe-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "44cc9151-0956-4e90-9be6-5f792389eabe" (UID: "44cc9151-0956-4e90-9be6-5f792389eabe"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:22:52.163575 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.163546 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/90ae54f4-6a24-415f-a59c-eaa6f1fb55c8-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-kqzfd\" (UID: \"90ae54f4-6a24-415f-a59c-eaa6f1fb55c8\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" Sep 10 12:22:52.163709 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.163588 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/44cc9151-0956-4e90-9be6-5f792389eabe-installation-pull-secrets\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:22:52.163709 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.163600 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/44cc9151-0956-4e90-9be6-5f792389eabe-image-registry-private-configuration\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:22:52.163709 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.163609 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-registry-tls\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:22:52.163709 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.163617 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/44cc9151-0956-4e90-9be6-5f792389eabe-ca-trust-extracted\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:22:52.163709 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.163627 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-bound-sa-token\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:22:52.163709 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.163634 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/44cc9151-0956-4e90-9be6-5f792389eabe-trusted-ca\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:22:52.163709 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.163642 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pmqp\" (UniqueName: \"kubernetes.io/projected/44cc9151-0956-4e90-9be6-5f792389eabe-kube-api-access-4pmqp\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:22:52.163709 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.163649 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/44cc9151-0956-4e90-9be6-5f792389eabe-registry-certificates\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:22:52.166058 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.166031 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/90ae54f4-6a24-415f-a59c-eaa6f1fb55c8-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-kqzfd\" (UID: \"90ae54f4-6a24-415f-a59c-eaa6f1fb55c8\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" Sep 10 12:22:52.403609 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.403524 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" Sep 10 12:22:52.672540 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.672515 2574 generic.go:356] "Generic (PLEG): container finished" podID="44cc9151-0956-4e90-9be6-5f792389eabe" containerID="c1793a55e36179b9974ae4b75000049f17fe9dd48888583f6fcbc9cd6886d41e" exitCode=0 Sep 10 12:22:52.672870 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.672561 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" Sep 10 12:22:52.672870 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.672612 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" event={"ID":"44cc9151-0956-4e90-9be6-5f792389eabe","Type":"ContainerDied","Data":"c1793a55e36179b9974ae4b75000049f17fe9dd48888583f6fcbc9cd6886d41e"} Sep 10 12:22:52.672870 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.672656 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb54b5566-9v2jw" event={"ID":"44cc9151-0956-4e90-9be6-5f792389eabe","Type":"ContainerDied","Data":"98e2f5ce93af7affa17e1763de8f69c755026c07364d6db37b85c4e34250494e"} Sep 10 12:22:52.672870 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.672680 2574 scope.go:117] "RemoveContainer" containerID="c1793a55e36179b9974ae4b75000049f17fe9dd48888583f6fcbc9cd6886d41e" Sep 10 12:22:52.680853 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.680834 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-kqzfd"] Sep 10 12:22:52.682131 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.682110 2574 scope.go:117] "RemoveContainer" containerID="c1793a55e36179b9974ae4b75000049f17fe9dd48888583f6fcbc9cd6886d41e" Sep 10 12:22:52.682475 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:22:52.682451 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1793a55e36179b9974ae4b75000049f17fe9dd48888583f6fcbc9cd6886d41e\": container with ID starting with c1793a55e36179b9974ae4b75000049f17fe9dd48888583f6fcbc9cd6886d41e not found: ID does not exist" containerID="c1793a55e36179b9974ae4b75000049f17fe9dd48888583f6fcbc9cd6886d41e" Sep 10 12:22:52.682538 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.682488 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1793a55e36179b9974ae4b75000049f17fe9dd48888583f6fcbc9cd6886d41e"} err="failed to get container status \"c1793a55e36179b9974ae4b75000049f17fe9dd48888583f6fcbc9cd6886d41e\": rpc error: code = NotFound desc = could not find container \"c1793a55e36179b9974ae4b75000049f17fe9dd48888583f6fcbc9cd6886d41e\": container with ID starting with c1793a55e36179b9974ae4b75000049f17fe9dd48888583f6fcbc9cd6886d41e not found: ID does not exist" Sep 10 12:22:52.682871 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:22:52.682851 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ae54f4_6a24_415f_a59c_eaa6f1fb55c8.slice/crio-c7c44b57c5c78e04f48cde635a0d06545970d57926ba137a68f72496149ed477 WatchSource:0}: Error finding container c7c44b57c5c78e04f48cde635a0d06545970d57926ba137a68f72496149ed477: Status 404 returned error can't find the container with id c7c44b57c5c78e04f48cde635a0d06545970d57926ba137a68f72496149ed477 Sep 10 12:22:52.696337 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.696314 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cb54b5566-9v2jw"] Sep 10 12:22:52.700276 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:52.700211 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5cb54b5566-9v2jw"] Sep 10 12:22:53.204168 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:53.204120 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44cc9151-0956-4e90-9be6-5f792389eabe" path="/var/lib/kubelet/pods/44cc9151-0956-4e90-9be6-5f792389eabe/volumes" Sep 10 12:22:53.677447 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:53.677414 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" event={"ID":"90ae54f4-6a24-415f-a59c-eaa6f1fb55c8","Type":"ContainerStarted","Data":"c7c44b57c5c78e04f48cde635a0d06545970d57926ba137a68f72496149ed477"} Sep 10 12:22:54.296378 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:54.296301 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:54.683580 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:54.683500 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" event={"ID":"90ae54f4-6a24-415f-a59c-eaa6f1fb55c8","Type":"ContainerStarted","Data":"a0f4aa0ae773c2b3b17276578229ea4ed314b8b4509d846397109809db662e46"} Sep 10 12:22:54.683912 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:54.683604 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" event={"ID":"90ae54f4-6a24-415f-a59c-eaa6f1fb55c8","Type":"ContainerStarted","Data":"1f6e36c74bb3aad9e785a36dcfd38f736491c8fa45d442b0e3e5c4e3966e9239"} Sep 10 12:22:54.710339 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:54.710294 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-kqzfd" podStartSLOduration=2.407253811 podStartE2EDuration="3.710276955s" totalImagesPullingTime="1.303023144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:22:54.70831909 +0000 UTC m=+99.995588780" watchObservedRunningTime="2026-09-10 12:22:54.710276955 +0000 UTC m=+99.997546636" Sep 10 12:22:56.623563 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.623526 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:56.779039 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.778997 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:56.881374 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.881279 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:56.911643 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.911611 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8"] Sep 10 12:22:56.911910 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.911897 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44cc9151-0956-4e90-9be6-5f792389eabe" containerName="registry" Sep 10 12:22:56.911984 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.911913 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="44cc9151-0956-4e90-9be6-5f792389eabe" containerName="registry" Sep 10 12:22:56.912026 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.911984 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="44cc9151-0956-4e90-9be6-5f792389eabe" containerName="registry" Sep 10 12:22:56.946969 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.946941 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wk25k"] Sep 10 12:22:56.947120 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.947076 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:56.951438 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.951416 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 10 12:22:56.951575 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.951556 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 10 12:22:56.951575 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.951418 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gcbj5\"" Sep 10 12:22:56.951695 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.951477 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 10 12:22:56.960941 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.960921 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8"] Sep 10 12:22:56.961054 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.961039 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:56.963794 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.963776 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 12:22:56.963938 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.963921 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 12:22:56.964072 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.964052 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hh7np\"" Sep 10 12:22:56.964189 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:56.964174 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 12:22:57.097845 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.097813 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7050b131-deab-43ef-85df-4bc05dcae778-node-exporter-textfile\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.097845 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.097845 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7ab4cbec-fb0b-4359-ab8d-0b158e241134-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.098083 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.097872 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7ab4cbec-fb0b-4359-ab8d-0b158e241134-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.098083 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.097899 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7050b131-deab-43ef-85df-4bc05dcae778-node-exporter-wtmp\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.098083 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.097979 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7050b131-deab-43ef-85df-4bc05dcae778-sys\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.098083 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.098016 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7050b131-deab-43ef-85df-4bc05dcae778-metrics-client-ca\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.098324 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.098096 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab4cbec-fb0b-4359-ab8d-0b158e241134-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.098324 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.098117 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ab4cbec-fb0b-4359-ab8d-0b158e241134-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.098324 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.098150 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7050b131-deab-43ef-85df-4bc05dcae778-node-exporter-tls\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.098324 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.098219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7050b131-deab-43ef-85df-4bc05dcae778-root\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.098324 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.098265 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7050b131-deab-43ef-85df-4bc05dcae778-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.098324 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.098293 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsn6m\" (UniqueName: \"kubernetes.io/projected/7050b131-deab-43ef-85df-4bc05dcae778-kube-api-access-dsn6m\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.098324 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.098322 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tmhx\" (UniqueName: \"kubernetes.io/projected/7ab4cbec-fb0b-4359-ab8d-0b158e241134-kube-api-access-7tmhx\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.098560 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.098353 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7050b131-deab-43ef-85df-4bc05dcae778-node-exporter-accelerators-collector-config\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.098560 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.098400 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ab4cbec-fb0b-4359-ab8d-0b158e241134-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.147952 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.147886 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:57.199316 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.199285 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab4cbec-fb0b-4359-ab8d-0b158e241134-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.199435 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.199327 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ab4cbec-fb0b-4359-ab8d-0b158e241134-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.199435 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.199354 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7050b131-deab-43ef-85df-4bc05dcae778-node-exporter-tls\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.199435 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.199381 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7050b131-deab-43ef-85df-4bc05dcae778-root\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.199435 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.199409 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7050b131-deab-43ef-85df-4bc05dcae778-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.199657 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.199434 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsn6m\" (UniqueName: \"kubernetes.io/projected/7050b131-deab-43ef-85df-4bc05dcae778-kube-api-access-dsn6m\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.199975 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.199944 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7050b131-deab-43ef-85df-4bc05dcae778-root\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.206025 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.200746 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ab4cbec-fb0b-4359-ab8d-0b158e241134-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.206025 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.203185 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ab4cbec-fb0b-4359-ab8d-0b158e241134-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.206219 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.205892 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7050b131-deab-43ef-85df-4bc05dcae778-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.206277 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.206218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tmhx\" (UniqueName: \"kubernetes.io/projected/7ab4cbec-fb0b-4359-ab8d-0b158e241134-kube-api-access-7tmhx\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.206394 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.206366 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7050b131-deab-43ef-85df-4bc05dcae778-node-exporter-accelerators-collector-config\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.206469 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.206442 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ab4cbec-fb0b-4359-ab8d-0b158e241134-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.206525 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.206492 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7050b131-deab-43ef-85df-4bc05dcae778-node-exporter-textfile\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.208978 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.206573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7ab4cbec-fb0b-4359-ab8d-0b158e241134-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.208978 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.206860 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7050b131-deab-43ef-85df-4bc05dcae778-node-exporter-textfile\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.208978 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.206960 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7ab4cbec-fb0b-4359-ab8d-0b158e241134-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.208978 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.207071 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7ab4cbec-fb0b-4359-ab8d-0b158e241134-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.208978 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.207105 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7050b131-deab-43ef-85df-4bc05dcae778-node-exporter-wtmp\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.208978 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.207238 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7050b131-deab-43ef-85df-4bc05dcae778-sys\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.208978 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.207282 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7050b131-deab-43ef-85df-4bc05dcae778-metrics-client-ca\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.210060 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.209531 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7050b131-deab-43ef-85df-4bc05dcae778-node-exporter-tls\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.210060 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.209764 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7050b131-deab-43ef-85df-4bc05dcae778-sys\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.212812 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.211610 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7050b131-deab-43ef-85df-4bc05dcae778-node-exporter-accelerators-collector-config\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.212812 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.211918 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7ab4cbec-fb0b-4359-ab8d-0b158e241134-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.212812 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.212244 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7050b131-deab-43ef-85df-4bc05dcae778-node-exporter-wtmp\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.212812 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.212776 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ab4cbec-fb0b-4359-ab8d-0b158e241134-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.214491 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.214468 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsn6m\" (UniqueName: \"kubernetes.io/projected/7050b131-deab-43ef-85df-4bc05dcae778-kube-api-access-dsn6m\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.220104 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.220078 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tmhx\" (UniqueName: \"kubernetes.io/projected/7ab4cbec-fb0b-4359-ab8d-0b158e241134-kube-api-access-7tmhx\") pod \"kube-state-metrics-74cb57df7-mb9p8\" (UID: \"7ab4cbec-fb0b-4359-ab8d-0b158e241134\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.224691 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.224673 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7050b131-deab-43ef-85df-4bc05dcae778-metrics-client-ca\") pod \"node-exporter-wk25k\" (UID: \"7050b131-deab-43ef-85df-4bc05dcae778\") " pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.247867 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.247841 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:57.257651 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.257626 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" Sep 10 12:22:57.270518 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.270500 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wk25k" Sep 10 12:22:57.315834 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:22:57.315810 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7050b131_deab_43ef_85df_4bc05dcae778.slice/crio-2fc4b3ab9e0df3f57854cd978377561171102c8f780a383840cfc4aeaab910bc WatchSource:0}: Error finding container 2fc4b3ab9e0df3f57854cd978377561171102c8f780a383840cfc4aeaab910bc: Status 404 returned error can't find the container with id 2fc4b3ab9e0df3f57854cd978377561171102c8f780a383840cfc4aeaab910bc Sep 10 12:22:57.350037 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.349173 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:57.565386 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.565350 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8"] Sep 10 12:22:57.568521 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:22:57.568486 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab4cbec_fb0b_4359_ab8d_0b158e241134.slice/crio-5eab353fb866d321979b5fe03a29d2012b3e31ba4da94821a2adb2751a2a8e70 WatchSource:0}: Error finding container 5eab353fb866d321979b5fe03a29d2012b3e31ba4da94821a2adb2751a2a8e70: Status 404 returned error can't find the container with id 5eab353fb866d321979b5fe03a29d2012b3e31ba4da94821a2adb2751a2a8e70 Sep 10 12:22:57.587323 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.587302 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:57.693627 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.693592 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" event={"ID":"7ab4cbec-fb0b-4359-ab8d-0b158e241134","Type":"ContainerStarted","Data":"5eab353fb866d321979b5fe03a29d2012b3e31ba4da94821a2adb2751a2a8e70"} Sep 10 12:22:57.694653 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.694632 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wk25k" event={"ID":"7050b131-deab-43ef-85df-4bc05dcae778","Type":"ContainerStarted","Data":"2fc4b3ab9e0df3f57854cd978377561171102c8f780a383840cfc4aeaab910bc"} Sep 10 12:22:57.706949 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.706924 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:57.863963 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.863877 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:57.953994 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.953949 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:57.955827 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.955803 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:22:57.970159 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.969958 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:57.973288 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.973264 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 12:22:57.973394 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.973338 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 12:22:57.973440 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.973390 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nbrfk\"" Sep 10 12:22:57.973440 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.973264 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 12:22:57.973523 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.973340 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 12:22:57.973691 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.973665 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 12:22:57.973691 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.973677 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 12:22:57.973850 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.973792 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 12:22:57.973850 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.973808 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 12:22:57.973943 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.973883 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 12:22:57.980181 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:57.980027 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:22:58.075128 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.075091 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:58.113901 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.113865 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.114083 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.113917 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-web-config\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.114083 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.113944 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.114083 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.113965 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7cbf6fc3-61df-4531-a71c-f8af05f08749-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.114083 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.114002 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cbf6fc3-61df-4531-a71c-f8af05f08749-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.114083 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.114043 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.114083 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.114072 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-config-volume\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.114404 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.114098 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cbf6fc3-61df-4531-a71c-f8af05f08749-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.114404 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.114128 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cbf6fc3-61df-4531-a71c-f8af05f08749-config-out\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.114404 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.114201 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gpm2\" (UniqueName: \"kubernetes.io/projected/7cbf6fc3-61df-4531-a71c-f8af05f08749-kube-api-access-9gpm2\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.114404 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.114255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cbf6fc3-61df-4531-a71c-f8af05f08749-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.114404 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.114288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.114404 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.114317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.215181 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.215151 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cbf6fc3-61df-4531-a71c-f8af05f08749-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.215315 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.215187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.215315 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.215212 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.215315 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.215294 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.215488 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.215341 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-web-config\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.215488 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.215375 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.215488 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.215397 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7cbf6fc3-61df-4531-a71c-f8af05f08749-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.215488 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.215439 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cbf6fc3-61df-4531-a71c-f8af05f08749-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.215488 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.215472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.215742 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.215502 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-config-volume\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.215742 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.215530 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cbf6fc3-61df-4531-a71c-f8af05f08749-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.215742 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.215566 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cbf6fc3-61df-4531-a71c-f8af05f08749-config-out\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.215742 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.215595 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gpm2\" (UniqueName: \"kubernetes.io/projected/7cbf6fc3-61df-4531-a71c-f8af05f08749-kube-api-access-9gpm2\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.216368 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.216341 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7cbf6fc3-61df-4531-a71c-f8af05f08749-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.217480 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.216727 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cbf6fc3-61df-4531-a71c-f8af05f08749-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.217951 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.217931 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cbf6fc3-61df-4531-a71c-f8af05f08749-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.218707 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.218684 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-web-config\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.218943 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.218919 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cbf6fc3-61df-4531-a71c-f8af05f08749-config-out\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.219281 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.219236 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.219533 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.219480 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cbf6fc3-61df-4531-a71c-f8af05f08749-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.219746 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.219718 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.220109 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.220087 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.220207 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.220166 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.220342 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.220324 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.220682 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.220663 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-config-volume\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.224573 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.224555 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gpm2\" (UniqueName: \"kubernetes.io/projected/7cbf6fc3-61df-4531-a71c-f8af05f08749-kube-api-access-9gpm2\") pod \"alertmanager-main-0\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.267949 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.267904 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:58.284747 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.284723 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:22:58.347969 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.347883 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:22:58.592327 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.592278 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:22:58.647328 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:22:58.647298 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cbf6fc3_61df_4531_a71c_f8af05f08749.slice/crio-56dbe6fb7135b8f0f55b2c5a975fd07004eaab28551166fe3e60780590092ed2 WatchSource:0}: Error finding container 56dbe6fb7135b8f0f55b2c5a975fd07004eaab28551166fe3e60780590092ed2: Status 404 returned error can't find the container with id 56dbe6fb7135b8f0f55b2c5a975fd07004eaab28551166fe3e60780590092ed2 Sep 10 12:22:58.698641 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.698612 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cbf6fc3-61df-4531-a71c-f8af05f08749","Type":"ContainerStarted","Data":"56dbe6fb7135b8f0f55b2c5a975fd07004eaab28551166fe3e60780590092ed2"} Sep 10 12:22:58.961804 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.961726 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-56949df654-rrj6g"] Sep 10 12:22:58.975149 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.975106 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:58.979015 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.978841 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 10 12:22:58.979015 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.978882 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 10 12:22:58.980384 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.980360 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7tv8n\"" Sep 10 12:22:58.980715 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.980698 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 10 12:22:58.981262 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.980979 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 10 12:22:58.982907 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.982439 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cij2rqcjv8lm6\"" Sep 10 12:22:58.982907 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.982513 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 10 12:22:58.983960 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:58.983729 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56949df654-rrj6g"] Sep 10 12:22:59.122478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.122435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0ef8093-23a2-444c-a035-de84fa81d8ba-metrics-client-ca\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.122651 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.122502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-thanos-querier-tls\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.122651 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.122559 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-grpc-tls\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.122651 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.122600 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.122651 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.122627 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.122651 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.122648 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.122859 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.122762 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qd5r\" (UniqueName: \"kubernetes.io/projected/a0ef8093-23a2-444c-a035-de84fa81d8ba-kube-api-access-2qd5r\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.122859 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.122796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.224149 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.224101 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-thanos-querier-tls\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.224301 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.224162 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-grpc-tls\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.224301 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.224194 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.224301 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.224228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.224301 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.224259 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.224516 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.224312 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qd5r\" (UniqueName: \"kubernetes.io/projected/a0ef8093-23a2-444c-a035-de84fa81d8ba-kube-api-access-2qd5r\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.224516 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.224358 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.224516 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.224409 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0ef8093-23a2-444c-a035-de84fa81d8ba-metrics-client-ca\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.225260 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.225233 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0ef8093-23a2-444c-a035-de84fa81d8ba-metrics-client-ca\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.227675 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.227622 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-grpc-tls\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.227675 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.227633 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.227839 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.227760 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.227839 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.227760 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.228063 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.228043 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-thanos-querier-tls\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.228253 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.228229 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a0ef8093-23a2-444c-a035-de84fa81d8ba-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.233538 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.233516 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qd5r\" (UniqueName: \"kubernetes.io/projected/a0ef8093-23a2-444c-a035-de84fa81d8ba-kube-api-access-2qd5r\") pod \"thanos-querier-56949df654-rrj6g\" (UID: \"a0ef8093-23a2-444c-a035-de84fa81d8ba\") " pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.289703 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.289674 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:22:59.595973 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.595951 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-prnjr" Sep 10 12:22:59.609944 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.609924 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56949df654-rrj6g"] Sep 10 12:22:59.611689 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:22:59.611668 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ef8093_23a2_444c_a035_de84fa81d8ba.slice/crio-5c6c89975a4f233c55a29e0f5b2293078595e1be7d5707fdcc435af075dd9019 WatchSource:0}: Error finding container 5c6c89975a4f233c55a29e0f5b2293078595e1be7d5707fdcc435af075dd9019: Status 404 returned error can't find the container with id 5c6c89975a4f233c55a29e0f5b2293078595e1be7d5707fdcc435af075dd9019 Sep 10 12:22:59.705506 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.705475 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" event={"ID":"7ab4cbec-fb0b-4359-ab8d-0b158e241134","Type":"ContainerStarted","Data":"364ef98e0ac34573c76845b24bb415faa23c471e02ee36284d6eb174648497e1"} Sep 10 12:22:59.706742 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.706710 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" event={"ID":"a0ef8093-23a2-444c-a035-de84fa81d8ba","Type":"ContainerStarted","Data":"5c6c89975a4f233c55a29e0f5b2293078595e1be7d5707fdcc435af075dd9019"} Sep 10 12:22:59.708362 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.708337 2574 generic.go:356] "Generic (PLEG): container finished" podID="7050b131-deab-43ef-85df-4bc05dcae778" containerID="2f3145f0a16a6cd93461535bf9a30e20e3cb06d7752658b9a0c2fd06caf21b32" exitCode=0 Sep 10 12:22:59.708504 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.708372 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wk25k" event={"ID":"7050b131-deab-43ef-85df-4bc05dcae778","Type":"ContainerDied","Data":"2f3145f0a16a6cd93461535bf9a30e20e3cb06d7752658b9a0c2fd06caf21b32"} Sep 10 12:22:59.908930 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:22:59.908893 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:00.007803 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:00.007771 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:00.108857 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:00.108777 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:00.420599 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:00.420507 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:00.713732 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:00.713656 2574 generic.go:356] "Generic (PLEG): container finished" podID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerID="b7887e0b8340256202f40e30d7c5b58b03ce9ae8e3973a3bcbd33120e21a24ce" exitCode=0 Sep 10 12:23:00.714163 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:00.713753 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cbf6fc3-61df-4531-a71c-f8af05f08749","Type":"ContainerDied","Data":"b7887e0b8340256202f40e30d7c5b58b03ce9ae8e3973a3bcbd33120e21a24ce"} Sep 10 12:23:00.716032 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:00.716010 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" event={"ID":"7ab4cbec-fb0b-4359-ab8d-0b158e241134","Type":"ContainerStarted","Data":"f815faea40b2133364cbccff7ba76e9387154be61c3dfa311859aed018625982"} Sep 10 12:23:00.716173 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:00.716057 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" event={"ID":"7ab4cbec-fb0b-4359-ab8d-0b158e241134","Type":"ContainerStarted","Data":"eccf09082bf738e245af03d365b2f28f6c0b5ab7b9989c03e549d36abf4830e9"} Sep 10 12:23:00.718188 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:00.718165 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wk25k" event={"ID":"7050b131-deab-43ef-85df-4bc05dcae778","Type":"ContainerStarted","Data":"99f7955da315aaa0b5afc4b02cf31035d94f2aa02c565217a69d934e36e04329"} Sep 10 12:23:00.718286 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:00.718215 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wk25k" event={"ID":"7050b131-deab-43ef-85df-4bc05dcae778","Type":"ContainerStarted","Data":"267057ba060b01056da435167443f621b8a2211d803c60e32cefa0070e498c53"} Sep 10 12:23:00.765299 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:00.765246 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wk25k" podStartSLOduration=2.669278072 podStartE2EDuration="4.765228386s" totalImagesPullingTime="2.016872779s" totalInitContainerRuntime="79.077535ms" isStatefulPod=true podCreationTimestamp="2026-09-10 12:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:23:00.764405502 +0000 UTC m=+106.051675215" watchObservedRunningTime="2026-09-10 12:23:00.765228386 +0000 UTC m=+106.052498067" Sep 10 12:23:00.789224 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:00.789126 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-mb9p8" podStartSLOduration=2.800341521 podStartE2EDuration="4.789108938s" totalImagesPullingTime="1.988767417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:23:00.788719211 +0000 UTC m=+106.075988888" watchObservedRunningTime="2026-09-10 12:23:00.789108938 +0000 UTC m=+106.076378619" Sep 10 12:23:01.278890 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.278846 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5f9bc6c697-r9fpq"] Sep 10 12:23:01.280991 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.280964 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.285117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.285095 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-comvsf9folfrk\"" Sep 10 12:23:01.285262 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.285124 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 10 12:23:01.285262 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.285182 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 10 12:23:01.285262 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.285182 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-89pb6\"" Sep 10 12:23:01.285262 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.285107 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 10 12:23:01.285262 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.285234 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 12:23:01.299121 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.299099 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f9bc6c697-r9fpq"] Sep 10 12:23:01.442419 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.442387 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/20aba482-8995-4b13-b0c2-ffa1df7ebe50-secret-metrics-server-tls\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.442419 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.442422 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/20aba482-8995-4b13-b0c2-ffa1df7ebe50-audit-log\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.442631 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.442447 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psdmq\" (UniqueName: \"kubernetes.io/projected/20aba482-8995-4b13-b0c2-ffa1df7ebe50-kube-api-access-psdmq\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.442631 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.442475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/20aba482-8995-4b13-b0c2-ffa1df7ebe50-secret-metrics-server-client-certs\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.442631 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.442559 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20aba482-8995-4b13-b0c2-ffa1df7ebe50-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.442631 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.442620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20aba482-8995-4b13-b0c2-ffa1df7ebe50-client-ca-bundle\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.442797 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.442713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/20aba482-8995-4b13-b0c2-ffa1df7ebe50-metrics-server-audit-profiles\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.543898 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.543816 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/20aba482-8995-4b13-b0c2-ffa1df7ebe50-secret-metrics-server-tls\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.543898 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.543859 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/20aba482-8995-4b13-b0c2-ffa1df7ebe50-audit-log\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.544112 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.543991 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psdmq\" (UniqueName: \"kubernetes.io/projected/20aba482-8995-4b13-b0c2-ffa1df7ebe50-kube-api-access-psdmq\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.544112 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.544041 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/20aba482-8995-4b13-b0c2-ffa1df7ebe50-secret-metrics-server-client-certs\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.544112 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.544090 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20aba482-8995-4b13-b0c2-ffa1df7ebe50-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.544349 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.544130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20aba482-8995-4b13-b0c2-ffa1df7ebe50-client-ca-bundle\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.544349 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.544237 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/20aba482-8995-4b13-b0c2-ffa1df7ebe50-metrics-server-audit-profiles\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.544349 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.544266 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/20aba482-8995-4b13-b0c2-ffa1df7ebe50-audit-log\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.544827 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.544801 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20aba482-8995-4b13-b0c2-ffa1df7ebe50-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.545391 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.545368 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/20aba482-8995-4b13-b0c2-ffa1df7ebe50-metrics-server-audit-profiles\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.546870 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.546847 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/20aba482-8995-4b13-b0c2-ffa1df7ebe50-secret-metrics-server-tls\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.546975 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.546958 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/20aba482-8995-4b13-b0c2-ffa1df7ebe50-secret-metrics-server-client-certs\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.547121 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.547104 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/20aba482-8995-4b13-b0c2-ffa1df7ebe50-client-ca-bundle\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.556592 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.556570 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psdmq\" (UniqueName: \"kubernetes.io/projected/20aba482-8995-4b13-b0c2-ffa1df7ebe50-kube-api-access-psdmq\") pod \"metrics-server-5f9bc6c697-r9fpq\" (UID: \"20aba482-8995-4b13-b0c2-ffa1df7ebe50\") " pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.592692 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.592669 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:01.667810 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.667776 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz"] Sep 10 12:23:01.669999 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.669953 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:01.670838 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.670767 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz" Sep 10 12:23:01.673751 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.673597 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 10 12:23:01.675655 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.675632 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mgkq4\"" Sep 10 12:23:01.688268 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.688245 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz"] Sep 10 12:23:01.745536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.745505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzpqr\" (UniqueName: \"kubernetes.io/projected/b729596f-cec0-4331-ac58-03aee1ffa876-kube-api-access-bzpqr\") pod \"monitoring-plugin-85bbbbbf4-9pqcz\" (UID: \"b729596f-cec0-4331-ac58-03aee1ffa876\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz" Sep 10 12:23:01.745918 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.745572 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b729596f-cec0-4331-ac58-03aee1ffa876-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-9pqcz\" (UID: \"b729596f-cec0-4331-ac58-03aee1ffa876\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz" Sep 10 12:23:01.796049 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.795970 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:01.846995 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.846963 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzpqr\" (UniqueName: \"kubernetes.io/projected/b729596f-cec0-4331-ac58-03aee1ffa876-kube-api-access-bzpqr\") pod \"monitoring-plugin-85bbbbbf4-9pqcz\" (UID: \"b729596f-cec0-4331-ac58-03aee1ffa876\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz" Sep 10 12:23:01.847198 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.847096 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b729596f-cec0-4331-ac58-03aee1ffa876-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-9pqcz\" (UID: \"b729596f-cec0-4331-ac58-03aee1ffa876\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz" Sep 10 12:23:01.847594 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:23:01.847570 2574 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 10 12:23:01.847728 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:23:01.847635 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b729596f-cec0-4331-ac58-03aee1ffa876-monitoring-plugin-cert podName:b729596f-cec0-4331-ac58-03aee1ffa876 nodeName:}" failed. No retries permitted until 2026-09-10 12:23:02.347615934 +0000 UTC m=+107.634885604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b729596f-cec0-4331-ac58-03aee1ffa876-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-9pqcz" (UID: "b729596f-cec0-4331-ac58-03aee1ffa876") : secret "monitoring-plugin-cert" not found Sep 10 12:23:01.859637 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:01.859594 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzpqr\" (UniqueName: \"kubernetes.io/projected/b729596f-cec0-4331-ac58-03aee1ffa876-kube-api-access-bzpqr\") pod \"monitoring-plugin-85bbbbbf4-9pqcz\" (UID: \"b729596f-cec0-4331-ac58-03aee1ffa876\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz" Sep 10 12:23:02.063265 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:02.063211 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:02.229449 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:02.229423 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f9bc6c697-r9fpq"] Sep 10 12:23:02.232862 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:23:02.232827 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20aba482_8995_4b13_b0c2_ffa1df7ebe50.slice/crio-77057aa562ea51301e572bdc8ab1a8f59319d2a6267925ca2a85a5a6506c6dd6 WatchSource:0}: Error finding container 77057aa562ea51301e572bdc8ab1a8f59319d2a6267925ca2a85a5a6506c6dd6: Status 404 returned error can't find the container with id 77057aa562ea51301e572bdc8ab1a8f59319d2a6267925ca2a85a5a6506c6dd6 Sep 10 12:23:02.352647 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:02.352565 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b729596f-cec0-4331-ac58-03aee1ffa876-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-9pqcz\" (UID: \"b729596f-cec0-4331-ac58-03aee1ffa876\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz" Sep 10 12:23:02.354934 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:02.354908 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b729596f-cec0-4331-ac58-03aee1ffa876-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-9pqcz\" (UID: \"b729596f-cec0-4331-ac58-03aee1ffa876\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz" Sep 10 12:23:02.563852 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:02.563811 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:02.586610 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:02.586591 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz" Sep 10 12:23:02.731692 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:02.731658 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" event={"ID":"20aba482-8995-4b13-b0c2-ffa1df7ebe50","Type":"ContainerStarted","Data":"77057aa562ea51301e572bdc8ab1a8f59319d2a6267925ca2a85a5a6506c6dd6"} Sep 10 12:23:02.734993 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:02.734970 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" event={"ID":"a0ef8093-23a2-444c-a035-de84fa81d8ba","Type":"ContainerStarted","Data":"a98baad83e12642573545525ca61ea7403bb73e23d145ce09006fefd9aa540ef"} Sep 10 12:23:02.735124 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:02.735103 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" event={"ID":"a0ef8093-23a2-444c-a035-de84fa81d8ba","Type":"ContainerStarted","Data":"148487f656d5fb3143f78c619b42a116cf5fd67b7743346ceb4cbeb0c2347245"} Sep 10 12:23:02.735244 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:02.735227 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" event={"ID":"a0ef8093-23a2-444c-a035-de84fa81d8ba","Type":"ContainerStarted","Data":"e59155b68340440f0c40ae97a33487831bbe1407b32b30380c9a6e8dbe6d5e7c"} Sep 10 12:23:02.859754 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:02.859729 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz"] Sep 10 12:23:02.862530 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:23:02.862502 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb729596f_cec0_4331_ac58_03aee1ffa876.slice/crio-107b9e4b5d8f0d294238c70887ff64c92fc39b27cbc21f7b910ae436fd7475ad WatchSource:0}: Error finding container 107b9e4b5d8f0d294238c70887ff64c92fc39b27cbc21f7b910ae436fd7475ad: Status 404 returned error can't find the container with id 107b9e4b5d8f0d294238c70887ff64c92fc39b27cbc21f7b910ae436fd7475ad Sep 10 12:23:03.246881 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.246530 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:23:03.249044 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.248739 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:03.254391 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.254370 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.262318 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.262296 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 12:23:03.262901 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.262745 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 12:23:03.263659 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.263008 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 12:23:03.263659 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.262843 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 12:23:03.263659 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.262891 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 12:23:03.263659 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.262800 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 12:23:03.263659 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.262932 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 12:23:03.263659 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.262968 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 12:23:03.264792 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.264770 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 12:23:03.265874 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.265837 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7scsv4b72e7d\"" Sep 10 12:23:03.266111 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.266092 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 12:23:03.269867 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.268906 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 12:23:03.269867 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.269112 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zckw9\"" Sep 10 12:23:03.269867 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.269326 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 12:23:03.270188 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.270164 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:23:03.270285 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.270212 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 12:23:03.274090 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.273172 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 12:23:03.365159 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.364909 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.365159 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.364955 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.365159 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.364980 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-web-config\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.365159 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.365009 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.365159 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.365035 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.365159 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.365074 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9vfr\" (UniqueName: \"kubernetes.io/projected/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-kube-api-access-q9vfr\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.365794 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.365129 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.365794 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.365696 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.365794 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.365751 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-config\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.365794 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.365789 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.366050 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.365814 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.366050 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.365841 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.366050 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.365864 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.366050 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.365944 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.366050 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.365991 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.366050 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.366036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-config-out\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.366380 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.366062 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.366380 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.366116 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.366380 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.366163 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.366380 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.366192 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.467702 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.467655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9vfr\" (UniqueName: \"kubernetes.io/projected/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-kube-api-access-q9vfr\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.467924 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.467724 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.467924 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.467772 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.467924 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.467799 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-config\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.467924 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.467822 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.467924 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.467847 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.467924 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.467876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.467924 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.467900 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.467924 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.467926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.468396 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.467952 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.468396 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.467991 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-config-out\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.468396 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.468016 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.468396 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.468054 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.468396 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.468087 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.468396 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.468114 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.468396 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.468191 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.468396 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.468215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.468396 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.468244 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-web-config\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.468396 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.468289 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.468396 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.468318 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.469498 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.469012 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.469498 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.469291 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.470289 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.470185 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.474810 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.473505 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.474810 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.473858 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.474810 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.473909 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.474810 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.474368 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.474810 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.474371 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.474810 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.474473 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.474810 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.474774 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.475198 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.475003 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.475818 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.475440 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.475818 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.475657 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-config-out\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.475818 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.475663 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.475818 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.475770 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-web-config\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.476803 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.476765 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-config\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.477485 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.477437 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.477584 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.477548 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.478076 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.478051 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9vfr\" (UniqueName: \"kubernetes.io/projected/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-kube-api-access-q9vfr\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.478244 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.478220 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.579755 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.579455 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:03.742472 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.742434 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" event={"ID":"a0ef8093-23a2-444c-a035-de84fa81d8ba","Type":"ContainerStarted","Data":"ae2c58bcc18cb9496e3667729251d63cece3bb6a129577a911499083448e7ded"} Sep 10 12:23:03.742666 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.742528 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" event={"ID":"a0ef8093-23a2-444c-a035-de84fa81d8ba","Type":"ContainerStarted","Data":"2452e9318ef2de226afc627b72b93be57d66bc6c88991b68b91784bd03906f60"} Sep 10 12:23:03.742666 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.742577 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" event={"ID":"a0ef8093-23a2-444c-a035-de84fa81d8ba","Type":"ContainerStarted","Data":"8c2b3e62fe9adbff1aedbe5eeeb75d293ee1aaebdd81691b07d99c91db3759a5"} Sep 10 12:23:03.742666 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.742622 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:23:03.743957 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.743920 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz" event={"ID":"b729596f-cec0-4331-ac58-03aee1ffa876","Type":"ContainerStarted","Data":"107b9e4b5d8f0d294238c70887ff64c92fc39b27cbc21f7b910ae436fd7475ad"} Sep 10 12:23:03.769506 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:03.769458 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" podStartSLOduration=2.4038773 podStartE2EDuration="5.769443121s" totalImagesPullingTime="3.365565821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:22:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:23:03.767433014 +0000 UTC m=+109.054702694" watchObservedRunningTime="2026-09-10 12:23:03.769443121 +0000 UTC m=+109.056712798" Sep 10 12:23:04.569233 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:04.569062 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:23:04.571924 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:23:04.571901 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a7965a_a8f4_4a7c_851a_740df2ae01d7.slice/crio-ccbf276581704b6c06fcd4a98a3c0639e440a2c80acd18b70ebb8694ce19a338 WatchSource:0}: Error finding container ccbf276581704b6c06fcd4a98a3c0639e440a2c80acd18b70ebb8694ce19a338: Status 404 returned error can't find the container with id ccbf276581704b6c06fcd4a98a3c0639e440a2c80acd18b70ebb8694ce19a338 Sep 10 12:23:04.749646 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:04.749617 2574 generic.go:356] "Generic (PLEG): container finished" podID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerID="3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361" exitCode=0 Sep 10 12:23:04.749762 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:04.749716 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4a7965a-a8f4-4a7c-851a-740df2ae01d7","Type":"ContainerDied","Data":"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361"} Sep 10 12:23:04.749855 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:04.749838 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4a7965a-a8f4-4a7c-851a-740df2ae01d7","Type":"ContainerStarted","Data":"ccbf276581704b6c06fcd4a98a3c0639e440a2c80acd18b70ebb8694ce19a338"} Sep 10 12:23:04.753705 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:04.753680 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cbf6fc3-61df-4531-a71c-f8af05f08749","Type":"ContainerStarted","Data":"ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0"} Sep 10 12:23:04.753813 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:04.753751 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cbf6fc3-61df-4531-a71c-f8af05f08749","Type":"ContainerStarted","Data":"eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658"} Sep 10 12:23:04.753813 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:04.753803 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cbf6fc3-61df-4531-a71c-f8af05f08749","Type":"ContainerStarted","Data":"73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a"} Sep 10 12:23:04.753912 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:04.753837 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cbf6fc3-61df-4531-a71c-f8af05f08749","Type":"ContainerStarted","Data":"3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec"} Sep 10 12:23:04.753912 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:04.753862 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cbf6fc3-61df-4531-a71c-f8af05f08749","Type":"ContainerStarted","Data":"ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00"} Sep 10 12:23:04.753912 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:04.753896 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cbf6fc3-61df-4531-a71c-f8af05f08749","Type":"ContainerStarted","Data":"7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44"} Sep 10 12:23:04.755387 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:04.755367 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" event={"ID":"20aba482-8995-4b13-b0c2-ffa1df7ebe50","Type":"ContainerStarted","Data":"b8c8887cc9da3f2274492cbd19b2454a664ff9a0cf0eb0a7ba1be672edccf5d7"} Sep 10 12:23:04.831916 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:04.831812 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.436418917 podStartE2EDuration="7.831794404s" totalImagesPullingTime="5.379335633s" totalInitContainerRuntime="16.039854ms" isStatefulPod=false podCreationTimestamp="2026-09-10 12:22:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:23:04.829301798 +0000 UTC m=+110.116571501" watchObservedRunningTime="2026-09-10 12:23:04.831794404 +0000 UTC m=+110.119064082" Sep 10 12:23:04.862085 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:04.862028 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" podStartSLOduration=1.805134099 podStartE2EDuration="3.862006776s" totalImagesPullingTime="2.056872677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:23:04.860036619 +0000 UTC m=+110.147306298" watchObservedRunningTime="2026-09-10 12:23:04.862006776 +0000 UTC m=+110.149276456" Sep 10 12:23:05.727211 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:05.727122 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:05.760108 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:05.760073 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz" event={"ID":"b729596f-cec0-4331-ac58-03aee1ffa876","Type":"ContainerStarted","Data":"c20c691d53b3895c6a2551a05a2ce961cb9faaff6fcc7b699b104e4f986e9cda"} Sep 10 12:23:05.760262 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:05.760190 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz" Sep 10 12:23:05.765402 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:05.765382 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz" Sep 10 12:23:05.778705 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:05.778662 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-9pqcz" podStartSLOduration=2.043790879 podStartE2EDuration="4.778648217s" totalImagesPullingTime="2.734857338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:23:05.777710976 +0000 UTC m=+111.064980655" watchObservedRunningTime="2026-09-10 12:23:05.778648217 +0000 UTC m=+111.065917895" Sep 10 12:23:05.827450 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:05.827364 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:06.959991 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:06.959952 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:07.061682 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:07.061641 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:09.762237 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:09.762209 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-56949df654-rrj6g" Sep 10 12:23:09.781440 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:09.781407 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4a7965a-a8f4-4a7c-851a-740df2ae01d7","Type":"ContainerStarted","Data":"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8"} Sep 10 12:23:09.781582 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:09.781466 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4a7965a-a8f4-4a7c-851a-740df2ae01d7","Type":"ContainerStarted","Data":"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368"} Sep 10 12:23:09.781582 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:09.781492 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4a7965a-a8f4-4a7c-851a-740df2ae01d7","Type":"ContainerStarted","Data":"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5"} Sep 10 12:23:09.781582 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:09.781522 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4a7965a-a8f4-4a7c-851a-740df2ae01d7","Type":"ContainerStarted","Data":"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408"} Sep 10 12:23:09.781582 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:09.781546 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4a7965a-a8f4-4a7c-851a-740df2ae01d7","Type":"ContainerStarted","Data":"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0"} Sep 10 12:23:09.781582 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:09.781567 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4a7965a-a8f4-4a7c-851a-740df2ae01d7","Type":"ContainerStarted","Data":"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b"} Sep 10 12:23:09.823507 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:09.823455 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.635890994 podStartE2EDuration="6.823434744s" totalImagesPullingTime="4.167961621s" totalInitContainerRuntime="19.582129ms" isStatefulPod=false podCreationTimestamp="2026-09-10 12:23:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:23:09.820907109 +0000 UTC m=+115.108176824" watchObservedRunningTime="2026-09-10 12:23:09.823434744 +0000 UTC m=+115.110704466" Sep 10 12:23:13.453150 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:13.453114 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cbf6fc3-61df-4531-a71c-f8af05f08749/init-config-reloader/0.log" Sep 10 12:23:13.580648 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:13.580613 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:23:13.652789 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:13.652762 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cbf6fc3-61df-4531-a71c-f8af05f08749/alertmanager/0.log" Sep 10 12:23:13.852594 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:13.852567 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cbf6fc3-61df-4531-a71c-f8af05f08749/config-reloader/0.log" Sep 10 12:23:14.053045 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:14.053011 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cbf6fc3-61df-4531-a71c-f8af05f08749/kube-rbac-proxy-web/0.log" Sep 10 12:23:14.253016 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:14.252989 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cbf6fc3-61df-4531-a71c-f8af05f08749/kube-rbac-proxy/0.log" Sep 10 12:23:14.452465 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:14.452425 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cbf6fc3-61df-4531-a71c-f8af05f08749/kube-rbac-proxy-metric/0.log" Sep 10 12:23:14.653291 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:14.653218 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cbf6fc3-61df-4531-a71c-f8af05f08749/prom-label-proxy/0.log" Sep 10 12:23:15.053324 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:15.053298 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-mb9p8_7ab4cbec-fb0b-4359-ab8d-0b158e241134/kube-state-metrics/0.log" Sep 10 12:23:15.253169 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:15.253122 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-mb9p8_7ab4cbec-fb0b-4359-ab8d-0b158e241134/kube-rbac-proxy-main/0.log" Sep 10 12:23:15.452896 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:15.452797 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-mb9p8_7ab4cbec-fb0b-4359-ab8d-0b158e241134/kube-rbac-proxy-self/0.log" Sep 10 12:23:15.653355 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:15.653326 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f9bc6c697-r9fpq_20aba482-8995-4b13-b0c2-ffa1df7ebe50/metrics-server/0.log" Sep 10 12:23:15.853030 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:15.852999 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-9pqcz_b729596f-cec0-4331-ac58-03aee1ffa876/monitoring-plugin/0.log" Sep 10 12:23:17.188635 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:17.188602 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:17.252501 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:17.252478 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wk25k_7050b131-deab-43ef-85df-4bc05dcae778/init-textfile/0.log" Sep 10 12:23:17.288045 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:17.288010 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:17.453860 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:17.453772 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wk25k_7050b131-deab-43ef-85df-4bc05dcae778/node-exporter/0.log" Sep 10 12:23:17.652308 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:17.652269 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wk25k_7050b131-deab-43ef-85df-4bc05dcae778/kube-rbac-proxy/0.log" Sep 10 12:23:18.452373 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:18.452341 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c4a7965a-a8f4-4a7c-851a-740df2ae01d7/init-config-reloader/0.log" Sep 10 12:23:18.573090 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:18.573055 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:18.654092 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:18.654067 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c4a7965a-a8f4-4a7c-851a-740df2ae01d7/prometheus/0.log" Sep 10 12:23:18.676555 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:18.676530 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:18.852678 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:18.852649 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c4a7965a-a8f4-4a7c-851a-740df2ae01d7/config-reloader/0.log" Sep 10 12:23:19.053716 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:19.053686 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c4a7965a-a8f4-4a7c-851a-740df2ae01d7/thanos-sidecar/0.log" Sep 10 12:23:19.252496 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:19.252471 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c4a7965a-a8f4-4a7c-851a-740df2ae01d7/kube-rbac-proxy-web/0.log" Sep 10 12:23:19.453337 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:19.453299 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c4a7965a-a8f4-4a7c-851a-740df2ae01d7/kube-rbac-proxy/0.log" Sep 10 12:23:19.580365 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:19.580288 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:19.653356 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:19.653325 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c4a7965a-a8f4-4a7c-851a-740df2ae01d7/kube-rbac-proxy-thanos/0.log" Sep 10 12:23:19.658457 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:19.658429 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:19.855810 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:19.855730 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-kqzfd_90ae54f4-6a24-415f-a59c-eaa6f1fb55c8/prometheus-operator/0.log" Sep 10 12:23:20.052459 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:20.052429 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-kqzfd_90ae54f4-6a24-415f-a59c-eaa6f1fb55c8/kube-rbac-proxy/0.log" Sep 10 12:23:20.253765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:20.253735 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-z52fc_d063e011-7e3c-465f-be14-8e69aca02b73/prometheus-operator-admission-webhook/0.log" Sep 10 12:23:20.454077 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:20.454045 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56949df654-rrj6g_a0ef8093-23a2-444c-a035-de84fa81d8ba/thanos-query/0.log" Sep 10 12:23:20.652262 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:20.652187 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56949df654-rrj6g_a0ef8093-23a2-444c-a035-de84fa81d8ba/kube-rbac-proxy-web/0.log" Sep 10 12:23:20.759762 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:20.759729 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:20.851942 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:20.851899 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56949df654-rrj6g_a0ef8093-23a2-444c-a035-de84fa81d8ba/kube-rbac-proxy/0.log" Sep 10 12:23:20.856251 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:20.856222 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:20.942728 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:20.942659 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:21.052289 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:21.052263 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56949df654-rrj6g_a0ef8093-23a2-444c-a035-de84fa81d8ba/prom-label-proxy/0.log" Sep 10 12:23:21.252125 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:21.252098 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56949df654-rrj6g_a0ef8093-23a2-444c-a035-de84fa81d8ba/kube-rbac-proxy-rules/0.log" Sep 10 12:23:21.452258 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:21.452230 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56949df654-rrj6g_a0ef8093-23a2-444c-a035-de84fa81d8ba/kube-rbac-proxy-metrics/0.log" Sep 10 12:23:21.593221 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:21.593119 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:21.593221 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:21.593206 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:23.053001 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:23.052972 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6ckhj_8ade03c9-a18b-4685-b3f5-f5a0afe370db/serve-healthcheck-canary/0.log" Sep 10 12:23:28.873729 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:28.873691 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:28.978254 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:28.978221 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:29.079722 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:29.079689 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:35.723290 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:35.723246 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:35.792973 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:35.792942 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:23:41.598747 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:41.598717 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:23:41.602565 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:23:41.602547 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5f9bc6c697-r9fpq" Sep 10 12:24:03.580011 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:03.579978 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:03.599003 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:03.598982 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:04.024573 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:04.024548 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:12.192734 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:12.192645 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:16.256520 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:16.256470 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:16.601490 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:16.601385 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:17.299541 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:17.299503 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:24:17.299939 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:17.299782 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="alertmanager" containerID="cri-o://7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44" gracePeriod=120 Sep 10 12:24:17.299939 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:17.299858 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="kube-rbac-proxy-web" containerID="cri-o://3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec" gracePeriod=120 Sep 10 12:24:17.299939 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:17.299883 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="config-reloader" containerID="cri-o://ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00" gracePeriod=120 Sep 10 12:24:17.299939 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:17.299912 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="prom-label-proxy" containerID="cri-o://ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0" gracePeriod=120 Sep 10 12:24:17.299939 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:17.299864 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="kube-rbac-proxy-metric" containerID="cri-o://eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658" gracePeriod=120 Sep 10 12:24:17.300288 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:17.299999 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="kube-rbac-proxy" containerID="cri-o://73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a" gracePeriod=120 Sep 10 12:24:18.076524 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.076490 2574 generic.go:356] "Generic (PLEG): container finished" podID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerID="ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0" exitCode=0 Sep 10 12:24:18.076524 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.076521 2574 generic.go:356] "Generic (PLEG): container finished" podID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerID="73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a" exitCode=0 Sep 10 12:24:18.076524 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.076529 2574 generic.go:356] "Generic (PLEG): container finished" podID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerID="ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00" exitCode=0 Sep 10 12:24:18.076524 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.076536 2574 generic.go:356] "Generic (PLEG): container finished" podID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerID="7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44" exitCode=0 Sep 10 12:24:18.076797 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.076573 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cbf6fc3-61df-4531-a71c-f8af05f08749","Type":"ContainerDied","Data":"ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0"} Sep 10 12:24:18.076797 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.076664 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cbf6fc3-61df-4531-a71c-f8af05f08749","Type":"ContainerDied","Data":"73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a"} Sep 10 12:24:18.076797 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.076690 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cbf6fc3-61df-4531-a71c-f8af05f08749","Type":"ContainerDied","Data":"ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00"} Sep 10 12:24:18.076797 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.076714 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cbf6fc3-61df-4531-a71c-f8af05f08749","Type":"ContainerDied","Data":"7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44"} Sep 10 12:24:18.548759 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.548737 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:18.585968 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.585945 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7cbf6fc3-61df-4531-a71c-f8af05f08749-alertmanager-main-db\") pod \"7cbf6fc3-61df-4531-a71c-f8af05f08749\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " Sep 10 12:24:18.586085 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.586000 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-web-config\") pod \"7cbf6fc3-61df-4531-a71c-f8af05f08749\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " Sep 10 12:24:18.586085 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.586021 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cbf6fc3-61df-4531-a71c-f8af05f08749-config-out\") pod \"7cbf6fc3-61df-4531-a71c-f8af05f08749\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " Sep 10 12:24:18.586085 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.586052 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gpm2\" (UniqueName: \"kubernetes.io/projected/7cbf6fc3-61df-4531-a71c-f8af05f08749-kube-api-access-9gpm2\") pod \"7cbf6fc3-61df-4531-a71c-f8af05f08749\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " Sep 10 12:24:18.586258 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.586085 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy\") pod \"7cbf6fc3-61df-4531-a71c-f8af05f08749\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " Sep 10 12:24:18.586258 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.586158 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-config-volume\") pod \"7cbf6fc3-61df-4531-a71c-f8af05f08749\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " Sep 10 12:24:18.586258 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.586190 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cbf6fc3-61df-4531-a71c-f8af05f08749-tls-assets\") pod \"7cbf6fc3-61df-4531-a71c-f8af05f08749\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " Sep 10 12:24:18.586258 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.586216 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-main-tls\") pod \"7cbf6fc3-61df-4531-a71c-f8af05f08749\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " Sep 10 12:24:18.586258 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.586249 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy-web\") pod \"7cbf6fc3-61df-4531-a71c-f8af05f08749\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " Sep 10 12:24:18.586513 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.586276 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cbf6fc3-61df-4531-a71c-f8af05f08749-alertmanager-trusted-ca-bundle\") pod \"7cbf6fc3-61df-4531-a71c-f8af05f08749\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " Sep 10 12:24:18.586513 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.586281 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cbf6fc3-61df-4531-a71c-f8af05f08749-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7cbf6fc3-61df-4531-a71c-f8af05f08749" (UID: "7cbf6fc3-61df-4531-a71c-f8af05f08749"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:24:18.586513 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.586322 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cbf6fc3-61df-4531-a71c-f8af05f08749-metrics-client-ca\") pod \"7cbf6fc3-61df-4531-a71c-f8af05f08749\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " Sep 10 12:24:18.586513 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.586354 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-cluster-tls-config\") pod \"7cbf6fc3-61df-4531-a71c-f8af05f08749\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " Sep 10 12:24:18.586513 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.586379 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7cbf6fc3-61df-4531-a71c-f8af05f08749\" (UID: \"7cbf6fc3-61df-4531-a71c-f8af05f08749\") " Sep 10 12:24:18.586908 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.586810 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7cbf6fc3-61df-4531-a71c-f8af05f08749-alertmanager-main-db\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:18.587621 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.587300 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cbf6fc3-61df-4531-a71c-f8af05f08749-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7cbf6fc3-61df-4531-a71c-f8af05f08749" (UID: "7cbf6fc3-61df-4531-a71c-f8af05f08749"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:24:18.587621 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.587537 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cbf6fc3-61df-4531-a71c-f8af05f08749-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7cbf6fc3-61df-4531-a71c-f8af05f08749" (UID: "7cbf6fc3-61df-4531-a71c-f8af05f08749"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:24:18.590090 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.589956 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7cbf6fc3-61df-4531-a71c-f8af05f08749" (UID: "7cbf6fc3-61df-4531-a71c-f8af05f08749"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:24:18.590756 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.590673 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cbf6fc3-61df-4531-a71c-f8af05f08749-kube-api-access-9gpm2" (OuterVolumeSpecName: "kube-api-access-9gpm2") pod "7cbf6fc3-61df-4531-a71c-f8af05f08749" (UID: "7cbf6fc3-61df-4531-a71c-f8af05f08749"). InnerVolumeSpecName "kube-api-access-9gpm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:24:18.590854 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.590758 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cbf6fc3-61df-4531-a71c-f8af05f08749-config-out" (OuterVolumeSpecName: "config-out") pod "7cbf6fc3-61df-4531-a71c-f8af05f08749" (UID: "7cbf6fc3-61df-4531-a71c-f8af05f08749"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:24:18.592177 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.591609 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7cbf6fc3-61df-4531-a71c-f8af05f08749" (UID: "7cbf6fc3-61df-4531-a71c-f8af05f08749"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:24:18.593852 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.593239 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7cbf6fc3-61df-4531-a71c-f8af05f08749" (UID: "7cbf6fc3-61df-4531-a71c-f8af05f08749"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:24:18.594432 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.594404 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7cbf6fc3-61df-4531-a71c-f8af05f08749" (UID: "7cbf6fc3-61df-4531-a71c-f8af05f08749"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:24:18.594508 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.594489 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-config-volume" (OuterVolumeSpecName: "config-volume") pod "7cbf6fc3-61df-4531-a71c-f8af05f08749" (UID: "7cbf6fc3-61df-4531-a71c-f8af05f08749"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:24:18.595384 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.595357 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cbf6fc3-61df-4531-a71c-f8af05f08749-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7cbf6fc3-61df-4531-a71c-f8af05f08749" (UID: "7cbf6fc3-61df-4531-a71c-f8af05f08749"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:24:18.599204 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.599103 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7cbf6fc3-61df-4531-a71c-f8af05f08749" (UID: "7cbf6fc3-61df-4531-a71c-f8af05f08749"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:24:18.605898 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.605875 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-web-config" (OuterVolumeSpecName: "web-config") pod "7cbf6fc3-61df-4531-a71c-f8af05f08749" (UID: "7cbf6fc3-61df-4531-a71c-f8af05f08749"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:24:18.687385 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.687353 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cbf6fc3-61df-4531-a71c-f8af05f08749-tls-assets\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:18.687385 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.687380 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-main-tls\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:18.687553 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.687392 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:18.687553 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.687402 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cbf6fc3-61df-4531-a71c-f8af05f08749-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:18.687553 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.687411 2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cbf6fc3-61df-4531-a71c-f8af05f08749-metrics-client-ca\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:18.687553 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.687419 2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-cluster-tls-config\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:18.687553 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.687427 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:18.687553 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.687436 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-web-config\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:18.687553 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.687444 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cbf6fc3-61df-4531-a71c-f8af05f08749-config-out\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:18.687553 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.687451 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gpm2\" (UniqueName: \"kubernetes.io/projected/7cbf6fc3-61df-4531-a71c-f8af05f08749-kube-api-access-9gpm2\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:18.687553 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.687460 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:18.687553 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:18.687468 2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7cbf6fc3-61df-4531-a71c-f8af05f08749-config-volume\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:19.084101 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.084061 2574 generic.go:356] "Generic (PLEG): container finished" podID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerID="eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658" exitCode=0 Sep 10 12:24:19.084101 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.084092 2574 generic.go:356] "Generic (PLEG): container finished" podID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerID="3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec" exitCode=0 Sep 10 12:24:19.084322 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.084121 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cbf6fc3-61df-4531-a71c-f8af05f08749","Type":"ContainerDied","Data":"eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658"} Sep 10 12:24:19.084322 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.084167 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.084322 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.084210 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cbf6fc3-61df-4531-a71c-f8af05f08749","Type":"ContainerDied","Data":"3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec"} Sep 10 12:24:19.084322 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.084238 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cbf6fc3-61df-4531-a71c-f8af05f08749","Type":"ContainerDied","Data":"56dbe6fb7135b8f0f55b2c5a975fd07004eaab28551166fe3e60780590092ed2"} Sep 10 12:24:19.084322 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.084269 2574 scope.go:117] "RemoveContainer" containerID="ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0" Sep 10 12:24:19.092311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.092296 2574 scope.go:117] "RemoveContainer" containerID="eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658" Sep 10 12:24:19.100178 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.100158 2574 scope.go:117] "RemoveContainer" containerID="73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a" Sep 10 12:24:19.106760 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.106742 2574 scope.go:117] "RemoveContainer" containerID="3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec" Sep 10 12:24:19.110793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.110772 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:24:19.115230 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.115213 2574 scope.go:117] "RemoveContainer" containerID="ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00" Sep 10 12:24:19.115358 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.115338 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:24:19.122193 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.122177 2574 scope.go:117] "RemoveContainer" containerID="7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44" Sep 10 12:24:19.129147 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.129118 2574 scope.go:117] "RemoveContainer" containerID="b7887e0b8340256202f40e30d7c5b58b03ce9ae8e3973a3bcbd33120e21a24ce" Sep 10 12:24:19.135936 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.135922 2574 scope.go:117] "RemoveContainer" containerID="ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0" Sep 10 12:24:19.136227 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:24:19.136207 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0\": container with ID starting with ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0 not found: ID does not exist" containerID="ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0" Sep 10 12:24:19.136279 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.136235 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0"} err="failed to get container status \"ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0\": rpc error: code = NotFound desc = could not find container \"ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0\": container with ID starting with ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0 not found: ID does not exist" Sep 10 12:24:19.136279 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.136251 2574 scope.go:117] "RemoveContainer" containerID="eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658" Sep 10 12:24:19.136493 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:24:19.136478 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658\": container with ID starting with eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658 not found: ID does not exist" containerID="eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658" Sep 10 12:24:19.136530 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.136498 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658"} err="failed to get container status \"eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658\": rpc error: code = NotFound desc = could not find container \"eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658\": container with ID starting with eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658 not found: ID does not exist" Sep 10 12:24:19.136530 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.136511 2574 scope.go:117] "RemoveContainer" containerID="73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a" Sep 10 12:24:19.136721 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:24:19.136708 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a\": container with ID starting with 73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a not found: ID does not exist" containerID="73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a" Sep 10 12:24:19.136765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.136725 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a"} err="failed to get container status \"73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a\": rpc error: code = NotFound desc = could not find container \"73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a\": container with ID starting with 73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a not found: ID does not exist" Sep 10 12:24:19.136765 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.136736 2574 scope.go:117] "RemoveContainer" containerID="3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec" Sep 10 12:24:19.136934 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:24:19.136920 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec\": container with ID starting with 3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec not found: ID does not exist" containerID="3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec" Sep 10 12:24:19.136976 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.136937 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec"} err="failed to get container status \"3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec\": rpc error: code = NotFound desc = could not find container \"3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec\": container with ID starting with 3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec not found: ID does not exist" Sep 10 12:24:19.136976 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.136948 2574 scope.go:117] "RemoveContainer" containerID="ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00" Sep 10 12:24:19.137162 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:24:19.137146 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00\": container with ID starting with ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00 not found: ID does not exist" containerID="ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00" Sep 10 12:24:19.137203 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.137165 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00"} err="failed to get container status \"ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00\": rpc error: code = NotFound desc = could not find container \"ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00\": container with ID starting with ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00 not found: ID does not exist" Sep 10 12:24:19.137203 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.137177 2574 scope.go:117] "RemoveContainer" containerID="7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44" Sep 10 12:24:19.137400 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:24:19.137387 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44\": container with ID starting with 7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44 not found: ID does not exist" containerID="7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44" Sep 10 12:24:19.137447 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.137401 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44"} err="failed to get container status \"7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44\": rpc error: code = NotFound desc = could not find container \"7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44\": container with ID starting with 7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44 not found: ID does not exist" Sep 10 12:24:19.137447 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.137412 2574 scope.go:117] "RemoveContainer" containerID="b7887e0b8340256202f40e30d7c5b58b03ce9ae8e3973a3bcbd33120e21a24ce" Sep 10 12:24:19.137638 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:24:19.137620 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7887e0b8340256202f40e30d7c5b58b03ce9ae8e3973a3bcbd33120e21a24ce\": container with ID starting with b7887e0b8340256202f40e30d7c5b58b03ce9ae8e3973a3bcbd33120e21a24ce not found: ID does not exist" containerID="b7887e0b8340256202f40e30d7c5b58b03ce9ae8e3973a3bcbd33120e21a24ce" Sep 10 12:24:19.137679 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.137644 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7887e0b8340256202f40e30d7c5b58b03ce9ae8e3973a3bcbd33120e21a24ce"} err="failed to get container status \"b7887e0b8340256202f40e30d7c5b58b03ce9ae8e3973a3bcbd33120e21a24ce\": rpc error: code = NotFound desc = could not find container \"b7887e0b8340256202f40e30d7c5b58b03ce9ae8e3973a3bcbd33120e21a24ce\": container with ID starting with b7887e0b8340256202f40e30d7c5b58b03ce9ae8e3973a3bcbd33120e21a24ce not found: ID does not exist" Sep 10 12:24:19.137679 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.137663 2574 scope.go:117] "RemoveContainer" containerID="ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0" Sep 10 12:24:19.137901 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.137881 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0"} err="failed to get container status \"ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0\": rpc error: code = NotFound desc = could not find container \"ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0\": container with ID starting with ecc873ac8843c40114b9501a2c08a94001f454562fe5193d0c220b77963d24e0 not found: ID does not exist" Sep 10 12:24:19.137963 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.137916 2574 scope.go:117] "RemoveContainer" containerID="eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658" Sep 10 12:24:19.138190 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.138173 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658"} err="failed to get container status \"eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658\": rpc error: code = NotFound desc = could not find container \"eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658\": container with ID starting with eea5c7697ea187bc46078ef39ceadc45bb039c77ef0aaa0015ae44498064b658 not found: ID does not exist" Sep 10 12:24:19.138246 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.138191 2574 scope.go:117] "RemoveContainer" containerID="73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a" Sep 10 12:24:19.138430 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.138415 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a"} err="failed to get container status \"73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a\": rpc error: code = NotFound desc = could not find container \"73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a\": container with ID starting with 73d816468d15f409e2a9106338739b7f75b5ed4c104920e2e529be5e7955cc0a not found: ID does not exist" Sep 10 12:24:19.138430 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.138430 2574 scope.go:117] "RemoveContainer" containerID="3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec" Sep 10 12:24:19.138657 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.138638 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec"} err="failed to get container status \"3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec\": rpc error: code = NotFound desc = could not find container \"3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec\": container with ID starting with 3b0426d52ae75c568cffe795b54530ebd128238bcf1efe30567aa0f2e7feb7ec not found: ID does not exist" Sep 10 12:24:19.138724 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.138659 2574 scope.go:117] "RemoveContainer" containerID="ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00" Sep 10 12:24:19.138881 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.138862 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00"} err="failed to get container status \"ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00\": rpc error: code = NotFound desc = could not find container \"ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00\": container with ID starting with ee69007522f02e1323e60d00a518d74f007d99cee9bbd46b16953726fb9d8f00 not found: ID does not exist" Sep 10 12:24:19.138925 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.138883 2574 scope.go:117] "RemoveContainer" containerID="7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44" Sep 10 12:24:19.139087 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.139071 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44"} err="failed to get container status \"7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44\": rpc error: code = NotFound desc = could not find container \"7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44\": container with ID starting with 7dee786e7c989b4ae2cc6bcf920c5b9a97b1de35f0a3489ec8bfecb21e4d3d44 not found: ID does not exist" Sep 10 12:24:19.139129 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.139088 2574 scope.go:117] "RemoveContainer" containerID="b7887e0b8340256202f40e30d7c5b58b03ce9ae8e3973a3bcbd33120e21a24ce" Sep 10 12:24:19.139327 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.139311 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7887e0b8340256202f40e30d7c5b58b03ce9ae8e3973a3bcbd33120e21a24ce"} err="failed to get container status \"b7887e0b8340256202f40e30d7c5b58b03ce9ae8e3973a3bcbd33120e21a24ce\": rpc error: code = NotFound desc = could not find container \"b7887e0b8340256202f40e30d7c5b58b03ce9ae8e3973a3bcbd33120e21a24ce\": container with ID starting with b7887e0b8340256202f40e30d7c5b58b03ce9ae8e3973a3bcbd33120e21a24ce not found: ID does not exist" Sep 10 12:24:19.160960 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.160935 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:24:19.161233 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161221 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="prom-label-proxy" Sep 10 12:24:19.161311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161234 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="prom-label-proxy" Sep 10 12:24:19.161311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161244 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="kube-rbac-proxy-web" Sep 10 12:24:19.161311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161249 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="kube-rbac-proxy-web" Sep 10 12:24:19.161311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161257 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="kube-rbac-proxy" Sep 10 12:24:19.161311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161262 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="kube-rbac-proxy" Sep 10 12:24:19.161311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161269 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="alertmanager" Sep 10 12:24:19.161311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161274 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="alertmanager" Sep 10 12:24:19.161311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161286 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="init-config-reloader" Sep 10 12:24:19.161311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161291 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="init-config-reloader" Sep 10 12:24:19.161311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161297 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="config-reloader" Sep 10 12:24:19.161311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161301 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="config-reloader" Sep 10 12:24:19.161311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161308 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="kube-rbac-proxy-metric" Sep 10 12:24:19.161311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161313 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="kube-rbac-proxy-metric" Sep 10 12:24:19.161664 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161352 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="alertmanager" Sep 10 12:24:19.161664 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161359 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="kube-rbac-proxy-metric" Sep 10 12:24:19.161664 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161365 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="kube-rbac-proxy-web" Sep 10 12:24:19.161664 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161370 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="prom-label-proxy" Sep 10 12:24:19.161664 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161377 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="config-reloader" Sep 10 12:24:19.161664 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.161383 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" containerName="kube-rbac-proxy" Sep 10 12:24:19.165880 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.165865 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.169058 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.169020 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 10 12:24:19.169184 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.169066 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 10 12:24:19.169184 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.169084 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 10 12:24:19.169184 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.169123 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nbrfk\"" Sep 10 12:24:19.169339 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.169086 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 10 12:24:19.169339 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.169323 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 10 12:24:19.169483 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.169444 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 10 12:24:19.169610 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.169511 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 10 12:24:19.169610 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.169561 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 10 12:24:19.174839 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.174822 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 10 12:24:19.184892 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.184870 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:24:19.191483 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.191464 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-config-volume\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.191585 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.191491 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871ef10f-6a89-429b-8185-ed8650472552-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.191585 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.191512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.191585 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.191537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/871ef10f-6a89-429b-8185-ed8650472552-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.191585 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.191557 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.191744 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.191592 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/871ef10f-6a89-429b-8185-ed8650472552-tls-assets\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.191744 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.191611 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.191744 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.191625 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.191744 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.191661 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/871ef10f-6a89-429b-8185-ed8650472552-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.191744 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.191687 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.191744 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.191742 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-web-config\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.191999 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.191760 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5n4x\" (UniqueName: \"kubernetes.io/projected/871ef10f-6a89-429b-8185-ed8650472552-kube-api-access-m5n4x\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.191999 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.191789 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/871ef10f-6a89-429b-8185-ed8650472552-config-out\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.206476 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.205434 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cbf6fc3-61df-4531-a71c-f8af05f08749" path="/var/lib/kubelet/pods/7cbf6fc3-61df-4531-a71c-f8af05f08749/volumes" Sep 10 12:24:19.292568 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.292546 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.292680 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.292583 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/871ef10f-6a89-429b-8185-ed8650472552-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.292680 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.292602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.292680 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.292620 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/871ef10f-6a89-429b-8185-ed8650472552-tls-assets\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.292831 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.292671 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.292831 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.292709 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.292831 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.292740 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/871ef10f-6a89-429b-8185-ed8650472552-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.292831 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.292768 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.292831 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.292805 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-web-config\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.292831 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.292832 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5n4x\" (UniqueName: \"kubernetes.io/projected/871ef10f-6a89-429b-8185-ed8650472552-kube-api-access-m5n4x\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.293170 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.292878 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/871ef10f-6a89-429b-8185-ed8650472552-config-out\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.293170 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.292915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-config-volume\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.293170 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.292939 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871ef10f-6a89-429b-8185-ed8650472552-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.293432 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.293410 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/871ef10f-6a89-429b-8185-ed8650472552-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.293811 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.293758 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/871ef10f-6a89-429b-8185-ed8650472552-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.294430 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.294383 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/871ef10f-6a89-429b-8185-ed8650472552-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.295936 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.295905 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.296482 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.296457 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.296581 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.296564 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.296669 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.296646 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/871ef10f-6a89-429b-8185-ed8650472552-tls-assets\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.296732 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.296660 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.296732 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.296663 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-web-config\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.296844 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.296800 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.296912 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.296895 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/871ef10f-6a89-429b-8185-ed8650472552-config-out\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.297916 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.297898 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/871ef10f-6a89-429b-8185-ed8650472552-config-volume\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.304646 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.304629 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5n4x\" (UniqueName: \"kubernetes.io/projected/871ef10f-6a89-429b-8185-ed8650472552-kube-api-access-m5n4x\") pod \"alertmanager-main-0\" (UID: \"871ef10f-6a89-429b-8185-ed8650472552\") " pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.474640 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.474609 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 10 12:24:19.762105 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:19.762080 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 10 12:24:19.763197 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:24:19.763173 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod871ef10f_6a89_429b_8185_ed8650472552.slice/crio-28dbe5a6d35c681ecb1ab2a283eb6b92a3c26a05a71c0fd47adfbe742cafb240 WatchSource:0}: Error finding container 28dbe5a6d35c681ecb1ab2a283eb6b92a3c26a05a71c0fd47adfbe742cafb240: Status 404 returned error can't find the container with id 28dbe5a6d35c681ecb1ab2a283eb6b92a3c26a05a71c0fd47adfbe742cafb240 Sep 10 12:24:20.089574 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:20.089492 2574 generic.go:356] "Generic (PLEG): container finished" podID="871ef10f-6a89-429b-8185-ed8650472552" containerID="e1ac57c4eb4b14869992f9f35bf7ba661e5fe504aa3fbfefdb7632d460153f6f" exitCode=0 Sep 10 12:24:20.089736 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:20.089575 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"871ef10f-6a89-429b-8185-ed8650472552","Type":"ContainerDied","Data":"e1ac57c4eb4b14869992f9f35bf7ba661e5fe504aa3fbfefdb7632d460153f6f"} Sep 10 12:24:20.089736 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:20.089656 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"871ef10f-6a89-429b-8185-ed8650472552","Type":"ContainerStarted","Data":"28dbe5a6d35c681ecb1ab2a283eb6b92a3c26a05a71c0fd47adfbe742cafb240"} Sep 10 12:24:21.097504 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.097469 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"871ef10f-6a89-429b-8185-ed8650472552","Type":"ContainerStarted","Data":"dec0e1eec5ad4ba2d7f0ee6ce27581adc4f237a203d2c82b568bf76a7ab73636"} Sep 10 12:24:21.097839 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.097568 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"871ef10f-6a89-429b-8185-ed8650472552","Type":"ContainerStarted","Data":"c1b690b978b9f3208fe4af0b1467229bfc71c24535de4932fa6cec850c2268f5"} Sep 10 12:24:21.097839 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.097599 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"871ef10f-6a89-429b-8185-ed8650472552","Type":"ContainerStarted","Data":"b466f7ae13fb06a3e8f01975ce175853f18ca62b41c4f9d07d1bee31e76c46fa"} Sep 10 12:24:21.097839 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.097625 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"871ef10f-6a89-429b-8185-ed8650472552","Type":"ContainerStarted","Data":"52b2cfb57f396d786b7d2718bf52b0ac9ee0c04fe0775ef8dca0072ec4f51551"} Sep 10 12:24:21.097839 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.097657 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"871ef10f-6a89-429b-8185-ed8650472552","Type":"ContainerStarted","Data":"a7bbbd327dd925c5911111d9a3f509253c853893b54c964477fbed7eb60b8397"} Sep 10 12:24:21.097839 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.097683 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"871ef10f-6a89-429b-8185-ed8650472552","Type":"ContainerStarted","Data":"24f772fb5d2af1d572ef894f552ede1babc82e1627dcfb7daab060e8cb89654e"} Sep 10 12:24:21.132770 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.132723 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.11663189 podStartE2EDuration="2.132701217s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.069327ms" isStatefulPod=false podCreationTimestamp="2026-09-10 12:24:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:24:21.130005701 +0000 UTC m=+186.417275451" watchObservedRunningTime="2026-09-10 12:24:21.132701217 +0000 UTC m=+186.419970894" Sep 10 12:24:21.321907 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.321747 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-78dbb99f86-2zwbx"] Sep 10 12:24:21.325479 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.325451 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.329153 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.329083 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 10 12:24:21.329273 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.329229 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-66j4m\"" Sep 10 12:24:21.330078 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.330058 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 10 12:24:21.330225 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.330077 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 10 12:24:21.330225 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.330077 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 10 12:24:21.330225 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.330058 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 10 12:24:21.335668 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.335648 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 10 12:24:21.352199 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.351289 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78dbb99f86-2zwbx"] Sep 10 12:24:21.412072 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.412035 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7aacd41a-dcc8-41ba-9b1b-c1609888636a-federate-client-tls\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.412244 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.412079 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aacd41a-dcc8-41ba-9b1b-c1609888636a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.412244 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.412112 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7aacd41a-dcc8-41ba-9b1b-c1609888636a-secret-telemeter-client\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.412244 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.412222 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aacd41a-dcc8-41ba-9b1b-c1609888636a-metrics-client-ca\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.412376 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.412255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqph9\" (UniqueName: \"kubernetes.io/projected/7aacd41a-dcc8-41ba-9b1b-c1609888636a-kube-api-access-bqph9\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.412376 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.412281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aacd41a-dcc8-41ba-9b1b-c1609888636a-serving-certs-ca-bundle\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.412376 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.412327 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7aacd41a-dcc8-41ba-9b1b-c1609888636a-telemeter-client-tls\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.412376 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.412370 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aacd41a-dcc8-41ba-9b1b-c1609888636a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.513274 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.513226 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7aacd41a-dcc8-41ba-9b1b-c1609888636a-telemeter-client-tls\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.513453 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.513282 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aacd41a-dcc8-41ba-9b1b-c1609888636a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.513453 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.513331 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7aacd41a-dcc8-41ba-9b1b-c1609888636a-federate-client-tls\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.513453 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.513364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aacd41a-dcc8-41ba-9b1b-c1609888636a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.513453 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.513404 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7aacd41a-dcc8-41ba-9b1b-c1609888636a-secret-telemeter-client\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.513667 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.513463 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aacd41a-dcc8-41ba-9b1b-c1609888636a-metrics-client-ca\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.513667 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.513496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqph9\" (UniqueName: \"kubernetes.io/projected/7aacd41a-dcc8-41ba-9b1b-c1609888636a-kube-api-access-bqph9\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.513667 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.513535 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aacd41a-dcc8-41ba-9b1b-c1609888636a-serving-certs-ca-bundle\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.514324 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.514300 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aacd41a-dcc8-41ba-9b1b-c1609888636a-serving-certs-ca-bundle\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.514629 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.514598 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7aacd41a-dcc8-41ba-9b1b-c1609888636a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.515705 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.515647 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aacd41a-dcc8-41ba-9b1b-c1609888636a-metrics-client-ca\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.517002 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.516981 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7aacd41a-dcc8-41ba-9b1b-c1609888636a-secret-telemeter-client\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.517811 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.517789 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aacd41a-dcc8-41ba-9b1b-c1609888636a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.517890 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.517862 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7aacd41a-dcc8-41ba-9b1b-c1609888636a-telemeter-client-tls\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.518119 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.518098 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7aacd41a-dcc8-41ba-9b1b-c1609888636a-federate-client-tls\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.525019 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.524995 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqph9\" (UniqueName: \"kubernetes.io/projected/7aacd41a-dcc8-41ba-9b1b-c1609888636a-kube-api-access-bqph9\") pod \"telemeter-client-78dbb99f86-2zwbx\" (UID: \"7aacd41a-dcc8-41ba-9b1b-c1609888636a\") " pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.636245 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.636170 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" Sep 10 12:24:21.652697 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.652597 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:24:21.653021 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.652971 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="prometheus" containerID="cri-o://6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b" gracePeriod=600 Sep 10 12:24:21.653117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.653029 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="thanos-sidecar" containerID="cri-o://65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408" gracePeriod=600 Sep 10 12:24:21.653117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.653056 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="config-reloader" containerID="cri-o://eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0" gracePeriod=600 Sep 10 12:24:21.653117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.653069 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="kube-rbac-proxy-web" containerID="cri-o://79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5" gracePeriod=600 Sep 10 12:24:21.653307 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.653001 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="kube-rbac-proxy" containerID="cri-o://004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368" gracePeriod=600 Sep 10 12:24:21.653307 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.652999 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8" gracePeriod=600 Sep 10 12:24:21.910617 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.910585 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:21.939284 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:21.939249 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78dbb99f86-2zwbx"] Sep 10 12:24:21.942668 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:24:21.942643 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aacd41a_dcc8_41ba_9b1b_c1609888636a.slice/crio-9b5bf25946c83212bf1f968aca92b977858c30802b8c541882e91946984fcca3 WatchSource:0}: Error finding container 9b5bf25946c83212bf1f968aca92b977858c30802b8c541882e91946984fcca3: Status 404 returned error can't find the container with id 9b5bf25946c83212bf1f968aca92b977858c30802b8c541882e91946984fcca3 Sep 10 12:24:22.018391 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018360 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-2\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018576 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018415 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-tls\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018576 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018434 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-config\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018576 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018453 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018576 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018475 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-thanos-prometheus-http-client-file\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018576 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018501 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-grpc-tls\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018576 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018524 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-1\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018576 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018551 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9vfr\" (UniqueName: \"kubernetes.io/projected/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-kube-api-access-q9vfr\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018576 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018573 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-metrics-client-certs\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018972 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018609 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-tls-assets\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018972 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018636 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-web-config\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018972 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018672 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-0\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018972 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018702 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-serving-certs-ca-bundle\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018972 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018705 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:24:22.018972 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018748 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-kubelet-serving-ca-bundle\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018972 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018773 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-kube-rbac-proxy\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018972 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018802 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-metrics-client-ca\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018972 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018830 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-trusted-ca-bundle\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018972 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018857 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-db\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018972 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018886 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-config-out\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.018972 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.018926 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\" (UID: \"c4a7965a-a8f4-4a7c-851a-740df2ae01d7\") " Sep 10 12:24:22.019631 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.019253 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.019631 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.019412 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:24:22.019907 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.019803 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:24:22.020441 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.020411 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:24:22.020826 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.020797 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:24:22.021299 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.021269 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:24:22.021697 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.021666 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 12:24:22.021784 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.021765 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:24:22.022639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.022607 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-kube-api-access-q9vfr" (OuterVolumeSpecName: "kube-api-access-q9vfr") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "kube-api-access-q9vfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:24:22.023113 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.023083 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:24:22.023113 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.023085 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:24:22.023285 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.023126 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:24:22.023285 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.023244 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:24:22.023395 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.023369 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:24:22.023457 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.023437 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:24:22.023609 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.023584 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-config" (OuterVolumeSpecName: "config") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:24:22.023609 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.023609 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:24:22.024179 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.024160 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:24:22.024179 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.024164 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-config-out" (OuterVolumeSpecName: "config-out") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:24:22.034698 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.034677 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-web-config" (OuterVolumeSpecName: "web-config") pod "c4a7965a-a8f4-4a7c-851a-740df2ae01d7" (UID: "c4a7965a-a8f4-4a7c-851a-740df2ae01d7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 12:24:22.103881 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.103856 2574 generic.go:356] "Generic (PLEG): container finished" podID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerID="2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8" exitCode=0 Sep 10 12:24:22.103881 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.103879 2574 generic.go:356] "Generic (PLEG): container finished" podID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerID="004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368" exitCode=0 Sep 10 12:24:22.103881 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.103885 2574 generic.go:356] "Generic (PLEG): container finished" podID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerID="79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5" exitCode=0 Sep 10 12:24:22.104342 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.103893 2574 generic.go:356] "Generic (PLEG): container finished" podID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerID="65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408" exitCode=0 Sep 10 12:24:22.104342 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.103899 2574 generic.go:356] "Generic (PLEG): container finished" podID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerID="eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0" exitCode=0 Sep 10 12:24:22.104342 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.103905 2574 generic.go:356] "Generic (PLEG): container finished" podID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerID="6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b" exitCode=0 Sep 10 12:24:22.104342 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.103936 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.104342 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.103935 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4a7965a-a8f4-4a7c-851a-740df2ae01d7","Type":"ContainerDied","Data":"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8"} Sep 10 12:24:22.104342 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.104000 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4a7965a-a8f4-4a7c-851a-740df2ae01d7","Type":"ContainerDied","Data":"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368"} Sep 10 12:24:22.104342 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.104027 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4a7965a-a8f4-4a7c-851a-740df2ae01d7","Type":"ContainerDied","Data":"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5"} Sep 10 12:24:22.104342 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.104060 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4a7965a-a8f4-4a7c-851a-740df2ae01d7","Type":"ContainerDied","Data":"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408"} Sep 10 12:24:22.104342 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.104074 2574 scope.go:117] "RemoveContainer" containerID="2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8" Sep 10 12:24:22.104342 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.104092 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4a7965a-a8f4-4a7c-851a-740df2ae01d7","Type":"ContainerDied","Data":"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0"} Sep 10 12:24:22.104342 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.104157 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4a7965a-a8f4-4a7c-851a-740df2ae01d7","Type":"ContainerDied","Data":"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b"} Sep 10 12:24:22.104342 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.104200 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4a7965a-a8f4-4a7c-851a-740df2ae01d7","Type":"ContainerDied","Data":"ccbf276581704b6c06fcd4a98a3c0639e440a2c80acd18b70ebb8694ce19a338"} Sep 10 12:24:22.105502 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.105477 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" event={"ID":"7aacd41a-dcc8-41ba-9b1b-c1609888636a","Type":"ContainerStarted","Data":"9b5bf25946c83212bf1f968aca92b977858c30802b8c541882e91946984fcca3"} Sep 10 12:24:22.113091 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.113074 2574 scope.go:117] "RemoveContainer" containerID="004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368" Sep 10 12:24:22.119903 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.119832 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.119903 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.119855 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-config\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.119903 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.119869 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.119903 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.119884 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.119903 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.119901 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-grpc-tls\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.120103 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.119913 2574 scope.go:117] "RemoveContainer" containerID="79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5" Sep 10 12:24:22.120103 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.119914 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.120103 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.119994 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9vfr\" (UniqueName: \"kubernetes.io/projected/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-kube-api-access-q9vfr\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.120103 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.120012 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-metrics-client-certs\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.120103 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.120028 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-tls-assets\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.120103 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.120041 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-web-config\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.120103 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.120052 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.120103 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.120066 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.120103 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.120102 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.120421 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.120116 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-kube-rbac-proxy\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.120421 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.120131 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-configmap-metrics-client-ca\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.120421 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.120161 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.120421 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.120174 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-prometheus-k8s-db\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.120421 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.120186 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-config-out\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.120421 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.120197 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4a7965a-a8f4-4a7c-851a-740df2ae01d7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:24:22.129160 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.129123 2574 scope.go:117] "RemoveContainer" containerID="65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408" Sep 10 12:24:22.129503 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.129485 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:24:22.133581 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.133558 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:24:22.136842 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.136825 2574 scope.go:117] "RemoveContainer" containerID="eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0" Sep 10 12:24:22.143317 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.143301 2574 scope.go:117] "RemoveContainer" containerID="6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b" Sep 10 12:24:22.150227 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.150212 2574 scope.go:117] "RemoveContainer" containerID="3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361" Sep 10 12:24:22.157007 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.156982 2574 scope.go:117] "RemoveContainer" containerID="2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8" Sep 10 12:24:22.157296 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:24:22.157279 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8\": container with ID starting with 2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8 not found: ID does not exist" containerID="2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8" Sep 10 12:24:22.157356 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.157312 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8"} err="failed to get container status \"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8\": rpc error: code = NotFound desc = could not find container \"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8\": container with ID starting with 2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8 not found: ID does not exist" Sep 10 12:24:22.157356 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.157335 2574 scope.go:117] "RemoveContainer" containerID="004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368" Sep 10 12:24:22.157562 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:24:22.157548 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368\": container with ID starting with 004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368 not found: ID does not exist" containerID="004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368" Sep 10 12:24:22.157597 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.157566 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368"} err="failed to get container status \"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368\": rpc error: code = NotFound desc = could not find container \"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368\": container with ID starting with 004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368 not found: ID does not exist" Sep 10 12:24:22.157597 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.157581 2574 scope.go:117] "RemoveContainer" containerID="79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5" Sep 10 12:24:22.157836 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:24:22.157818 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5\": container with ID starting with 79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5 not found: ID does not exist" containerID="79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5" Sep 10 12:24:22.157905 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.157845 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5"} err="failed to get container status \"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5\": rpc error: code = NotFound desc = could not find container \"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5\": container with ID starting with 79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5 not found: ID does not exist" Sep 10 12:24:22.157905 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.157869 2574 scope.go:117] "RemoveContainer" containerID="65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408" Sep 10 12:24:22.158111 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:24:22.158095 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408\": container with ID starting with 65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408 not found: ID does not exist" containerID="65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408" Sep 10 12:24:22.158182 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.158119 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408"} err="failed to get container status \"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408\": rpc error: code = NotFound desc = could not find container \"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408\": container with ID starting with 65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408 not found: ID does not exist" Sep 10 12:24:22.158182 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.158153 2574 scope.go:117] "RemoveContainer" containerID="eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0" Sep 10 12:24:22.158380 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:24:22.158363 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0\": container with ID starting with eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0 not found: ID does not exist" containerID="eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0" Sep 10 12:24:22.158420 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.158384 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0"} err="failed to get container status \"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0\": rpc error: code = NotFound desc = could not find container \"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0\": container with ID starting with eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0 not found: ID does not exist" Sep 10 12:24:22.158420 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.158398 2574 scope.go:117] "RemoveContainer" containerID="6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b" Sep 10 12:24:22.158591 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:24:22.158575 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b\": container with ID starting with 6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b not found: ID does not exist" containerID="6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b" Sep 10 12:24:22.158646 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.158599 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b"} err="failed to get container status \"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b\": rpc error: code = NotFound desc = could not find container \"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b\": container with ID starting with 6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b not found: ID does not exist" Sep 10 12:24:22.158646 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.158617 2574 scope.go:117] "RemoveContainer" containerID="3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361" Sep 10 12:24:22.158824 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:24:22.158809 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361\": container with ID starting with 3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361 not found: ID does not exist" containerID="3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361" Sep 10 12:24:22.158861 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.158826 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361"} err="failed to get container status \"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361\": rpc error: code = NotFound desc = could not find container \"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361\": container with ID starting with 3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361 not found: ID does not exist" Sep 10 12:24:22.158861 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.158838 2574 scope.go:117] "RemoveContainer" containerID="2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8" Sep 10 12:24:22.159028 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.159011 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8"} err="failed to get container status \"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8\": rpc error: code = NotFound desc = could not find container \"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8\": container with ID starting with 2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8 not found: ID does not exist" Sep 10 12:24:22.159100 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.159029 2574 scope.go:117] "RemoveContainer" containerID="004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368" Sep 10 12:24:22.159323 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.159307 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368"} err="failed to get container status \"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368\": rpc error: code = NotFound desc = could not find container \"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368\": container with ID starting with 004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368 not found: ID does not exist" Sep 10 12:24:22.159385 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.159322 2574 scope.go:117] "RemoveContainer" containerID="79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5" Sep 10 12:24:22.159520 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.159505 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5"} err="failed to get container status \"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5\": rpc error: code = NotFound desc = could not find container \"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5\": container with ID starting with 79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5 not found: ID does not exist" Sep 10 12:24:22.159569 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.159519 2574 scope.go:117] "RemoveContainer" containerID="65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408" Sep 10 12:24:22.159746 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.159726 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408"} err="failed to get container status \"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408\": rpc error: code = NotFound desc = could not find container \"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408\": container with ID starting with 65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408 not found: ID does not exist" Sep 10 12:24:22.159819 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.159758 2574 scope.go:117] "RemoveContainer" containerID="eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0" Sep 10 12:24:22.160025 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.160008 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0"} err="failed to get container status \"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0\": rpc error: code = NotFound desc = could not find container \"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0\": container with ID starting with eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0 not found: ID does not exist" Sep 10 12:24:22.160063 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.160027 2574 scope.go:117] "RemoveContainer" containerID="6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b" Sep 10 12:24:22.160301 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.160282 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b"} err="failed to get container status \"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b\": rpc error: code = NotFound desc = could not find container \"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b\": container with ID starting with 6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b not found: ID does not exist" Sep 10 12:24:22.160350 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.160301 2574 scope.go:117] "RemoveContainer" containerID="3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361" Sep 10 12:24:22.160537 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.160520 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361"} err="failed to get container status \"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361\": rpc error: code = NotFound desc = could not find container \"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361\": container with ID starting with 3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361 not found: ID does not exist" Sep 10 12:24:22.160608 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.160538 2574 scope.go:117] "RemoveContainer" containerID="2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8" Sep 10 12:24:22.160790 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.160771 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8"} err="failed to get container status \"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8\": rpc error: code = NotFound desc = could not find container \"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8\": container with ID starting with 2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8 not found: ID does not exist" Sep 10 12:24:22.160828 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.160792 2574 scope.go:117] "RemoveContainer" containerID="004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368" Sep 10 12:24:22.161027 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.161012 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368"} err="failed to get container status \"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368\": rpc error: code = NotFound desc = could not find container \"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368\": container with ID starting with 004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368 not found: ID does not exist" Sep 10 12:24:22.161062 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.161027 2574 scope.go:117] "RemoveContainer" containerID="79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5" Sep 10 12:24:22.161264 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.161247 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5"} err="failed to get container status \"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5\": rpc error: code = NotFound desc = could not find container \"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5\": container with ID starting with 79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5 not found: ID does not exist" Sep 10 12:24:22.161311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.161266 2574 scope.go:117] "RemoveContainer" containerID="65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408" Sep 10 12:24:22.161478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.161462 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408"} err="failed to get container status \"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408\": rpc error: code = NotFound desc = could not find container \"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408\": container with ID starting with 65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408 not found: ID does not exist" Sep 10 12:24:22.161536 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.161480 2574 scope.go:117] "RemoveContainer" containerID="eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0" Sep 10 12:24:22.161693 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.161677 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0"} err="failed to get container status \"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0\": rpc error: code = NotFound desc = could not find container \"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0\": container with ID starting with eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0 not found: ID does not exist" Sep 10 12:24:22.161734 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.161694 2574 scope.go:117] "RemoveContainer" containerID="6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b" Sep 10 12:24:22.161872 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.161854 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b"} err="failed to get container status \"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b\": rpc error: code = NotFound desc = could not find container \"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b\": container with ID starting with 6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b not found: ID does not exist" Sep 10 12:24:22.161931 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.161873 2574 scope.go:117] "RemoveContainer" containerID="3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361" Sep 10 12:24:22.162116 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.162099 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361"} err="failed to get container status \"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361\": rpc error: code = NotFound desc = could not find container \"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361\": container with ID starting with 3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361 not found: ID does not exist" Sep 10 12:24:22.162189 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.162117 2574 scope.go:117] "RemoveContainer" containerID="2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8" Sep 10 12:24:22.162425 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.162410 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8"} err="failed to get container status \"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8\": rpc error: code = NotFound desc = could not find container \"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8\": container with ID starting with 2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8 not found: ID does not exist" Sep 10 12:24:22.162476 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.162426 2574 scope.go:117] "RemoveContainer" containerID="004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368" Sep 10 12:24:22.162652 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.162634 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368"} err="failed to get container status \"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368\": rpc error: code = NotFound desc = could not find container \"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368\": container with ID starting with 004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368 not found: ID does not exist" Sep 10 12:24:22.162690 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.162654 2574 scope.go:117] "RemoveContainer" containerID="79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5" Sep 10 12:24:22.162849 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.162834 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5"} err="failed to get container status \"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5\": rpc error: code = NotFound desc = could not find container \"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5\": container with ID starting with 79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5 not found: ID does not exist" Sep 10 12:24:22.162901 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.162849 2574 scope.go:117] "RemoveContainer" containerID="65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408" Sep 10 12:24:22.163151 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.163119 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408"} err="failed to get container status \"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408\": rpc error: code = NotFound desc = could not find container \"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408\": container with ID starting with 65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408 not found: ID does not exist" Sep 10 12:24:22.163237 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.163153 2574 scope.go:117] "RemoveContainer" containerID="eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0" Sep 10 12:24:22.163478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.163446 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0"} err="failed to get container status \"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0\": rpc error: code = NotFound desc = could not find container \"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0\": container with ID starting with eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0 not found: ID does not exist" Sep 10 12:24:22.163478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.163475 2574 scope.go:117] "RemoveContainer" containerID="6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b" Sep 10 12:24:22.163889 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.163842 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b"} err="failed to get container status \"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b\": rpc error: code = NotFound desc = could not find container \"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b\": container with ID starting with 6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b not found: ID does not exist" Sep 10 12:24:22.163889 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.163887 2574 scope.go:117] "RemoveContainer" containerID="3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361" Sep 10 12:24:22.164181 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.164128 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361"} err="failed to get container status \"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361\": rpc error: code = NotFound desc = could not find container \"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361\": container with ID starting with 3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361 not found: ID does not exist" Sep 10 12:24:22.164181 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.164182 2574 scope.go:117] "RemoveContainer" containerID="2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8" Sep 10 12:24:22.164476 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.164460 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8"} err="failed to get container status \"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8\": rpc error: code = NotFound desc = could not find container \"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8\": container with ID starting with 2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8 not found: ID does not exist" Sep 10 12:24:22.164521 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.164478 2574 scope.go:117] "RemoveContainer" containerID="004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368" Sep 10 12:24:22.164716 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.164698 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368"} err="failed to get container status \"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368\": rpc error: code = NotFound desc = could not find container \"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368\": container with ID starting with 004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368 not found: ID does not exist" Sep 10 12:24:22.164773 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.164718 2574 scope.go:117] "RemoveContainer" containerID="79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5" Sep 10 12:24:22.164990 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.164973 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5"} err="failed to get container status \"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5\": rpc error: code = NotFound desc = could not find container \"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5\": container with ID starting with 79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5 not found: ID does not exist" Sep 10 12:24:22.165042 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.164991 2574 scope.go:117] "RemoveContainer" containerID="65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408" Sep 10 12:24:22.165267 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165249 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408"} err="failed to get container status \"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408\": rpc error: code = NotFound desc = could not find container \"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408\": container with ID starting with 65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408 not found: ID does not exist" Sep 10 12:24:22.165317 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165268 2574 scope.go:117] "RemoveContainer" containerID="eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0" Sep 10 12:24:22.165382 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165364 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:24:22.165518 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165477 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0"} err="failed to get container status \"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0\": rpc error: code = NotFound desc = could not find container \"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0\": container with ID starting with eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0 not found: ID does not exist" Sep 10 12:24:22.165559 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165520 2574 scope.go:117] "RemoveContainer" containerID="6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b" Sep 10 12:24:22.165683 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165670 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="thanos-sidecar" Sep 10 12:24:22.165751 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165686 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="thanos-sidecar" Sep 10 12:24:22.165751 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165699 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="config-reloader" Sep 10 12:24:22.165751 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165705 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="config-reloader" Sep 10 12:24:22.165751 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165716 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="init-config-reloader" Sep 10 12:24:22.165751 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165722 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="init-config-reloader" Sep 10 12:24:22.165751 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165729 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="kube-rbac-proxy" Sep 10 12:24:22.165751 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165734 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="kube-rbac-proxy" Sep 10 12:24:22.165751 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165744 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="kube-rbac-proxy-web" Sep 10 12:24:22.165751 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165737 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b"} err="failed to get container status \"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b\": rpc error: code = NotFound desc = could not find container \"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b\": container with ID starting with 6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b not found: ID does not exist" Sep 10 12:24:22.166183 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165762 2574 scope.go:117] "RemoveContainer" containerID="3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361" Sep 10 12:24:22.166183 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165748 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="kube-rbac-proxy-web" Sep 10 12:24:22.166183 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165837 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="prometheus" Sep 10 12:24:22.166183 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165849 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="prometheus" Sep 10 12:24:22.166183 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165868 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="kube-rbac-proxy-thanos" Sep 10 12:24:22.166183 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165876 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="kube-rbac-proxy-thanos" Sep 10 12:24:22.166183 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165982 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="kube-rbac-proxy-web" Sep 10 12:24:22.166183 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.165996 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="kube-rbac-proxy" Sep 10 12:24:22.166183 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.166007 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="config-reloader" Sep 10 12:24:22.166183 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.166016 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="kube-rbac-proxy-thanos" Sep 10 12:24:22.166183 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.166026 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="prometheus" Sep 10 12:24:22.166183 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.166025 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361"} err="failed to get container status \"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361\": rpc error: code = NotFound desc = could not find container \"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361\": container with ID starting with 3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361 not found: ID does not exist" Sep 10 12:24:22.166183 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.166038 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" containerName="thanos-sidecar" Sep 10 12:24:22.166183 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.166041 2574 scope.go:117] "RemoveContainer" containerID="2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8" Sep 10 12:24:22.166843 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.166288 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8"} err="failed to get container status \"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8\": rpc error: code = NotFound desc = could not find container \"2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8\": container with ID starting with 2a9191584c2188c9436153ad3f457fd5a80b9b0355f6d522a6e14ce76530b6c8 not found: ID does not exist" Sep 10 12:24:22.166843 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.166301 2574 scope.go:117] "RemoveContainer" containerID="004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368" Sep 10 12:24:22.166843 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.166492 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368"} err="failed to get container status \"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368\": rpc error: code = NotFound desc = could not find container \"004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368\": container with ID starting with 004e39b706c5c8bedfaa8b6e4814e2833c678f44efc0335ec5ff434ac0d2c368 not found: ID does not exist" Sep 10 12:24:22.166843 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.166511 2574 scope.go:117] "RemoveContainer" containerID="79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5" Sep 10 12:24:22.166843 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.166704 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5"} err="failed to get container status \"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5\": rpc error: code = NotFound desc = could not find container \"79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5\": container with ID starting with 79fe70d632ffefb93ab9f846af24424b85849906c1a571fc01ef087d5e0bdab5 not found: ID does not exist" Sep 10 12:24:22.166843 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.166721 2574 scope.go:117] "RemoveContainer" containerID="65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408" Sep 10 12:24:22.167117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.166884 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408"} err="failed to get container status \"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408\": rpc error: code = NotFound desc = could not find container \"65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408\": container with ID starting with 65509455b79f563dd9c4371330375631b8310a19996fc95ba5a5b95a79e75408 not found: ID does not exist" Sep 10 12:24:22.167117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.166897 2574 scope.go:117] "RemoveContainer" containerID="eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0" Sep 10 12:24:22.167117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.167097 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0"} err="failed to get container status \"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0\": rpc error: code = NotFound desc = could not find container \"eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0\": container with ID starting with eb4b0936d2b3b5b4fd5edc3dd22c446c04f09ff27241fd2fb0302ba0c25807d0 not found: ID does not exist" Sep 10 12:24:22.167117 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.167114 2574 scope.go:117] "RemoveContainer" containerID="6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b" Sep 10 12:24:22.167324 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.167299 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b"} err="failed to get container status \"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b\": rpc error: code = NotFound desc = could not find container \"6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b\": container with ID starting with 6dbc087a283db151ff673a8766a67442e76b9641ed4d3d7f5efd9687e038424b not found: ID does not exist" Sep 10 12:24:22.167324 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.167311 2574 scope.go:117] "RemoveContainer" containerID="3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361" Sep 10 12:24:22.167530 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.167512 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361"} err="failed to get container status \"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361\": rpc error: code = NotFound desc = could not find container \"3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361\": container with ID starting with 3a3ffc2de95a49333a1960070e273e05d72d84eddea0a5a7bd3a4b4bfce10361 not found: ID does not exist" Sep 10 12:24:22.171764 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.171744 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.175643 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.175055 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 12:24:22.175643 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.175286 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 12:24:22.175643 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.175455 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 12:24:22.175643 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.175607 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7scsv4b72e7d\"" Sep 10 12:24:22.175877 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.175866 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 12:24:22.175933 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.175913 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zckw9\"" Sep 10 12:24:22.175985 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.175933 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 12:24:22.175985 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.175915 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 12:24:22.176090 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.176034 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 12:24:22.176440 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.176420 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 12:24:22.176672 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.176644 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 12:24:22.176761 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.176644 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 12:24:22.176920 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.176906 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 12:24:22.177021 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.176925 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 12:24:22.179087 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.179060 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 12:24:22.183455 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.183438 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 12:24:22.220988 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.220945 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.221254 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.221338 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221275 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.221338 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221322 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whf7r\" (UniqueName: \"kubernetes.io/projected/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-kube-api-access-whf7r\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.221478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221382 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.221478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221413 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-web-config\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.221478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221428 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.221478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221442 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.221478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221458 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.221478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221477 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.221690 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.221690 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221611 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-config-out\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.221774 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221694 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.221774 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.221774 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221727 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.221774 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221745 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.221916 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221855 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.222001 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.221982 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-config\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.222061 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.222015 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.222061 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.222037 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.309690 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.309660 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:24:22.323428 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323400 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323557 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323432 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-web-config\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323557 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323448 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323557 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323464 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323557 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323481 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323557 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323498 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323557 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323514 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323557 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323530 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-config-out\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323882 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323882 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323882 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323607 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323882 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323882 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323882 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-config\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323882 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323723 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323882 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323882 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323776 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323882 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323804 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323882 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323821 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.323882 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323845 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whf7r\" (UniqueName: \"kubernetes.io/projected/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-kube-api-access-whf7r\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.324563 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.323879 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.324563 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.324587 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.326384 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.326356 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.326885 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.326865 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-config\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.326983 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.326925 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.327098 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.327066 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.327339 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.327316 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.328273 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.327628 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.328273 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.327890 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.328273 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.328127 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.328273 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.328181 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.328526 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.328450 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.328582 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.328565 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-config-out\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.328693 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.328667 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.328749 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.328715 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.328848 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.328822 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-web-config\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.329464 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.329444 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.329543 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.329475 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.330644 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.330627 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.332664 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.332648 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whf7r\" (UniqueName: \"kubernetes.io/projected/f16c9fa0-a8aa-410d-b72e-c1d0387b8987-kube-api-access-whf7r\") pod \"prometheus-k8s-0\" (UID: \"f16c9fa0-a8aa-410d-b72e-c1d0387b8987\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.482947 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.482919 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:22.773041 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:22.772953 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 12:24:22.777930 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:24:22.777906 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16c9fa0_a8aa_410d_b72e_c1d0387b8987.slice/crio-c50206d18cc7a410115ebc786797b9154d23da6c0ec9e34c59d54ba2647d6e35 WatchSource:0}: Error finding container c50206d18cc7a410115ebc786797b9154d23da6c0ec9e34c59d54ba2647d6e35: Status 404 returned error can't find the container with id c50206d18cc7a410115ebc786797b9154d23da6c0ec9e34c59d54ba2647d6e35 Sep 10 12:24:23.113565 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:23.113473 2574 generic.go:356] "Generic (PLEG): container finished" podID="f16c9fa0-a8aa-410d-b72e-c1d0387b8987" containerID="f5f48e22d75b3bd301ad8c55d435c32d6d50e9225eb203bd7851fe68e910578c" exitCode=0 Sep 10 12:24:23.113953 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:23.113571 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16c9fa0-a8aa-410d-b72e-c1d0387b8987","Type":"ContainerDied","Data":"f5f48e22d75b3bd301ad8c55d435c32d6d50e9225eb203bd7851fe68e910578c"} Sep 10 12:24:23.113953 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:23.113656 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16c9fa0-a8aa-410d-b72e-c1d0387b8987","Type":"ContainerStarted","Data":"c50206d18cc7a410115ebc786797b9154d23da6c0ec9e34c59d54ba2647d6e35"} Sep 10 12:24:23.207199 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:23.207169 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4a7965a-a8f4-4a7c-851a-740df2ae01d7" path="/var/lib/kubelet/pods/c4a7965a-a8f4-4a7c-851a-740df2ae01d7/volumes" Sep 10 12:24:24.129228 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:24.129193 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16c9fa0-a8aa-410d-b72e-c1d0387b8987","Type":"ContainerStarted","Data":"c9cb66c00cb09592d3f5ea0496565791302936ec3c8100b71e20c536a82de575"} Sep 10 12:24:24.129674 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:24.129294 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16c9fa0-a8aa-410d-b72e-c1d0387b8987","Type":"ContainerStarted","Data":"7ac912be9227f438361e3409309e4c931701c8c7e488a8ac4c474e6e6316af46"} Sep 10 12:24:24.129674 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:24.129324 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16c9fa0-a8aa-410d-b72e-c1d0387b8987","Type":"ContainerStarted","Data":"53a569192238c33416ef5f849c4c44e5d6914799ec6572ead33cf87cba990970"} Sep 10 12:24:24.129674 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:24.129348 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16c9fa0-a8aa-410d-b72e-c1d0387b8987","Type":"ContainerStarted","Data":"a9d972c9f3382e58e1dd253301aa9b1cd34413f9bad95cc1477a5b3484fb492e"} Sep 10 12:24:24.129674 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:24.129380 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16c9fa0-a8aa-410d-b72e-c1d0387b8987","Type":"ContainerStarted","Data":"78785411e13f9663a300a5607c35ec4113920bffe3e10e6f13b2587e24d6a6a3"} Sep 10 12:24:24.129674 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:24.129412 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16c9fa0-a8aa-410d-b72e-c1d0387b8987","Type":"ContainerStarted","Data":"eaaa566a7e96b09ac485015c4dbc3650a50888b54e8e64ed783955000cbe9294"} Sep 10 12:24:24.171506 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:24.171425 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.152790343 podStartE2EDuration="2.171406137s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.615794ms" isStatefulPod=false podCreationTimestamp="2026-09-10 12:24:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:24:24.169937396 +0000 UTC m=+189.457207075" watchObservedRunningTime="2026-09-10 12:24:24.171406137 +0000 UTC m=+189.458675814" Sep 10 12:24:25.135863 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:25.135830 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" event={"ID":"7aacd41a-dcc8-41ba-9b1b-c1609888636a","Type":"ContainerStarted","Data":"27866eac744358aa48f8a6e65987bdfaaa5041b54bb783ae089289dd0289a301"} Sep 10 12:24:25.136252 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:25.135895 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" event={"ID":"7aacd41a-dcc8-41ba-9b1b-c1609888636a","Type":"ContainerStarted","Data":"832602c23b171bc7e0bd132cb4c5739e2f7f91a8d5c2056601084c61ef761a7a"} Sep 10 12:24:25.136252 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:25.135917 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" event={"ID":"7aacd41a-dcc8-41ba-9b1b-c1609888636a","Type":"ContainerStarted","Data":"769bb2bed6523d9b4f817dd928b741bdb46bc8d19d826a32785b0fd40a6b4fcd"} Sep 10 12:24:25.164323 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:25.164274 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-78dbb99f86-2zwbx" podStartSLOduration=1.729821717 podStartE2EDuration="4.164258918s" totalImagesPullingTime="2.434437201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:24:25.163275947 +0000 UTC m=+190.450545625" watchObservedRunningTime="2026-09-10 12:24:25.164258918 +0000 UTC m=+190.451528596" Sep 10 12:24:25.340757 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:25.340725 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:25.439296 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:25.439182 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:25.541163 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:25.541102 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:26.082158 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:26.082106 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:26.186637 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:26.186603 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:27.483753 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:27.483715 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:24:36.515788 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:36.515745 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:36.622739 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:36.622705 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:36.729707 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:36.729677 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:42.865560 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:42.865521 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:42.983122 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:42.983090 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:51.601376 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:51.601343 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:24:51.705022 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:24:51.704987 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:25:00.994019 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:00.993981 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:25:16.414672 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:16.414639 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:25:22.483463 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:22.483430 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:25:22.498471 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:22.498449 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:25:23.377524 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:23.377497 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 12:25:31.685762 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:31.685722 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:25:31.795651 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:31.795618 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:25:34.300429 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:34.300397 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:25:34.418013 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:34.417978 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:25:34.511389 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:34.511359 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:25:35.022507 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:35.022470 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:25:35.124311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:35.124279 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:25:43.623153 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:43.623045 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:25:43.711013 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:43.710975 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:25:44.788034 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:44.787998 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:25:44.900632 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:44.900602 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:25:45.058000 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:45.057924 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:25:50.795194 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:50.795158 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:25:50.935081 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:25:50.935045 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:26:15.151602 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:26:15.151574 2574 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 12:26:54.368555 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:26:54.368516 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:26:56.469173 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:26:56.469124 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:00.105667 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:00.105629 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:18.657149 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:18.657048 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:18.781603 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:18.781565 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:22.782878 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:22.782839 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:22.901393 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:22.901357 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:24.691766 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:24.691728 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:24.952040 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:24.951967 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:26.946486 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:26.946452 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:27.296502 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:27.296468 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:28.077932 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:28.077890 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:28.179400 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:28.179366 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:29.212914 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:29.212879 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:29.332750 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:29.332702 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:33.803830 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:33.803795 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:33.909545 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:33.909507 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:35.238408 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:35.238366 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:37.216308 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:37.216274 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:37.319564 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:37.319531 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:47.712701 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:47.712667 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:47.809184 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:47.809124 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:49.259759 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:49.259723 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-d9psf"] Sep 10 12:27:49.263103 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:49.263084 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-d9psf" Sep 10 12:27:49.266038 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:49.266019 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 10 12:27:49.266151 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:49.266024 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 10 12:27:49.267221 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:49.267203 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-zn2t4\"" Sep 10 12:27:49.277435 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:49.277413 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-d9psf"] Sep 10 12:27:49.399906 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:49.399876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5be62120-81ff-4199-8663-664a0b11b6ac-tmp\") pod \"jobset-operator-5bc45f897-d9psf\" (UID: \"5be62120-81ff-4199-8663-664a0b11b6ac\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-d9psf" Sep 10 12:27:49.399906 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:49.399911 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvg75\" (UniqueName: \"kubernetes.io/projected/5be62120-81ff-4199-8663-664a0b11b6ac-kube-api-access-zvg75\") pod \"jobset-operator-5bc45f897-d9psf\" (UID: \"5be62120-81ff-4199-8663-664a0b11b6ac\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-d9psf" Sep 10 12:27:49.500436 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:49.500400 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5be62120-81ff-4199-8663-664a0b11b6ac-tmp\") pod \"jobset-operator-5bc45f897-d9psf\" (UID: \"5be62120-81ff-4199-8663-664a0b11b6ac\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-d9psf" Sep 10 12:27:49.500550 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:49.500443 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvg75\" (UniqueName: \"kubernetes.io/projected/5be62120-81ff-4199-8663-664a0b11b6ac-kube-api-access-zvg75\") pod \"jobset-operator-5bc45f897-d9psf\" (UID: \"5be62120-81ff-4199-8663-664a0b11b6ac\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-d9psf" Sep 10 12:27:49.500806 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:49.500787 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5be62120-81ff-4199-8663-664a0b11b6ac-tmp\") pod \"jobset-operator-5bc45f897-d9psf\" (UID: \"5be62120-81ff-4199-8663-664a0b11b6ac\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-d9psf" Sep 10 12:27:49.510160 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:49.510089 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvg75\" (UniqueName: \"kubernetes.io/projected/5be62120-81ff-4199-8663-664a0b11b6ac-kube-api-access-zvg75\") pod \"jobset-operator-5bc45f897-d9psf\" (UID: \"5be62120-81ff-4199-8663-664a0b11b6ac\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-d9psf" Sep 10 12:27:49.582148 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:49.582119 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-d9psf" Sep 10 12:27:49.861642 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:49.861569 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-d9psf"] Sep 10 12:27:49.864969 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:27:49.864939 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5be62120_81ff_4199_8663_664a0b11b6ac.slice/crio-5052e0e88d15790497be144fe16a99f2d6e7656a305a04e4dd8f207d9324172a WatchSource:0}: Error finding container 5052e0e88d15790497be144fe16a99f2d6e7656a305a04e4dd8f207d9324172a: Status 404 returned error can't find the container with id 5052e0e88d15790497be144fe16a99f2d6e7656a305a04e4dd8f207d9324172a Sep 10 12:27:49.866662 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:49.866642 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:27:49.938115 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:49.938086 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-d9psf" event={"ID":"5be62120-81ff-4199-8663-664a0b11b6ac","Type":"ContainerStarted","Data":"5052e0e88d15790497be144fe16a99f2d6e7656a305a04e4dd8f207d9324172a"} Sep 10 12:27:52.953656 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:52.953573 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-d9psf" event={"ID":"5be62120-81ff-4199-8663-664a0b11b6ac","Type":"ContainerStarted","Data":"4ae7878dbbf94b07826f8be49ef8f89ed2577e86043501b15690d6fa2b24d576"} Sep 10 12:27:52.976077 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:52.976024 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-d9psf" podStartSLOduration=1.217078851 podStartE2EDuration="3.976005232s" totalImagesPullingTime="2.758926381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:27:52.975969578 +0000 UTC m=+398.263239269" watchObservedRunningTime="2026-09-10 12:27:52.976005232 +0000 UTC m=+398.263274911" Sep 10 12:27:58.007539 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:58.007507 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:27:59.941923 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:27:59.941891 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:28:02.359341 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:02.359309 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:28:02.447107 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:02.447074 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:28:03.474295 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:03.474266 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:28:03.559854 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:03.559824 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:28:14.471264 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:14.471229 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:28:14.554349 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:14.554322 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:28:19.455339 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:19.455307 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:28:19.565552 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:19.565519 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:28:22.940626 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:22.940591 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:28:22.966496 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:22.966467 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5"] Sep 10 12:28:22.972549 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:22.972534 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" Sep 10 12:28:22.977093 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:22.977070 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 12:28:22.977203 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:22.977119 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 10 12:28:22.977388 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:22.977366 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-h7w9p\"" Sep 10 12:28:22.977748 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:22.977734 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 10 12:28:22.977812 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:22.977750 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 12:28:22.985675 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:22.985655 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5"] Sep 10 12:28:23.030366 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:23.030343 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:28:23.092393 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:23.092360 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/33da968c-bf90-4c49-af0d-bd4324f19894-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-596c46d97c-b4kj5\" (UID: \"33da968c-bf90-4c49-af0d-bd4324f19894\") " pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" Sep 10 12:28:23.092530 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:23.092396 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvtsj\" (UniqueName: \"kubernetes.io/projected/33da968c-bf90-4c49-af0d-bd4324f19894-kube-api-access-fvtsj\") pod \"kubeflow-trainer-controller-manager-596c46d97c-b4kj5\" (UID: \"33da968c-bf90-4c49-af0d-bd4324f19894\") " pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" Sep 10 12:28:23.092530 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:23.092435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33da968c-bf90-4c49-af0d-bd4324f19894-cert\") pod \"kubeflow-trainer-controller-manager-596c46d97c-b4kj5\" (UID: \"33da968c-bf90-4c49-af0d-bd4324f19894\") " pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" Sep 10 12:28:23.192959 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:23.192891 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/33da968c-bf90-4c49-af0d-bd4324f19894-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-596c46d97c-b4kj5\" (UID: \"33da968c-bf90-4c49-af0d-bd4324f19894\") " pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" Sep 10 12:28:23.192959 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:23.192920 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvtsj\" (UniqueName: \"kubernetes.io/projected/33da968c-bf90-4c49-af0d-bd4324f19894-kube-api-access-fvtsj\") pod \"kubeflow-trainer-controller-manager-596c46d97c-b4kj5\" (UID: \"33da968c-bf90-4c49-af0d-bd4324f19894\") " pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" Sep 10 12:28:23.192959 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:23.192945 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33da968c-bf90-4c49-af0d-bd4324f19894-cert\") pod \"kubeflow-trainer-controller-manager-596c46d97c-b4kj5\" (UID: \"33da968c-bf90-4c49-af0d-bd4324f19894\") " pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" Sep 10 12:28:23.193577 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:23.193555 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/33da968c-bf90-4c49-af0d-bd4324f19894-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-596c46d97c-b4kj5\" (UID: \"33da968c-bf90-4c49-af0d-bd4324f19894\") " pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" Sep 10 12:28:23.195366 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:23.195350 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33da968c-bf90-4c49-af0d-bd4324f19894-cert\") pod \"kubeflow-trainer-controller-manager-596c46d97c-b4kj5\" (UID: \"33da968c-bf90-4c49-af0d-bd4324f19894\") " pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" Sep 10 12:28:23.202756 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:23.202731 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvtsj\" (UniqueName: \"kubernetes.io/projected/33da968c-bf90-4c49-af0d-bd4324f19894-kube-api-access-fvtsj\") pod \"kubeflow-trainer-controller-manager-596c46d97c-b4kj5\" (UID: \"33da968c-bf90-4c49-af0d-bd4324f19894\") " pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" Sep 10 12:28:23.281551 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:23.281523 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" Sep 10 12:28:23.556822 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:23.556796 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5"] Sep 10 12:28:23.559018 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:28:23.558982 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33da968c_bf90_4c49_af0d_bd4324f19894.slice/crio-162b926bef6181eb3f56846efbad67db06544a7f80f6d88d5232f1bfb6d2c259 WatchSource:0}: Error finding container 162b926bef6181eb3f56846efbad67db06544a7f80f6d88d5232f1bfb6d2c259: Status 404 returned error can't find the container with id 162b926bef6181eb3f56846efbad67db06544a7f80f6d88d5232f1bfb6d2c259 Sep 10 12:28:24.077448 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:24.077413 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" event={"ID":"33da968c-bf90-4c49-af0d-bd4324f19894","Type":"ContainerStarted","Data":"162b926bef6181eb3f56846efbad67db06544a7f80f6d88d5232f1bfb6d2c259"} Sep 10 12:28:26.086701 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:26.086615 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" event={"ID":"33da968c-bf90-4c49-af0d-bd4324f19894","Type":"ContainerStarted","Data":"e029c80a133b077b63a4b5357e5e5ad47801c745c400e55b7069f3c9511a83d2"} Sep 10 12:28:26.087121 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:26.086721 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" Sep 10 12:28:26.106567 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:26.106516 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" podStartSLOduration=1.853543673 podStartE2EDuration="4.106500901s" totalImagesPullingTime="2.252957228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:28:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:28:26.10535676 +0000 UTC m=+431.392626439" watchObservedRunningTime="2026-09-10 12:28:26.106500901 +0000 UTC m=+431.393770604" Sep 10 12:28:27.717863 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:27.717823 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:28:27.788261 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:27.788232 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:28:42.094071 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:42.093983 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" podUID="33da968c-bf90-4c49-af0d-bd4324f19894" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 10 12:28:57.093458 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:28:57.093416 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" podUID="33da968c-bf90-4c49-af0d-bd4324f19894" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 10 12:29:12.092309 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:29:12.092262 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" podUID="33da968c-bf90-4c49-af0d-bd4324f19894" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 10 12:29:16.898367 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:29:16.898332 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:29:27.092851 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:29:27.092809 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" podUID="33da968c-bf90-4c49-af0d-bd4324f19894" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 10 12:29:42.093790 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:29:42.093747 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" podUID="33da968c-bf90-4c49-af0d-bd4324f19894" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 10 12:29:55.206612 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:29:55.206574 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" podUID="33da968c-bf90-4c49-af0d-bd4324f19894" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 10 12:30:10.206940 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:30:10.206857 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" podUID="33da968c-bf90-4c49-af0d-bd4324f19894" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 10 12:30:25.205931 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:30:25.205891 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" podUID="33da968c-bf90-4c49-af0d-bd4324f19894" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 10 12:30:40.207378 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:30:40.207331 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" podUID="33da968c-bf90-4c49-af0d-bd4324f19894" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 10 12:30:55.206776 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:30:55.206737 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" podUID="33da968c-bf90-4c49-af0d-bd4324f19894" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 10 12:31:10.206796 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:31:10.206754 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" podUID="33da968c-bf90-4c49-af0d-bd4324f19894" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 10 12:31:21.205277 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:31:21.205252 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-596c46d97c-b4kj5" Sep 10 12:32:22.042472 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:32:22.042437 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:32:22.176631 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:32:22.176605 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr"] Sep 10 12:32:22.179793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:32:22.179776 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" Sep 10 12:32:22.182580 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:32:22.182557 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-c9ffl\"/\"kube-root-ca.crt\"" Sep 10 12:32:22.182742 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:32:22.182723 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-c9ffl\"/\"openshift-service-ca.crt\"" Sep 10 12:32:22.182809 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:32:22.182784 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-c9ffl\"/\"default-dockercfg-z56hh\"" Sep 10 12:32:22.192664 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:32:22.192641 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr"] Sep 10 12:32:22.282913 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:32:22.282885 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjhd7\" (UniqueName: \"kubernetes.io/projected/c48f194f-3e74-4a01-b942-2429c78d42da-kube-api-access-sjhd7\") pod \"progression-enabled-node-0-0-bjtvr\" (UID: \"c48f194f-3e74-4a01-b942-2429c78d42da\") " pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" Sep 10 12:32:22.384337 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:32:22.384267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjhd7\" (UniqueName: \"kubernetes.io/projected/c48f194f-3e74-4a01-b942-2429c78d42da-kube-api-access-sjhd7\") pod \"progression-enabled-node-0-0-bjtvr\" (UID: \"c48f194f-3e74-4a01-b942-2429c78d42da\") " pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" Sep 10 12:32:22.394089 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:32:22.394060 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjhd7\" (UniqueName: \"kubernetes.io/projected/c48f194f-3e74-4a01-b942-2429c78d42da-kube-api-access-sjhd7\") pod \"progression-enabled-node-0-0-bjtvr\" (UID: \"c48f194f-3e74-4a01-b942-2429c78d42da\") " pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" Sep 10 12:32:22.489610 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:32:22.489587 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" Sep 10 12:32:22.764952 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:32:22.764927 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr"] Sep 10 12:32:22.766667 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:32:22.766636 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48f194f_3e74_4a01_b942_2429c78d42da.slice/crio-9e49cd9fb0d09d63d76ed74453b51d3f3ae13452f5f375792b29b227c6ee9643 WatchSource:0}: Error finding container 9e49cd9fb0d09d63d76ed74453b51d3f3ae13452f5f375792b29b227c6ee9643: Status 404 returned error can't find the container with id 9e49cd9fb0d09d63d76ed74453b51d3f3ae13452f5f375792b29b227c6ee9643 Sep 10 12:32:23.032297 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:32:23.032238 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" event={"ID":"c48f194f-3e74-4a01-b942-2429c78d42da","Type":"ContainerStarted","Data":"9e49cd9fb0d09d63d76ed74453b51d3f3ae13452f5f375792b29b227c6ee9643"} Sep 10 12:32:23.622689 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:32:23.622651 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:34:12.550036 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:12.549998 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" event={"ID":"c48f194f-3e74-4a01-b942-2429c78d42da","Type":"ContainerStarted","Data":"c8de9908bcb5fcf648282d2172caec0f792234836aa19fab2847d15f7ce93efd"} Sep 10 12:34:12.550516 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:12.550120 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" Sep 10 12:34:12.599065 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:12.599012 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" podStartSLOduration=1.8148939240000002 podStartE2EDuration="1m50.598997078s" totalImagesPullingTime="1m48.784103154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:32:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:34:12.598685456 +0000 UTC m=+777.885955141" watchObservedRunningTime="2026-09-10 12:34:12.598997078 +0000 UTC m=+777.886266756" Sep 10 12:34:13.553563 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:13.553523 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" Sep 10 12:34:27.150660 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:27.150624 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:34:34.917826 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:34.917780 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" podUID="c48f194f-3e74-4a01-b942-2429c78d42da" containerName="node" probeResult="failure" output="Get \"http://10.133.0.24:28080/metrics\": read tcp 10.133.0.2:52192->10.133.0.24:28080: read: connection reset by peer" Sep 10 12:34:35.550834 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:35.550791 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" podUID="c48f194f-3e74-4a01-b942-2429c78d42da" containerName="node" probeResult="failure" output="Get \"http://10.133.0.24:28080/metrics\": dial tcp 10.133.0.24:28080: connect: connection refused" Sep 10 12:34:35.551019 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:35.550923 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" Sep 10 12:34:35.551518 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:35.551481 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" podUID="c48f194f-3e74-4a01-b942-2429c78d42da" containerName="node" probeResult="failure" output="Get \"http://10.133.0.24:28080/metrics\": dial tcp 10.133.0.24:28080: connect: connection refused" Sep 10 12:34:35.651338 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:35.651306 2574 generic.go:356] "Generic (PLEG): container finished" podID="c48f194f-3e74-4a01-b942-2429c78d42da" containerID="c8de9908bcb5fcf648282d2172caec0f792234836aa19fab2847d15f7ce93efd" exitCode=0 Sep 10 12:34:35.651521 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:35.651382 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" event={"ID":"c48f194f-3e74-4a01-b942-2429c78d42da","Type":"ContainerDied","Data":"c8de9908bcb5fcf648282d2172caec0f792234836aa19fab2847d15f7ce93efd"} Sep 10 12:34:36.805381 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:36.805340 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" Sep 10 12:34:36.895588 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:36.895560 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjhd7\" (UniqueName: \"kubernetes.io/projected/c48f194f-3e74-4a01-b942-2429c78d42da-kube-api-access-sjhd7\") pod \"c48f194f-3e74-4a01-b942-2429c78d42da\" (UID: \"c48f194f-3e74-4a01-b942-2429c78d42da\") " Sep 10 12:34:36.898033 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:36.898010 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c48f194f-3e74-4a01-b942-2429c78d42da-kube-api-access-sjhd7" (OuterVolumeSpecName: "kube-api-access-sjhd7") pod "c48f194f-3e74-4a01-b942-2429c78d42da" (UID: "c48f194f-3e74-4a01-b942-2429c78d42da"). InnerVolumeSpecName "kube-api-access-sjhd7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:34:36.996545 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:36.996509 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjhd7\" (UniqueName: \"kubernetes.io/projected/c48f194f-3e74-4a01-b942-2429c78d42da-kube-api-access-sjhd7\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:34:37.661969 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:37.661931 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" Sep 10 12:34:37.661969 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:37.661950 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr" event={"ID":"c48f194f-3e74-4a01-b942-2429c78d42da","Type":"ContainerDied","Data":"9e49cd9fb0d09d63d76ed74453b51d3f3ae13452f5f375792b29b227c6ee9643"} Sep 10 12:34:37.662205 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:37.662032 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e49cd9fb0d09d63d76ed74453b51d3f3ae13452f5f375792b29b227c6ee9643" Sep 10 12:34:38.818404 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:38.818372 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:34:38.842336 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:38.842309 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt"] Sep 10 12:34:38.842693 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:38.842681 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c48f194f-3e74-4a01-b942-2429c78d42da" containerName="node" Sep 10 12:34:38.842735 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:38.842695 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c48f194f-3e74-4a01-b942-2429c78d42da" containerName="node" Sep 10 12:34:38.842769 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:38.842760 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c48f194f-3e74-4a01-b942-2429c78d42da" containerName="node" Sep 10 12:34:38.864451 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:38.864421 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt" Sep 10 12:34:38.868454 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:38.868427 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt"] Sep 10 12:34:38.869339 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:38.869315 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-c9ffl\"/\"openshift-service-ca.crt\"" Sep 10 12:34:38.869997 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:38.869976 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-c9ffl\"/\"kube-root-ca.crt\"" Sep 10 12:34:38.870555 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:38.870538 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-c9ffl\"/\"default-dockercfg-z56hh\"" Sep 10 12:34:38.912583 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:38.912548 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmnpz\" (UniqueName: \"kubernetes.io/projected/754f74db-2198-4a3f-8ab6-a9737aec60f0-kube-api-access-lmnpz\") pod \"progression-disabled-node-0-0-mzbzt\" (UID: \"754f74db-2198-4a3f-8ab6-a9737aec60f0\") " pod="rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt" Sep 10 12:34:39.013638 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:39.013597 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmnpz\" (UniqueName: \"kubernetes.io/projected/754f74db-2198-4a3f-8ab6-a9737aec60f0-kube-api-access-lmnpz\") pod \"progression-disabled-node-0-0-mzbzt\" (UID: \"754f74db-2198-4a3f-8ab6-a9737aec60f0\") " pod="rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt" Sep 10 12:34:39.024897 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:39.024862 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmnpz\" (UniqueName: \"kubernetes.io/projected/754f74db-2198-4a3f-8ab6-a9737aec60f0-kube-api-access-lmnpz\") pod \"progression-disabled-node-0-0-mzbzt\" (UID: \"754f74db-2198-4a3f-8ab6-a9737aec60f0\") " pod="rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt" Sep 10 12:34:39.176252 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:39.176166 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt" Sep 10 12:34:39.471943 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:39.471901 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt"] Sep 10 12:34:39.473468 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:34:39.473443 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754f74db_2198_4a3f_8ab6_a9737aec60f0.slice/crio-83e8573cf043239998b9749aab61ed98a920e385d9162299d91dd2f2c8df06dd WatchSource:0}: Error finding container 83e8573cf043239998b9749aab61ed98a920e385d9162299d91dd2f2c8df06dd: Status 404 returned error can't find the container with id 83e8573cf043239998b9749aab61ed98a920e385d9162299d91dd2f2c8df06dd Sep 10 12:34:39.674240 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:39.674206 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt" event={"ID":"754f74db-2198-4a3f-8ab6-a9737aec60f0","Type":"ContainerStarted","Data":"521aa90fc00d4561f81da42f18383749383a0987134556dae023e4e047c8c8fd"} Sep 10 12:34:39.674415 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:39.674260 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt" event={"ID":"754f74db-2198-4a3f-8ab6-a9737aec60f0","Type":"ContainerStarted","Data":"83e8573cf043239998b9749aab61ed98a920e385d9162299d91dd2f2c8df06dd"} Sep 10 12:34:39.674415 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:39.674310 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt" Sep 10 12:34:39.697682 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:39.697629 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt" podStartSLOduration=1.6976081 podStartE2EDuration="1.6976081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:34:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:34:39.696372199 +0000 UTC m=+804.983641876" watchObservedRunningTime="2026-09-10 12:34:39.6976081 +0000 UTC m=+804.984877777" Sep 10 12:34:41.682584 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:34:41.682549 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt" Sep 10 12:35:02.732654 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:02.732606 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt" podUID="754f74db-2198-4a3f-8ab6-a9737aec60f0" containerName="node" probeResult="failure" output="Get \"http://10.133.0.25:28080/metrics\": read tcp 10.133.0.2:46954->10.133.0.25:28080: read: connection reset by peer" Sep 10 12:35:02.777055 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:02.777028 2574 generic.go:356] "Generic (PLEG): container finished" podID="754f74db-2198-4a3f-8ab6-a9737aec60f0" containerID="521aa90fc00d4561f81da42f18383749383a0987134556dae023e4e047c8c8fd" exitCode=0 Sep 10 12:35:02.777207 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:02.777102 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt" event={"ID":"754f74db-2198-4a3f-8ab6-a9737aec60f0","Type":"ContainerDied","Data":"521aa90fc00d4561f81da42f18383749383a0987134556dae023e4e047c8c8fd"} Sep 10 12:35:03.909749 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:03.909727 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt" Sep 10 12:35:04.036830 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:04.036743 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmnpz\" (UniqueName: \"kubernetes.io/projected/754f74db-2198-4a3f-8ab6-a9737aec60f0-kube-api-access-lmnpz\") pod \"754f74db-2198-4a3f-8ab6-a9737aec60f0\" (UID: \"754f74db-2198-4a3f-8ab6-a9737aec60f0\") " Sep 10 12:35:04.038818 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:04.038785 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/754f74db-2198-4a3f-8ab6-a9737aec60f0-kube-api-access-lmnpz" (OuterVolumeSpecName: "kube-api-access-lmnpz") pod "754f74db-2198-4a3f-8ab6-a9737aec60f0" (UID: "754f74db-2198-4a3f-8ab6-a9737aec60f0"). InnerVolumeSpecName "kube-api-access-lmnpz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:35:04.137774 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:04.137749 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmnpz\" (UniqueName: \"kubernetes.io/projected/754f74db-2198-4a3f-8ab6-a9737aec60f0-kube-api-access-lmnpz\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:35:04.786935 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:04.786894 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt" event={"ID":"754f74db-2198-4a3f-8ab6-a9737aec60f0","Type":"ContainerDied","Data":"83e8573cf043239998b9749aab61ed98a920e385d9162299d91dd2f2c8df06dd"} Sep 10 12:35:04.786935 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:04.786931 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt" Sep 10 12:35:04.787156 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:04.786967 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83e8573cf043239998b9749aab61ed98a920e385d9162299d91dd2f2c8df06dd" Sep 10 12:35:13.764828 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:13.764786 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff"] Sep 10 12:35:13.765303 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:13.765285 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="754f74db-2198-4a3f-8ab6-a9737aec60f0" containerName="node" Sep 10 12:35:13.765303 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:13.765302 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="754f74db-2198-4a3f-8ab6-a9737aec60f0" containerName="node" Sep 10 12:35:13.765418 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:13.765405 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="754f74db-2198-4a3f-8ab6-a9737aec60f0" containerName="node" Sep 10 12:35:13.767729 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:13.767712 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff" Sep 10 12:35:13.771462 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:13.771346 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-c9ffl\"/\"kube-root-ca.crt\"" Sep 10 12:35:13.771462 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:13.771429 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-c9ffl\"/\"openshift-service-ca.crt\"" Sep 10 12:35:13.772239 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:13.772218 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-c9ffl\"/\"default-dockercfg-z56hh\"" Sep 10 12:35:13.785625 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:13.785600 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff"] Sep 10 12:35:13.807620 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:13.807585 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:35:13.923128 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:13.923095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f95qt\" (UniqueName: \"kubernetes.io/projected/c2667100-503c-44f0-bffa-bc8c18be3e5a-kube-api-access-f95qt\") pod \"progression-invalid-node-0-0-nx7ff\" (UID: \"c2667100-503c-44f0-bffa-bc8c18be3e5a\") " pod="rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff" Sep 10 12:35:14.023790 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:14.023711 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f95qt\" (UniqueName: \"kubernetes.io/projected/c2667100-503c-44f0-bffa-bc8c18be3e5a-kube-api-access-f95qt\") pod \"progression-invalid-node-0-0-nx7ff\" (UID: \"c2667100-503c-44f0-bffa-bc8c18be3e5a\") " pod="rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff" Sep 10 12:35:14.033530 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:14.033498 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f95qt\" (UniqueName: \"kubernetes.io/projected/c2667100-503c-44f0-bffa-bc8c18be3e5a-kube-api-access-f95qt\") pod \"progression-invalid-node-0-0-nx7ff\" (UID: \"c2667100-503c-44f0-bffa-bc8c18be3e5a\") " pod="rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff" Sep 10 12:35:14.081337 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:14.081315 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff" Sep 10 12:35:14.359031 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:14.359009 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff"] Sep 10 12:35:14.360956 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:35:14.360926 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2667100_503c_44f0_bffa_bc8c18be3e5a.slice/crio-dcf42ed25d06f21a1df972d12528f6494bc03908c1234d00b596af225af8bad6 WatchSource:0}: Error finding container dcf42ed25d06f21a1df972d12528f6494bc03908c1234d00b596af225af8bad6: Status 404 returned error can't find the container with id dcf42ed25d06f21a1df972d12528f6494bc03908c1234d00b596af225af8bad6 Sep 10 12:35:14.834187 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:14.834115 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff" event={"ID":"c2667100-503c-44f0-bffa-bc8c18be3e5a","Type":"ContainerStarted","Data":"bbfadf5c35d767d53486721b0ce6429a9b561d79191be92fcd5a54aa437331ac"} Sep 10 12:35:14.834531 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:14.834211 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff" Sep 10 12:35:14.834531 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:14.834232 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff" event={"ID":"c2667100-503c-44f0-bffa-bc8c18be3e5a","Type":"ContainerStarted","Data":"dcf42ed25d06f21a1df972d12528f6494bc03908c1234d00b596af225af8bad6"} Sep 10 12:35:14.856934 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:14.856889 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff" podStartSLOduration=1.856874382 podStartE2EDuration="1.856874382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:35:14.855950886 +0000 UTC m=+840.143220565" watchObservedRunningTime="2026-09-10 12:35:14.856874382 +0000 UTC m=+840.144144060" Sep 10 12:35:16.842952 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:16.842923 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff" Sep 10 12:35:28.867605 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:28.867530 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:35:29.444433 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:29.444389 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:35:37.840823 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:37.840784 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff" podUID="c2667100-503c-44f0-bffa-bc8c18be3e5a" containerName="node" probeResult="failure" output="Get \"http://10.133.0.26:28080/metrics\": dial tcp 10.133.0.26:28080: connect: connection refused" Sep 10 12:35:37.940256 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:37.940221 2574 generic.go:356] "Generic (PLEG): container finished" podID="c2667100-503c-44f0-bffa-bc8c18be3e5a" containerID="bbfadf5c35d767d53486721b0ce6429a9b561d79191be92fcd5a54aa437331ac" exitCode=0 Sep 10 12:35:37.940419 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:37.940258 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff" event={"ID":"c2667100-503c-44f0-bffa-bc8c18be3e5a","Type":"ContainerDied","Data":"bbfadf5c35d767d53486721b0ce6429a9b561d79191be92fcd5a54aa437331ac"} Sep 10 12:35:39.066814 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:39.066791 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff" Sep 10 12:35:39.123827 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:39.123802 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f95qt\" (UniqueName: \"kubernetes.io/projected/c2667100-503c-44f0-bffa-bc8c18be3e5a-kube-api-access-f95qt\") pod \"c2667100-503c-44f0-bffa-bc8c18be3e5a\" (UID: \"c2667100-503c-44f0-bffa-bc8c18be3e5a\") " Sep 10 12:35:39.125898 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:39.125873 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2667100-503c-44f0-bffa-bc8c18be3e5a-kube-api-access-f95qt" (OuterVolumeSpecName: "kube-api-access-f95qt") pod "c2667100-503c-44f0-bffa-bc8c18be3e5a" (UID: "c2667100-503c-44f0-bffa-bc8c18be3e5a"). InnerVolumeSpecName "kube-api-access-f95qt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:35:39.224519 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:39.224493 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f95qt\" (UniqueName: \"kubernetes.io/projected/c2667100-503c-44f0-bffa-bc8c18be3e5a-kube-api-access-f95qt\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:35:39.950342 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:39.950310 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff" event={"ID":"c2667100-503c-44f0-bffa-bc8c18be3e5a","Type":"ContainerDied","Data":"dcf42ed25d06f21a1df972d12528f6494bc03908c1234d00b596af225af8bad6"} Sep 10 12:35:39.950478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:39.950352 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcf42ed25d06f21a1df972d12528f6494bc03908c1234d00b596af225af8bad6" Sep 10 12:35:39.950478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:35:39.950315 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff" Sep 10 12:36:26.462542 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:36:26.462453 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:37:31.568900 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:31.568868 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:37:31.594038 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:31.594012 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb"] Sep 10 12:37:31.594416 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:31.594399 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2667100-503c-44f0-bffa-bc8c18be3e5a" containerName="node" Sep 10 12:37:31.594496 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:31.594419 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2667100-503c-44f0-bffa-bc8c18be3e5a" containerName="node" Sep 10 12:37:31.594551 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:31.594517 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2667100-503c-44f0-bffa-bc8c18be3e5a" containerName="node" Sep 10 12:37:31.596214 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:31.596196 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb" Sep 10 12:37:31.599198 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:31.599177 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-c9ffl\"/\"openshift-service-ca.crt\"" Sep 10 12:37:31.600551 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:31.600531 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-c9ffl\"/\"default-dockercfg-z56hh\"" Sep 10 12:37:31.600624 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:31.600555 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-c9ffl\"/\"kube-root-ca.crt\"" Sep 10 12:37:31.611319 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:31.611292 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb"] Sep 10 12:37:31.669179 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:31.669128 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52mfh\" (UniqueName: \"kubernetes.io/projected/868a08d7-254e-41fc-b3cd-d7af955da225-kube-api-access-52mfh\") pod \"progression-no-metrics-node-0-0-twvsb\" (UID: \"868a08d7-254e-41fc-b3cd-d7af955da225\") " pod="rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb" Sep 10 12:37:31.770467 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:31.770436 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52mfh\" (UniqueName: \"kubernetes.io/projected/868a08d7-254e-41fc-b3cd-d7af955da225-kube-api-access-52mfh\") pod \"progression-no-metrics-node-0-0-twvsb\" (UID: \"868a08d7-254e-41fc-b3cd-d7af955da225\") " pod="rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb" Sep 10 12:37:31.780955 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:31.780926 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52mfh\" (UniqueName: \"kubernetes.io/projected/868a08d7-254e-41fc-b3cd-d7af955da225-kube-api-access-52mfh\") pod \"progression-no-metrics-node-0-0-twvsb\" (UID: \"868a08d7-254e-41fc-b3cd-d7af955da225\") " pod="rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb" Sep 10 12:37:31.905249 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:31.905165 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb" Sep 10 12:37:32.183464 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:32.183442 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb"] Sep 10 12:37:32.185045 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:37:32.185023 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868a08d7_254e_41fc_b3cd_d7af955da225.slice/crio-532f27c78bcd3c7b1a36cade3de6b59a93ca89186888854cc099a3096fce66be WatchSource:0}: Error finding container 532f27c78bcd3c7b1a36cade3de6b59a93ca89186888854cc099a3096fce66be: Status 404 returned error can't find the container with id 532f27c78bcd3c7b1a36cade3de6b59a93ca89186888854cc099a3096fce66be Sep 10 12:37:32.473090 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:32.473053 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb" event={"ID":"868a08d7-254e-41fc-b3cd-d7af955da225","Type":"ContainerStarted","Data":"7ca94a2287003c25affef70f35b376d2576f8b146025077ca4f6b05905a27fc7"} Sep 10 12:37:32.473268 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:32.473112 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb" event={"ID":"868a08d7-254e-41fc-b3cd-d7af955da225","Type":"ContainerStarted","Data":"532f27c78bcd3c7b1a36cade3de6b59a93ca89186888854cc099a3096fce66be"} Sep 10 12:37:32.496758 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:32.496710 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb" podStartSLOduration=1.496693858 podStartE2EDuration="1.496693858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:37:32.495376374 +0000 UTC m=+977.782646063" watchObservedRunningTime="2026-09-10 12:37:32.496693858 +0000 UTC m=+977.783963536" Sep 10 12:37:37.504024 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:37.503996 2574 generic.go:356] "Generic (PLEG): container finished" podID="868a08d7-254e-41fc-b3cd-d7af955da225" containerID="7ca94a2287003c25affef70f35b376d2576f8b146025077ca4f6b05905a27fc7" exitCode=0 Sep 10 12:37:37.504382 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:37.504064 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb" event={"ID":"868a08d7-254e-41fc-b3cd-d7af955da225","Type":"ContainerDied","Data":"7ca94a2287003c25affef70f35b376d2576f8b146025077ca4f6b05905a27fc7"} Sep 10 12:37:38.638512 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:38.638489 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb" Sep 10 12:37:38.733724 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:38.733690 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52mfh\" (UniqueName: \"kubernetes.io/projected/868a08d7-254e-41fc-b3cd-d7af955da225-kube-api-access-52mfh\") pod \"868a08d7-254e-41fc-b3cd-d7af955da225\" (UID: \"868a08d7-254e-41fc-b3cd-d7af955da225\") " Sep 10 12:37:38.735897 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:38.735870 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/868a08d7-254e-41fc-b3cd-d7af955da225-kube-api-access-52mfh" (OuterVolumeSpecName: "kube-api-access-52mfh") pod "868a08d7-254e-41fc-b3cd-d7af955da225" (UID: "868a08d7-254e-41fc-b3cd-d7af955da225"). InnerVolumeSpecName "kube-api-access-52mfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:37:38.835216 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:38.835112 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52mfh\" (UniqueName: \"kubernetes.io/projected/868a08d7-254e-41fc-b3cd-d7af955da225-kube-api-access-52mfh\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:37:39.514554 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:39.514524 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb" event={"ID":"868a08d7-254e-41fc-b3cd-d7af955da225","Type":"ContainerDied","Data":"532f27c78bcd3c7b1a36cade3de6b59a93ca89186888854cc099a3096fce66be"} Sep 10 12:37:39.514709 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:39.514568 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="532f27c78bcd3c7b1a36cade3de6b59a93ca89186888854cc099a3096fce66be" Sep 10 12:37:39.514709 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:39.514572 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb" Sep 10 12:37:41.670766 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:41.670737 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:37:42.056389 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.056357 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pzx2d/must-gather-hl7k7"] Sep 10 12:37:42.056702 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.056689 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="868a08d7-254e-41fc-b3cd-d7af955da225" containerName="node" Sep 10 12:37:42.056754 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.056704 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="868a08d7-254e-41fc-b3cd-d7af955da225" containerName="node" Sep 10 12:37:42.056793 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.056766 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="868a08d7-254e-41fc-b3cd-d7af955da225" containerName="node" Sep 10 12:37:42.058675 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.058658 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pzx2d/must-gather-hl7k7" Sep 10 12:37:42.062552 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.062532 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pzx2d\"/\"kube-root-ca.crt\"" Sep 10 12:37:42.062708 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.062536 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pzx2d\"/\"default-dockercfg-ntc27\"" Sep 10 12:37:42.062838 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.062825 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pzx2d\"/\"openshift-service-ca.crt\"" Sep 10 12:37:42.072330 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.072308 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pzx2d/must-gather-hl7k7"] Sep 10 12:37:42.105468 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.105449 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:37:42.164826 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.164793 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zvkx\" (UniqueName: \"kubernetes.io/projected/5086778f-3aa8-4344-a23c-671619b6e317-kube-api-access-4zvkx\") pod \"must-gather-hl7k7\" (UID: \"5086778f-3aa8-4344-a23c-671619b6e317\") " pod="openshift-must-gather-pzx2d/must-gather-hl7k7" Sep 10 12:37:42.164924 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.164831 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5086778f-3aa8-4344-a23c-671619b6e317-must-gather-output\") pod \"must-gather-hl7k7\" (UID: \"5086778f-3aa8-4344-a23c-671619b6e317\") " pod="openshift-must-gather-pzx2d/must-gather-hl7k7" Sep 10 12:37:42.200383 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.200361 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:37:42.265659 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.265623 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvkx\" (UniqueName: \"kubernetes.io/projected/5086778f-3aa8-4344-a23c-671619b6e317-kube-api-access-4zvkx\") pod \"must-gather-hl7k7\" (UID: \"5086778f-3aa8-4344-a23c-671619b6e317\") " pod="openshift-must-gather-pzx2d/must-gather-hl7k7" Sep 10 12:37:42.265659 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.265657 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5086778f-3aa8-4344-a23c-671619b6e317-must-gather-output\") pod \"must-gather-hl7k7\" (UID: \"5086778f-3aa8-4344-a23c-671619b6e317\") " pod="openshift-must-gather-pzx2d/must-gather-hl7k7" Sep 10 12:37:42.265988 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.265972 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5086778f-3aa8-4344-a23c-671619b6e317-must-gather-output\") pod \"must-gather-hl7k7\" (UID: \"5086778f-3aa8-4344-a23c-671619b6e317\") " pod="openshift-must-gather-pzx2d/must-gather-hl7k7" Sep 10 12:37:42.275369 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.275341 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zvkx\" (UniqueName: \"kubernetes.io/projected/5086778f-3aa8-4344-a23c-671619b6e317-kube-api-access-4zvkx\") pod \"must-gather-hl7k7\" (UID: \"5086778f-3aa8-4344-a23c-671619b6e317\") " pod="openshift-must-gather-pzx2d/must-gather-hl7k7" Sep 10 12:37:42.368246 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.368172 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pzx2d/must-gather-hl7k7" Sep 10 12:37:42.647427 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.647402 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pzx2d/must-gather-hl7k7"] Sep 10 12:37:42.649338 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:37:42.649314 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5086778f_3aa8_4344_a23c_671619b6e317.slice/crio-7b5442c4ae04776aab95c7ae32659ffe9cb9a70f3fd5da9495b69cac14331c44 WatchSource:0}: Error finding container 7b5442c4ae04776aab95c7ae32659ffe9cb9a70f3fd5da9495b69cac14331c44: Status 404 returned error can't find the container with id 7b5442c4ae04776aab95c7ae32659ffe9cb9a70f3fd5da9495b69cac14331c44 Sep 10 12:37:42.651012 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:42.650997 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 12:37:43.535747 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:43.535710 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pzx2d/must-gather-hl7k7" event={"ID":"5086778f-3aa8-4344-a23c-671619b6e317","Type":"ContainerStarted","Data":"7b5442c4ae04776aab95c7ae32659ffe9cb9a70f3fd5da9495b69cac14331c44"} Sep 10 12:37:46.646286 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:46.646253 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt"] Sep 10 12:37:46.650393 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:46.650365 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-c9ffl/progression-disabled-node-0-0-mzbzt"] Sep 10 12:37:46.658193 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:46.658170 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr"] Sep 10 12:37:46.665627 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:46.665608 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-c9ffl/progression-enabled-node-0-0-bjtvr"] Sep 10 12:37:46.671718 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:46.671699 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff"] Sep 10 12:37:46.675825 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:46.675804 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-c9ffl/progression-invalid-node-0-0-nx7ff"] Sep 10 12:37:46.695070 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:46.695046 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb"] Sep 10 12:37:46.697515 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:46.697496 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-c9ffl/progression-no-metrics-node-0-0-twvsb"] Sep 10 12:37:46.918497 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:46.918423 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:37:47.018461 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:47.018423 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:37:47.207816 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:47.207681 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="754f74db-2198-4a3f-8ab6-a9737aec60f0" path="/var/lib/kubelet/pods/754f74db-2198-4a3f-8ab6-a9737aec60f0/volumes" Sep 10 12:37:47.208168 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:47.208130 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="868a08d7-254e-41fc-b3cd-d7af955da225" path="/var/lib/kubelet/pods/868a08d7-254e-41fc-b3cd-d7af955da225/volumes" Sep 10 12:37:47.208595 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:47.208577 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2667100-503c-44f0-bffa-bc8c18be3e5a" path="/var/lib/kubelet/pods/c2667100-503c-44f0-bffa-bc8c18be3e5a/volumes" Sep 10 12:37:47.208957 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:47.208940 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c48f194f-3e74-4a01-b942-2429c78d42da" path="/var/lib/kubelet/pods/c48f194f-3e74-4a01-b942-2429c78d42da/volumes" Sep 10 12:37:48.142276 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:48.142245 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:37:48.228154 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:48.228084 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:37:49.570838 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:49.570801 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pzx2d/must-gather-hl7k7" event={"ID":"5086778f-3aa8-4344-a23c-671619b6e317","Type":"ContainerStarted","Data":"0a128a1bc94d259c8f35e141237c23c57b6948352d106737669ecca9d756c965"} Sep 10 12:37:49.571391 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:49.570855 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pzx2d/must-gather-hl7k7" event={"ID":"5086778f-3aa8-4344-a23c-671619b6e317","Type":"ContainerStarted","Data":"2fdab9cb327c300873e4e6515962714743509910db2110b7a4ea347ee98f36c9"} Sep 10 12:37:49.591245 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:37:49.591198 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pzx2d/must-gather-hl7k7" podStartSLOduration=1.205179941 podStartE2EDuration="7.591183527s" totalImagesPullingTime="6.386003586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 12:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:37:49.589310157 +0000 UTC m=+994.876579835" watchObservedRunningTime="2026-09-10 12:37:49.591183527 +0000 UTC m=+994.878453204" Sep 10 12:38:36.827366 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:36.827333 2574 generic.go:356] "Generic (PLEG): container finished" podID="5086778f-3aa8-4344-a23c-671619b6e317" containerID="2fdab9cb327c300873e4e6515962714743509910db2110b7a4ea347ee98f36c9" exitCode=0 Sep 10 12:38:36.827751 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:36.827407 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pzx2d/must-gather-hl7k7" event={"ID":"5086778f-3aa8-4344-a23c-671619b6e317","Type":"ContainerDied","Data":"2fdab9cb327c300873e4e6515962714743509910db2110b7a4ea347ee98f36c9"} Sep 10 12:38:36.827751 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:36.827726 2574 scope.go:117] "RemoveContainer" containerID="2fdab9cb327c300873e4e6515962714743509910db2110b7a4ea347ee98f36c9" Sep 10 12:38:37.334580 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:37.334552 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pzx2d_must-gather-hl7k7_5086778f-3aa8-4344-a23c-671619b6e317/gather/0.log" Sep 10 12:38:37.696497 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:37.696423 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:38:37.852040 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:37.852010 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:38:37.914236 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:37.914197 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:38:41.878622 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:41.878551 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w88dt_7837a526-e410-47f6-8676-b6737e88b1e6/global-pull-secret-syncer/0.log" Sep 10 12:38:41.945209 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:41.945184 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" Sep 10 12:38:42.108053 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:42.108025 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-132.ec2.internal_0fc9a15e83fe3b4f3cd821df1a82359f/haproxy/0.log" Sep 10 12:38:42.665220 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:42.665190 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-pzx2d/must-gather-hl7k7"] Sep 10 12:38:42.665436 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:42.665411 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-pzx2d/must-gather-hl7k7" podUID="5086778f-3aa8-4344-a23c-671619b6e317" containerName="copy" containerID="cri-o://0a128a1bc94d259c8f35e141237c23c57b6948352d106737669ecca9d756c965" gracePeriod=2 Sep 10 12:38:42.667909 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:38:42.667879 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hl7k7\" is forbidden: User \"system:node:ip-10-0-130-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-pzx2d\": no relationship found between node 'ip-10-0-130-132.ec2.internal' and this object" podUID="5086778f-3aa8-4344-a23c-671619b6e317" pod="openshift-must-gather-pzx2d/must-gather-hl7k7" Sep 10 12:38:42.669747 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:42.669441 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-pzx2d/must-gather-hl7k7"] Sep 10 12:38:42.856618 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:42.856595 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pzx2d_must-gather-hl7k7_5086778f-3aa8-4344-a23c-671619b6e317/copy/0.log" Sep 10 12:38:42.856996 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:42.856976 2574 generic.go:356] "Generic (PLEG): container finished" podID="5086778f-3aa8-4344-a23c-671619b6e317" containerID="0a128a1bc94d259c8f35e141237c23c57b6948352d106737669ecca9d756c965" exitCode=143 Sep 10 12:38:42.900829 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:42.900812 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pzx2d_must-gather-hl7k7_5086778f-3aa8-4344-a23c-671619b6e317/copy/0.log" Sep 10 12:38:42.903442 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:42.903427 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pzx2d/must-gather-hl7k7" Sep 10 12:38:42.906199 ip-10-0-130-132 kubenswrapper[2574]: E0910 12:38:42.906176 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-hl7k7\" is forbidden: User \"system:node:ip-10-0-130-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-pzx2d\": no relationship found between node 'ip-10-0-130-132.ec2.internal' and this object" podUID="5086778f-3aa8-4344-a23c-671619b6e317" pod="openshift-must-gather-pzx2d/must-gather-hl7k7" Sep 10 12:38:43.003483 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:43.003465 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5086778f-3aa8-4344-a23c-671619b6e317-must-gather-output\") pod \"5086778f-3aa8-4344-a23c-671619b6e317\" (UID: \"5086778f-3aa8-4344-a23c-671619b6e317\") " Sep 10 12:38:43.003604 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:43.003506 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zvkx\" (UniqueName: \"kubernetes.io/projected/5086778f-3aa8-4344-a23c-671619b6e317-kube-api-access-4zvkx\") pod \"5086778f-3aa8-4344-a23c-671619b6e317\" (UID: \"5086778f-3aa8-4344-a23c-671619b6e317\") " Sep 10 12:38:43.004858 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:43.004837 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5086778f-3aa8-4344-a23c-671619b6e317-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "5086778f-3aa8-4344-a23c-671619b6e317" (UID: "5086778f-3aa8-4344-a23c-671619b6e317"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 12:38:43.005823 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:43.005804 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5086778f-3aa8-4344-a23c-671619b6e317-kube-api-access-4zvkx" (OuterVolumeSpecName: "kube-api-access-4zvkx") pod "5086778f-3aa8-4344-a23c-671619b6e317" (UID: "5086778f-3aa8-4344-a23c-671619b6e317"). InnerVolumeSpecName "kube-api-access-4zvkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 12:38:43.104468 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:43.104432 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zvkx\" (UniqueName: \"kubernetes.io/projected/5086778f-3aa8-4344-a23c-671619b6e317-kube-api-access-4zvkx\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:38:43.104468 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:43.104467 2574 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5086778f-3aa8-4344-a23c-671619b6e317-must-gather-output\") on node \"ip-10-0-130-132.ec2.internal\" DevicePath \"\"" Sep 10 12:38:43.205255 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:43.205224 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5086778f-3aa8-4344-a23c-671619b6e317" path="/var/lib/kubelet/pods/5086778f-3aa8-4344-a23c-671619b6e317/volumes" Sep 10 12:38:43.366492 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:43.366419 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:38:43.471311 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:43.471278 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54t2x_ce1f09e0-b23e-483b-bb9a-4727b0a8157e/konnectivity-agent/0.log" limit=1024 Sep 10 12:38:43.862802 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:43.862777 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pzx2d_must-gather-hl7k7_5086778f-3aa8-4344-a23c-671619b6e317/copy/0.log" Sep 10 12:38:43.863186 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:43.863171 2574 scope.go:117] "RemoveContainer" containerID="0a128a1bc94d259c8f35e141237c23c57b6948352d106737669ecca9d756c965" Sep 10 12:38:43.863186 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:43.863180 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pzx2d/must-gather-hl7k7" Sep 10 12:38:43.870939 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:43.870924 2574 scope.go:117] "RemoveContainer" containerID="2fdab9cb327c300873e4e6515962714743509910db2110b7a4ea347ee98f36c9" Sep 10 12:38:45.746296 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:45.746273 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_871ef10f-6a89-429b-8185-ed8650472552/alertmanager/0.log" Sep 10 12:38:45.800090 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:45.800066 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_871ef10f-6a89-429b-8185-ed8650472552/config-reloader/0.log" Sep 10 12:38:45.835845 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:45.835825 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_871ef10f-6a89-429b-8185-ed8650472552/kube-rbac-proxy-web/0.log" Sep 10 12:38:45.872972 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:45.872914 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_871ef10f-6a89-429b-8185-ed8650472552/kube-rbac-proxy/0.log" Sep 10 12:38:45.905734 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:45.905711 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_871ef10f-6a89-429b-8185-ed8650472552/kube-rbac-proxy-metric/0.log" Sep 10 12:38:45.937847 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:45.937828 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_871ef10f-6a89-429b-8185-ed8650472552/prom-label-proxy/0.log" Sep 10 12:38:45.970511 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:45.970473 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_871ef10f-6a89-429b-8185-ed8650472552/init-config-reloader/0.log" Sep 10 12:38:46.053631 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.053611 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-mb9p8_7ab4cbec-fb0b-4359-ab8d-0b158e241134/kube-state-metrics/0.log" Sep 10 12:38:46.086354 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.086329 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-mb9p8_7ab4cbec-fb0b-4359-ab8d-0b158e241134/kube-rbac-proxy-main/0.log" Sep 10 12:38:46.121596 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.121557 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-mb9p8_7ab4cbec-fb0b-4359-ab8d-0b158e241134/kube-rbac-proxy-self/0.log" Sep 10 12:38:46.148636 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.148580 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f9bc6c697-r9fpq_20aba482-8995-4b13-b0c2-ffa1df7ebe50/metrics-server/0.log" Sep 10 12:38:46.183128 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.183112 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-9pqcz_b729596f-cec0-4331-ac58-03aee1ffa876/monitoring-plugin/0.log" Sep 10 12:38:46.402767 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.402699 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wk25k_7050b131-deab-43ef-85df-4bc05dcae778/node-exporter/0.log" Sep 10 12:38:46.432079 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.432058 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wk25k_7050b131-deab-43ef-85df-4bc05dcae778/kube-rbac-proxy/0.log" Sep 10 12:38:46.467478 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.467458 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wk25k_7050b131-deab-43ef-85df-4bc05dcae778/init-textfile/0.log" Sep 10 12:38:46.590522 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.590491 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f16c9fa0-a8aa-410d-b72e-c1d0387b8987/prometheus/0.log" Sep 10 12:38:46.624852 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.624829 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f16c9fa0-a8aa-410d-b72e-c1d0387b8987/config-reloader/0.log" Sep 10 12:38:46.652639 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.652621 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f16c9fa0-a8aa-410d-b72e-c1d0387b8987/thanos-sidecar/0.log" Sep 10 12:38:46.678867 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.678819 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f16c9fa0-a8aa-410d-b72e-c1d0387b8987/kube-rbac-proxy-web/0.log" Sep 10 12:38:46.709898 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.709880 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f16c9fa0-a8aa-410d-b72e-c1d0387b8987/kube-rbac-proxy/0.log" Sep 10 12:38:46.737475 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.737458 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f16c9fa0-a8aa-410d-b72e-c1d0387b8987/kube-rbac-proxy-thanos/0.log" Sep 10 12:38:46.768293 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.768277 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f16c9fa0-a8aa-410d-b72e-c1d0387b8987/init-config-reloader/0.log" Sep 10 12:38:46.804465 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.804359 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-kqzfd_90ae54f4-6a24-415f-a59c-eaa6f1fb55c8/prometheus-operator/0.log" Sep 10 12:38:46.839574 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.839551 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-kqzfd_90ae54f4-6a24-415f-a59c-eaa6f1fb55c8/kube-rbac-proxy/0.log" Sep 10 12:38:46.884921 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.884892 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-z52fc_d063e011-7e3c-465f-be14-8e69aca02b73/prometheus-operator-admission-webhook/0.log" Sep 10 12:38:46.939186 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.939103 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78dbb99f86-2zwbx_7aacd41a-dcc8-41ba-9b1b-c1609888636a/telemeter-client/0.log" Sep 10 12:38:46.981895 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:46.981877 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78dbb99f86-2zwbx_7aacd41a-dcc8-41ba-9b1b-c1609888636a/reload/0.log" Sep 10 12:38:47.020079 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:47.020057 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78dbb99f86-2zwbx_7aacd41a-dcc8-41ba-9b1b-c1609888636a/kube-rbac-proxy/0.log" Sep 10 12:38:47.073542 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:47.073513 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56949df654-rrj6g_a0ef8093-23a2-444c-a035-de84fa81d8ba/thanos-query/0.log" Sep 10 12:38:47.113205 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:47.113169 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56949df654-rrj6g_a0ef8093-23a2-444c-a035-de84fa81d8ba/kube-rbac-proxy-web/0.log" Sep 10 12:38:47.158191 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:47.158171 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56949df654-rrj6g_a0ef8093-23a2-444c-a035-de84fa81d8ba/kube-rbac-proxy/0.log" Sep 10 12:38:47.201628 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:47.201573 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56949df654-rrj6g_a0ef8093-23a2-444c-a035-de84fa81d8ba/prom-label-proxy/0.log" Sep 10 12:38:47.242074 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:47.242046 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56949df654-rrj6g_a0ef8093-23a2-444c-a035-de84fa81d8ba/kube-rbac-proxy-rules/0.log" Sep 10 12:38:47.271678 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:47.271658 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56949df654-rrj6g_a0ef8093-23a2-444c-a035-de84fa81d8ba/kube-rbac-proxy-metrics/0.log" Sep 10 12:38:49.102687 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.102646 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n"] Sep 10 12:38:49.103198 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.103095 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5086778f-3aa8-4344-a23c-671619b6e317" containerName="copy" Sep 10 12:38:49.103198 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.103120 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5086778f-3aa8-4344-a23c-671619b6e317" containerName="copy" Sep 10 12:38:49.103198 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.103166 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5086778f-3aa8-4344-a23c-671619b6e317" containerName="gather" Sep 10 12:38:49.103198 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.103176 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5086778f-3aa8-4344-a23c-671619b6e317" containerName="gather" Sep 10 12:38:49.103472 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.103267 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5086778f-3aa8-4344-a23c-671619b6e317" containerName="gather" Sep 10 12:38:49.103472 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.103279 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5086778f-3aa8-4344-a23c-671619b6e317" containerName="copy" Sep 10 12:38:49.108045 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.108027 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.111151 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.111121 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6427b\"/\"openshift-service-ca.crt\"" Sep 10 12:38:49.112079 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.112060 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6427b\"/\"kube-root-ca.crt\"" Sep 10 12:38:49.117547 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.117525 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n"] Sep 10 12:38:49.119178 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.119159 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6427b\"/\"default-dockercfg-nm7wn\"" Sep 10 12:38:49.156655 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.156623 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4412f16-9211-4d3d-8825-78ac188f1a78-sys\") pod \"perf-node-gather-daemonset-m4t8n\" (UID: \"a4412f16-9211-4d3d-8825-78ac188f1a78\") " pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.156775 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.156660 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a4412f16-9211-4d3d-8825-78ac188f1a78-proc\") pod \"perf-node-gather-daemonset-m4t8n\" (UID: \"a4412f16-9211-4d3d-8825-78ac188f1a78\") " pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.156775 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.156689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a4412f16-9211-4d3d-8825-78ac188f1a78-podres\") pod \"perf-node-gather-daemonset-m4t8n\" (UID: \"a4412f16-9211-4d3d-8825-78ac188f1a78\") " pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.156775 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.156762 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxjz5\" (UniqueName: \"kubernetes.io/projected/a4412f16-9211-4d3d-8825-78ac188f1a78-kube-api-access-kxjz5\") pod \"perf-node-gather-daemonset-m4t8n\" (UID: \"a4412f16-9211-4d3d-8825-78ac188f1a78\") " pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.156902 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.156812 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4412f16-9211-4d3d-8825-78ac188f1a78-lib-modules\") pod \"perf-node-gather-daemonset-m4t8n\" (UID: \"a4412f16-9211-4d3d-8825-78ac188f1a78\") " pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.258222 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.258188 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4412f16-9211-4d3d-8825-78ac188f1a78-sys\") pod \"perf-node-gather-daemonset-m4t8n\" (UID: \"a4412f16-9211-4d3d-8825-78ac188f1a78\") " pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.258222 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.258219 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a4412f16-9211-4d3d-8825-78ac188f1a78-proc\") pod \"perf-node-gather-daemonset-m4t8n\" (UID: \"a4412f16-9211-4d3d-8825-78ac188f1a78\") " pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.258407 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.258240 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a4412f16-9211-4d3d-8825-78ac188f1a78-podres\") pod \"perf-node-gather-daemonset-m4t8n\" (UID: \"a4412f16-9211-4d3d-8825-78ac188f1a78\") " pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.258407 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.258263 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxjz5\" (UniqueName: \"kubernetes.io/projected/a4412f16-9211-4d3d-8825-78ac188f1a78-kube-api-access-kxjz5\") pod \"perf-node-gather-daemonset-m4t8n\" (UID: \"a4412f16-9211-4d3d-8825-78ac188f1a78\") " pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.258407 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.258290 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4412f16-9211-4d3d-8825-78ac188f1a78-lib-modules\") pod \"perf-node-gather-daemonset-m4t8n\" (UID: \"a4412f16-9211-4d3d-8825-78ac188f1a78\") " pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.258407 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.258316 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4412f16-9211-4d3d-8825-78ac188f1a78-sys\") pod \"perf-node-gather-daemonset-m4t8n\" (UID: \"a4412f16-9211-4d3d-8825-78ac188f1a78\") " pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.258407 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.258331 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a4412f16-9211-4d3d-8825-78ac188f1a78-proc\") pod \"perf-node-gather-daemonset-m4t8n\" (UID: \"a4412f16-9211-4d3d-8825-78ac188f1a78\") " pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.258407 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.258378 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a4412f16-9211-4d3d-8825-78ac188f1a78-podres\") pod \"perf-node-gather-daemonset-m4t8n\" (UID: \"a4412f16-9211-4d3d-8825-78ac188f1a78\") " pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.258407 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.258390 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4412f16-9211-4d3d-8825-78ac188f1a78-lib-modules\") pod \"perf-node-gather-daemonset-m4t8n\" (UID: \"a4412f16-9211-4d3d-8825-78ac188f1a78\") " pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.267844 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.267820 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxjz5\" (UniqueName: \"kubernetes.io/projected/a4412f16-9211-4d3d-8825-78ac188f1a78-kube-api-access-kxjz5\") pod \"perf-node-gather-daemonset-m4t8n\" (UID: \"a4412f16-9211-4d3d-8825-78ac188f1a78\") " pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.418129 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.418039 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.689366 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.689344 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n"] Sep 10 12:38:49.691462 ip-10-0-130-132 kubenswrapper[2574]: W0910 12:38:49.691432 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda4412f16_9211_4d3d_8825_78ac188f1a78.slice/crio-a764f484bf3351f2d511e7129627c5990e43f712e7f75cb06b38ebd0be123973 WatchSource:0}: Error finding container a764f484bf3351f2d511e7129627c5990e43f712e7f75cb06b38ebd0be123973: Status 404 returned error can't find the container with id a764f484bf3351f2d511e7129627c5990e43f712e7f75cb06b38ebd0be123973 Sep 10 12:38:49.892482 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.892452 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" event={"ID":"a4412f16-9211-4d3d-8825-78ac188f1a78","Type":"ContainerStarted","Data":"6cd06b0213bd2c5314dbdceabd9633ed6173cef5f4bb173e123785904861ec4c"} Sep 10 12:38:49.892605 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.892504 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" event={"ID":"a4412f16-9211-4d3d-8825-78ac188f1a78","Type":"ContainerStarted","Data":"a764f484bf3351f2d511e7129627c5990e43f712e7f75cb06b38ebd0be123973"} Sep 10 12:38:49.892605 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.892534 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:38:49.912631 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:49.912581 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" podStartSLOduration=0.912567052 podStartE2EDuration="912.567052ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 12:38:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 12:38:49.911503773 +0000 UTC m=+1055.198773454" watchObservedRunningTime="2026-09-10 12:38:49.912567052 +0000 UTC m=+1055.199836729" Sep 10 12:38:50.912904 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:50.912878 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9mtfb_4f1a26af-be97-46a4-87a9-6f3e8da1123e/dns/0.log" Sep 10 12:38:50.940617 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:50.940593 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9mtfb_4f1a26af-be97-46a4-87a9-6f3e8da1123e/kube-rbac-proxy/0.log" Sep 10 12:38:50.967410 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:50.967388 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9n2jk_7dd906be-8681-4057-9033-c0abf30b61be/dns-node-resolver/0.log" Sep 10 12:38:51.521060 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:51.521033 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bpn7r_fedf2f8e-9589-4d6a-ba1f-3f0a664e24d4/node-ca/0.log" Sep 10 12:38:52.813533 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:52.813509 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6ckhj_8ade03c9-a18b-4685-b3f5-f5a0afe370db/serve-healthcheck-canary/0.log" Sep 10 12:38:53.282435 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:53.282413 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7pvnm_c6cb426d-295d-410d-b8ca-648bb4caa6f2/kube-rbac-proxy/0.log" Sep 10 12:38:53.307682 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:53.307662 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7pvnm_c6cb426d-295d-410d-b8ca-648bb4caa6f2/exporter/0.log" Sep 10 12:38:53.332027 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:53.332006 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7pvnm_c6cb426d-295d-410d-b8ca-648bb4caa6f2/extractor/0.log" Sep 10 12:38:55.235461 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:55.235432 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-d9psf_5be62120-81ff-4199-8663-664a0b11b6ac/jobset-operator/0.log" Sep 10 12:38:55.907978 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:38:55.907951 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6427b/perf-node-gather-daemonset-m4t8n" Sep 10 12:39:00.813267 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:00.813238 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwlkm_b857cdde-fb6f-46f7-95bb-96227decda7c/kube-multus-additional-cni-plugins/0.log" Sep 10 12:39:00.843719 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:00.843690 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwlkm_b857cdde-fb6f-46f7-95bb-96227decda7c/egress-router-binary-copy/0.log" Sep 10 12:39:00.870530 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:00.870504 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwlkm_b857cdde-fb6f-46f7-95bb-96227decda7c/cni-plugins/0.log" Sep 10 12:39:00.896701 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:00.896674 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwlkm_b857cdde-fb6f-46f7-95bb-96227decda7c/bond-cni-plugin/0.log" Sep 10 12:39:00.923499 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:00.923476 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwlkm_b857cdde-fb6f-46f7-95bb-96227decda7c/routeoverride-cni/0.log" Sep 10 12:39:00.948406 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:00.948364 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwlkm_b857cdde-fb6f-46f7-95bb-96227decda7c/whereabouts-cni-bincopy/0.log" Sep 10 12:39:00.974505 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:00.974484 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rwlkm_b857cdde-fb6f-46f7-95bb-96227decda7c/whereabouts-cni/0.log" Sep 10 12:39:01.011701 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:01.011676 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gmg5v_0dbc8454-9e65-498f-b7aa-7ef0f40aafda/kube-multus/0.log" Sep 10 12:39:01.127959 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:01.127891 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-chlvc_b1def400-ba5c-452a-af47-acdcc7572604/network-metrics-daemon/0.log" Sep 10 12:39:01.152537 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:01.152516 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-chlvc_b1def400-ba5c-452a-af47-acdcc7572604/kube-rbac-proxy/0.log" Sep 10 12:39:02.301364 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:02.301338 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fm7wp_c3aa8845-8086-4c23-92c6-e80ea5bf99a8/ovn-controller/0.log" Sep 10 12:39:02.329731 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:02.329705 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fm7wp_c3aa8845-8086-4c23-92c6-e80ea5bf99a8/ovn-acl-logging/0.log" Sep 10 12:39:02.360713 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:02.360683 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fm7wp_c3aa8845-8086-4c23-92c6-e80ea5bf99a8/kube-rbac-proxy-node/0.log" Sep 10 12:39:02.387379 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:02.387352 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fm7wp_c3aa8845-8086-4c23-92c6-e80ea5bf99a8/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 12:39:02.417784 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:02.417759 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fm7wp_c3aa8845-8086-4c23-92c6-e80ea5bf99a8/northd/0.log" Sep 10 12:39:02.448771 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:02.448746 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fm7wp_c3aa8845-8086-4c23-92c6-e80ea5bf99a8/nbdb/0.log" Sep 10 12:39:02.476353 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:02.476311 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fm7wp_c3aa8845-8086-4c23-92c6-e80ea5bf99a8/sbdb/0.log" Sep 10 12:39:02.523819 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:02.523767 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fm7wp_c3aa8845-8086-4c23-92c6-e80ea5bf99a8/ovnkube-controller/0.log" Sep 10 12:39:03.886407 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:03.886378 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-prnjr_e1c75fe5-5d36-4709-bd85-aec96a0ce2c3/network-check-target-container/0.log" Sep 10 12:39:04.904563 ip-10-0-130-132 kubenswrapper[2574]: I0910 12:39:04.904481 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-bq7sl_58389d29-7343-493e-9d25-a3e1dc81ce6a/iptables-alerter/0.log"